Apr 28 21:58:47 devstack cinder-volume[75179]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75179) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 28 21:58:47 devstack cinder-volume[75179]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75179) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 28 21:58:47 devstack cinder-volume[75179]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75179) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 28 21:58:48 devstack cinder-volume[75179]: INFO dbcounter [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] Registered counter for database cinder
Apr 28 21:58:48 devstack cinder-volume[75179]: DEBUG oslo_db.sqlalchemy.engines [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75179) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 28 21:58:48 devstack cinder-volume[75179]: DEBUG dbcounter [-] [75179] Writer thread running {{(pid=75179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Apr 28 21:58:48 devstack cinder-volume[75179]: INFO cinder.rpc [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 28 21:58:48 devstack cinder-volume[75179]: INFO cinder.rpc [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 28 21:58:48 devstack cinder-volume[75179]: DEBUG oslo_db.sqlalchemy.engines [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75179) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 28 21:58:48 devstack cinder-volume[75179]: INFO cinder.volume.manager [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] Determined volume DB was empty at startup.
Apr 28 21:58:48 devstack cinder-volume[75179]: DEBUG cinder.volume.manager [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75179) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 28 21:58:48 devstack cinder-volume[75179]: INFO cinder.volume.manager [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 28 21:58:48 devstack cinder-volume[75179]: WARNING stevedore.named [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 28 21:58:48 devstack cinder-volume[75179]: WARNING castellan.key_manager [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 28 21:58:48 devstack cinder-volume[75179]: WARNING cinder.keymgr.conf_key_mgr [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 28 21:58:48 devstack cinder-volume[75179]: DEBUG cinder.volume.drivers.lvm [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75179) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_concurrency.processutils [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_concurrency.processutils [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] CMD "cinder-rtstool verify" returned: 0 in 0.343s {{(pid=75179) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_db.sqlalchemy.engines [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75179) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 28 21:58:49 devstack cinder-volume[75179]: INFO cinder.rpc [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Apr 28 21:58:49 devstack cinder-volume[75179]: INFO cinder.rpc [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Apr 28 21:58:49 devstack cinder-volume[75179]: WARNING stevedore.named [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 28 21:58:49 devstack cinder-volume[75179]: WARNING castellan.key_manager [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 28 21:58:49 devstack cinder-volume[75179]: INFO cinder.volume.manager [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_db.sqlalchemy.engines [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75179) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 28 21:58:49 devstack cinder-volume[75179]: INFO oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] Starting 1 workers
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] Started child 75350 {{(pid=75179) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] Full set of CONF: {{(pid=75179) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 28 21:58:49 devstack cinder-volume[75350]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] ******************************************************************************** {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] Configuration options gathered from: {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] ================================================================================ {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] allow_availability_zone_fallback = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] allow_compression_on_image_upload = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] allowed_direct_url_schemes     = [] {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] api_rate_limit                 = True {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] auth_strategy                  = keystone {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] az_cache_duration              = 3600 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_availability_zone      = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_host                   = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_name                   = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_stats_polling_interval = 60 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backup_api_class               = cinder.backup.api.API {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backup_name_template           = backup-%s {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backup_use_same_host           = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backup_use_temp_snapshot       = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] chap_password                  = **** {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] chap_username                  =  {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] cinder_internal_tenant_project_id = 92849d1120714bcf934bcdbd2dd49287 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] cinder_internal_tenant_user_id = ea7b5f36fac84aa3b14d55005b1c94ee {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] cloned_volume_same_az          = True {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] cluster                        = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] compression_format             = gzip {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] compute_api_class              = cinder.compute.nova.API {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] config_dir                     = [] {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] config_source                  = [] {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] control_exchange               = openstack {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] debug                          = True {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] default_availability_zone      = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] default_group_type             = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] default_volume_type            = lvmdriver-1 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] disk_geometry                  = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] driver_client_cert             = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] driver_client_cert_key         = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] driver_data_namespace          = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] driver_ssl_cert_path           = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] driver_ssl_cert_verify         = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] driver_use_ssl                 = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] enable_force_upload            = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] enable_new_services            = True {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] enable_unsupported_driver      = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] enforce_multipath_for_image_xfer = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] filter_function                = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] glance_api_insecure            = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] glance_api_servers             = ['http://192.168.122.185/image'] {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] glance_api_ssl_compression     = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] glance_ca_certificates_file    = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] glance_catalog_info            = image:glance:publicURL {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] glance_certfile                = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] glance_keyfile                 = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] glance_num_retries             = 3 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] glance_request_timeout         = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] goodness_function              = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] graceful_shutdown_timeout      = 5 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] group_api_class                = cinder.group.api.API {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] host                           = devstack {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] image_compress_on_upload       = True {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] image_conversion_address_space_limit = 1 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] image_conversion_cpu_limit     = 60 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] image_conversion_disable       = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] image_upload_use_cinder_backend = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75350]: INFO cinder.volume.manager [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] Starting volume driver LVMVolumeDriver (3.0.0)
Apr 28 21:58:49 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] image_upload_use_internal_tenant = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] image_volume_cache_enabled     = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] image_volume_cache_max_count   = 0 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] image_volume_cache_max_size_gb = 0 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] init_host_max_objects_retrieval = 0 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] iscsi_target_flags             =  {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] iscsi_write_cache              = on {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] iser_helper                    = tgtadm {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] iser_ip_address                = 192.168.122.185 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] iser_port                      = 3260 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] log_color                      = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] log_config_append              = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] log_dir                        = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] log_file                       = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] log_options                    = True {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] log_rotate_interval            = 1 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] log_rotate_interval_type       = days {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] log_rotation_type              = none {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] max_age                        = 0 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] max_logfile_count              = 30 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] max_logfile_size_mb            = 200 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] max_over_subscription_ratio    = 20.0 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] message_reap_interval          = 86400 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] message_ttl                    = 2592000 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] migration_create_volume_timeout_secs = 300 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] monkey_patch                   = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] monkey_patch_modules           = [] {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] my_ip                          = 192.168.122.185 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] no_snapshot_gb_quota           = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] num_iser_scan_tries            = 3 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] num_shell_tries                = 3 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] num_volume_device_scan_tries   = 3 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] nvmeof_conn_info_version       = 1 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] nvmet_ns_id                    = 10 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] nvmet_port_id                  = 1 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] osapi_max_limit                = 1000 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] osapi_volume_ext_list          = [] {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] osapi_volume_listen_port       = 8776 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] osapi_volume_use_ssl           = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] osapi_volume_workers           = 2 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] per_volume_size_limit          = -1 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] periodic_fuzzy_delay           = 60 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] periodic_interval              = 60 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] public_endpoint                = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] publish_errors                 = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] quota_backup_gigabytes         = 1000 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] quota_backups                  = 10 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] quota_gigabytes                = 1000 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] quota_groups                   = 10 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] quota_snapshots                = 10 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] quota_volumes                  = 10 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] rate_limit_burst               = 0 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] rate_limit_except_level        = CRITICAL {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] rate_limit_interval            = 0 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] reinit_driver_count            = 3 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] replication_device             = **** {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] report_discard_supported       = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] report_interval                = 120 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] reservation_clean_interval     = 86400 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.039s {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] reservation_expire             = 86400 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] reserved_image_namespaces      = [] {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] reserved_percentage            = 0 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] rpc_response_timeout           = 120 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] run_external_periodic_tasks    = True {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] scst_target_driver             = iscsi {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] scst_target_iqn_name           = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] service_down_time              = 720 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] shell_completion               = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] snapshot_name_template         = snapshot-%s {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] snapshot_same_host             = True {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] split_loggers                  = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] state_path                     = /opt/stack/data/cinder {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] storage_availability_zone      = nova {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] storage_protocol               = iSCSI {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] syslog_log_facility            = LOG_USER {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] target_helper                  = lioadm {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] target_ip_address              = 192.168.122.185 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] target_port                    = 3260 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] target_protocol                = iscsi {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] target_secondary_ip_addresses  = [] {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] trace_flags                    = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] transport_url                  = **** {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] until_refresh                  = 0 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] use_chap_auth                  = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] use_default_quota_class        = True {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] use_journal                    = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] use_json                       = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] use_multipath_for_image_xfer   = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] use_stderr                     = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] use_syslog                     = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] verify_glance_signatures       = enabled {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] volume_api_class               = cinder.volume.api.API {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] volume_backend_name            = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] volume_clear                   = zero {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] volume_clear_ionice            = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] volume_clear_size              = 0 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] volume_copy_bps_limit          = 0 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] volume_dd_blocksize            = 1M {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] volume_name_template           = volume-%s {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] volume_service_inithost_offload = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] volume_usage_audit_period      = month {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] zoning_mode                    = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] oslo_concurrency.disable_process_locking = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] keystone_authtoken.admin_password = **** {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] keystone_authtoken.admin_token = **** {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] keystone_authtoken.admin_user  = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] keystone_authtoken.auth_port   = 35357 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] keystone_authtoken.auth_protocol = https {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] keystone_authtoken.auth_section = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] keystone_authtoken.auth_type   = password {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] keystone_authtoken.auth_uri    = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] keystone_authtoken.auth_version = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] keystone_authtoken.cache       = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] keystone_authtoken.certfile    = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] keystone_authtoken.identity_uri = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] keystone_authtoken.include_service_catalog = True {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] keystone_authtoken.insecure    = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] keystone_authtoken.interface   = public {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] keystone_authtoken.keyfile     = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] keystone_authtoken.memcache_password =  {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] keystone_authtoken.memcache_username =  {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] keystone_authtoken.region_name = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] keystone_authtoken.service_token_roles_required = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] keystone_authtoken.service_type = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.185/identity {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] cache.backend                  = dogpile.cache.null {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] cache.backend_argument         = **** {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] cache.backend_expiration_time  = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] cache.config_prefix            = cache.oslo {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] cache.debug_cache_backend      = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] cache.enable_retry_client      = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] cache.enable_socket_keepalive  = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] cache.enabled                  = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] cache.enforce_fips_mode        = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] cache.expiration_time          = 600 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] cache.hashclient_retry_attempts = 2 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] cache.memcache_dead_retry      = 300 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] cache.memcache_sasl_enabled    = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] cache.password                 = **** {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] cache.proxies                  = [] {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] cache.redis_db                 = 0 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] cache.redis_server             = localhost:6379 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] cache.retry_attempts           = 2 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] cache.retry_delay              = 0.0 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] cache.socket_keepalive_count   = 1 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] cache.socket_keepalive_idle    = 1 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] cache.socket_keepalive_interval = 1 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] cache.socket_timeout           = 1.0 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] cache.tls_allowed_ciphers      = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] cache.tls_cafile               = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] cache.tls_certfile             = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] cache.tls_enabled              = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] cache.tls_keyfile              = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] cache.username                 = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] coordination.backend_url       = **** {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] database.asyncio_connection    = **** {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] database.asyncio_slave_connection = **** {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] database.backend               = sqlalchemy {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] database.connection            = **** {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] database.connection_debug      = 0 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] database.connection_parameters =  {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] database.connection_recycle_time = 3600 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] database.connection_trace      = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] database.db_inc_retry_interval = True {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] database.db_max_retries        = 20 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] database.db_max_retry_interval = 10 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] database.db_retry_interval     = 1 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] database.max_overflow          = 50 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] database.max_pool_size         = 5 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] database.max_retries           = 10 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] database.mysql_wsrep_sync_wait = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] database.pool_timeout          = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] database.retry_interval        = 10 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] database.slave_connection      = **** {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] database.sqlite_synchronous    = True {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] database.synchronous_reader    = True {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] database.use_db_reconnect      = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack sudo[75354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] profiler.connection_string     = messaging:// {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] profiler.enabled               = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] profiler.es_doc_type           = notification {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] profiler.es_scroll_size        = 10000 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] profiler.es_scroll_time        = 2m {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack sudo[75354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] profiler.filter_error_trace    = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] profiler.hmac_keys             = **** {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] profiler.sentinel_service_name = mymaster {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] profiler.socket_timeout        = 0.1 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] profiler.trace_requests        = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] profiler.trace_sqlalchemy      = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] profiler_jaeger.process_tags   = {} {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] profiler_jaeger.service_name_prefix = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] profiler_otlp.service_name_prefix = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] oslo_policy.enforce_new_defaults = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: WARNING oslo_config.cfg [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] oslo_policy.enforce_scope      = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] oslo_policy.policy_default_rule = default {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] privsep_osbrick.group          = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] privsep_osbrick.helper_command = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] privsep_osbrick.user           = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] cinder_sys_admin.group         = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] cinder_sys_admin.helper_command = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] cinder_sys_admin.user          = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] service_user.auth_section      = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] service_user.auth_type         = password {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] service_user.cafile            = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] service_user.certfile          = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] service_user.collect_timing    = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] service_user.insecure          = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] service_user.keyfile           = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] service_user.send_service_user_token = True {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] service_user.split_loggers     = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] service_user.timeout           = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] glance.auth_section            = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] glance.auth_type               = password {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] glance.certfile                = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] glance.collect_timing          = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] glance.insecure                = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] glance.keyfile                 = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] glance.region_name             = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] glance.split_loggers           = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] glance.timeout                 = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_defaults.backend_availability_zone = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_defaults.chap_password = **** {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_defaults.chap_username =  {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_defaults.disk_geometry = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_defaults.driver_client_cert = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_defaults.driver_client_cert_key = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_defaults.driver_data_namespace = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_defaults.driver_use_ssl = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_defaults.extra_capabilities = {} {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_defaults.filter_function = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_defaults.goodness_function = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_defaults.iscsi_target_flags =  {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_defaults.iscsi_write_cache = on {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_defaults.iser_helper   = tgtadm {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_defaults.iser_ip_address = 192.168.122.185 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_defaults.iser_port     = 3260 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_defaults.lvm_share_target = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_defaults.lvm_type      = auto {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_defaults.num_shell_tries = 3 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_defaults.replication_device = **** {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_defaults.report_discard_supported = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_defaults.reserved_percentage = 0 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_defaults.target_helper = tgtadm {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_defaults.target_ip_address = 192.168.122.185 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_defaults.target_port   = 3260 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_defaults.target_protocol = iscsi {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_defaults.trace_flags   = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_defaults.unique_fqdn_network = True {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_defaults.use_chap_auth = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_defaults.volume_backend_name = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_defaults.volume_clear  = zero {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_defaults.volume_clear_ionice = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_defaults.volume_clear_size = 0 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] oslo_reports.file_event_handler = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] oslo_reports.log_dir           = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] lvmdriver-1.backend_host       = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] lvmdriver-1.chap_password      = **** {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] lvmdriver-1.chap_username      = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] lvmdriver-1.disk_geometry      = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] lvmdriver-1.driver_client_cert = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] lvmdriver-1.extra_capabilities = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] lvmdriver-1.filter_function    = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] lvmdriver-1.goodness_function  = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] lvmdriver-1.iser_helper        = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] lvmdriver-1.iser_ip_address    = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] lvmdriver-1.iser_port          = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] lvmdriver-1.lvm_share_target   = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] lvmdriver-1.lvm_type           = auto {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] lvmdriver-1.num_shell_tries    = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] lvmdriver-1.replication_device = **** {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] lvmdriver-1.report_discard_supported = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] lvmdriver-1.reserved_percentage = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] lvmdriver-1.scst_target_driver = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] lvmdriver-1.storage_protocol   = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] lvmdriver-1.target_helper      = lioadm {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] lvmdriver-1.target_ip_address  = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] lvmdriver-1.target_port        = 3260 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] lvmdriver-1.trace_flags        = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] lvmdriver-1.use_chap_auth      = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] lvmdriver-1.volume_clear       = zero {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] lvmdriver-1.volume_clear_size  = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] lvmdriver-1.volumes_dir        = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] oslo_messaging_notifications.driver = [] {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] oslo_messaging_notifications.retry = -1 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] key_manager.fixed_key          = **** {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] barbican.barbican_api_version  = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] barbican.barbican_endpoint     = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] barbican.barbican_endpoint_type = public {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] barbican.barbican_region_name  = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] barbican.cafile                = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] barbican.certfile              = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] barbican.collect_timing        = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] barbican.insecure              = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] barbican.keyfile               = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] barbican.number_of_retries     = 60 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] barbican.retry_delay           = 1 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] barbican.send_service_user_token = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] barbican.split_loggers         = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] barbican.timeout               = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] barbican.verify_ssl            = True {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] barbican.verify_ssl_path       = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] barbican_service_user.auth_section = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] barbican_service_user.auth_type = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] barbican_service_user.cafile   = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] barbican_service_user.certfile = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] barbican_service_user.collect_timing = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] barbican_service_user.insecure = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] barbican_service_user.keyfile  = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] barbican_service_user.split_loggers = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] barbican_service_user.timeout  = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] vault.approle_role_id          = **** {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] vault.approle_secret_id        = **** {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] vault.kv_mountpoint            = secret {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] vault.kv_path                  = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] vault.kv_version               = 2 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] vault.namespace                = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] vault.root_token_id            = **** {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] vault.ssl_ca_crt_file          = None {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] vault.timeout                  = 60.0 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] vault.use_ssl                  = False {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 21:58:49 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] ******************************************************************************** {{(pid=75179) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}}
Apr 28 21:58:50 devstack sudo[75354]: pam_unix(sudo:session): session closed for user root
Apr 28 21:58:50 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.911s {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 21:58:50 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 21:58:50 devstack sudo[75524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 28 21:58:50 devstack sudo[75524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 21:58:51 devstack sudo[75524]: pam_unix(sudo:session): session closed for user root
Apr 28 21:58:51 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.630s {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 21:58:51 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 28 21:58:51 devstack cinder-volume[75350]: INFO cinder.brick.local_dev.lvm [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Apr 28 21:58:51 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 21:58:51 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 21:58:51 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 21:58:51 devstack sudo[75748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 28 21:58:51 devstack sudo[75748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 21:58:51 devstack sudo[75748]: pam_unix(sudo:session): session closed for user root
Apr 28 21:58:51 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.702s {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 21:58:51 devstack cinder-volume[75350]: DEBUG cinder.brick.local_dev.lvm [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75350) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Apr 28 21:58:51 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 21:58:51 devstack sudo[75917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 28 21:58:51 devstack sudo[75917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 21:58:52 devstack sudo[75917]: pam_unix(sudo:session): session closed for user root
Apr 28 21:58:52 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.945s {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 21:58:52 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 21:58:52 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 21:58:52 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 21:58:52 devstack sudo[76092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 28 21:58:52 devstack sudo[76092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 21:58:53 devstack sudo[76092]: pam_unix(sudo:session): session closed for user root
Apr 28 21:58:53 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.695s {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 21:58:53 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 21:58:53 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 21:58:53 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 21:58:53 devstack sudo[76126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Apr 28 21:58:53 devstack sudo[76126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 21:58:54 devstack sudo[76126]: pam_unix(sudo:session): session closed for user root
Apr 28 21:58:54 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.856s {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 21:58:54 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 21:58:54 devstack sudo[76135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 28 21:58:54 devstack sudo[76135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 21:58:55 devstack sudo[76135]: pam_unix(sudo:session): session closed for user root
Apr 28 21:58:55 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.683s {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 21:58:55 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 21:58:55 devstack sudo[76141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 28 21:58:55 devstack sudo[76141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 21:58:55 devstack sudo[76141]: pam_unix(sudo:session): session closed for user root
Apr 28 21:58:55 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.620s {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 21:58:55 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 21:58:55 devstack sudo[76144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 28 21:58:55 devstack sudo[76144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 21:58:56 devstack sudo[76144]: pam_unix(sudo:session): session closed for user root
Apr 28 21:58:56 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.649s {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 21:58:56 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 21:58:56 devstack sudo[76149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 28 21:58:56 devstack sudo[76149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 21:58:57 devstack sudo[76149]: pam_unix(sudo:session): session closed for user root
Apr 28 21:58:57 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.659s {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 21:58:57 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 21:58:57 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 21:58:57 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 21:58:57 devstack sudo[76153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 28 21:58:57 devstack sudo[76153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 21:58:57 devstack sudo[76153]: pam_unix(sudo:session): session closed for user root
Apr 28 21:58:57 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.706s {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 21:58:57 devstack cinder-volume[75350]: INFO cinder.volume.drivers.lvm [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] Enabling LVM thin provisioning by default because a thin pool exists.
Apr 28 21:58:57 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 21:58:57 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 21:58:57 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 21:58:57 devstack sudo[76166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 28 21:58:57 devstack sudo[76166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 21:58:58 devstack sudo[76166]: pam_unix(sudo:session): session closed for user root
Apr 28 21:58:58 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.720s {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 21:58:58 devstack cinder-volume[75350]: DEBUG cinder.volume.drivers.lvm [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] Updating volume stats {{(pid=75350) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 28 21:58:58 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 21:58:58 devstack sudo[76269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 28 21:58:58 devstack sudo[76269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 21:58:59 devstack sudo[76269]: pam_unix(sudo:session): session closed for user root
Apr 28 21:58:59 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.699s {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 21:58:59 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 21:58:59 devstack sudo[76315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 28 21:58:59 devstack sudo[76315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 21:58:59 devstack cinder-volume[75179]: DEBUG dbcounter [-] [75179] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75179) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 28 21:58:59 devstack sudo[76315]: pam_unix(sudo:session): session closed for user root
Apr 28 21:58:59 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.634s {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 21:58:59 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 21:58:59 devstack sudo[76427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 28 21:58:59 devstack sudo[76427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 21:59:00 devstack sudo[76427]: pam_unix(sudo:session): session closed for user root
Apr 28 21:59:00 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.600s {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 21:59:00 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 21:59:00 devstack sudo[76433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 28 21:59:00 devstack sudo[76433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 21:59:01 devstack sudo[76433]: pam_unix(sudo:session): session closed for user root
Apr 28 21:59:01 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.590s {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 21:59:01 devstack cinder-volume[75350]: INFO cinder.volume.driver [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] Driver hasn't implemented _init_vendor_properties()
Apr 28 21:59:01 devstack cinder-volume[75350]: DEBUG cinder.volume.driver [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75350) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 28 21:59:01 devstack cinder-volume[75350]: DEBUG oslo_db.sqlalchemy.engines [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75350) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 28 21:59:01 devstack cinder-volume[75350]: DEBUG dbcounter [-] [75350] Writer thread running {{(pid=75350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Apr 28 21:59:01 devstack cinder-volume[75350]: DEBUG cinder.db.sqlalchemy.api [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] Building query based on filter {{(pid=75350) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 28 21:59:01 devstack cinder-volume[75350]: DEBUG cinder.image.image_utils [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75350) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 28 21:59:01 devstack cinder-volume[75350]: INFO cinder.keymgr.migration [None req-d060fb58-c9cb-430c-acf6-ee3aef35ec14 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 28 21:59:01 devstack cinder-volume[75350]: DEBUG cinder.volume.drivers.lvm [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] Updating volume stats {{(pid=75350) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 28 21:59:01 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 21:59:01 devstack sudo[76437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 28 21:59:01 devstack sudo[76437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 21:59:01 devstack sudo[76437]: pam_unix(sudo:session): session closed for user root
Apr 28 21:59:01 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.621s {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 21:59:01 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 21:59:01 devstack sudo[76440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 28 21:59:01 devstack sudo[76440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 21:59:02 devstack sudo[76440]: pam_unix(sudo:session): session closed for user root
Apr 28 21:59:02 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.584s {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 21:59:02 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 21:59:02 devstack sudo[76444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 28 21:59:02 devstack sudo[76444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 21:59:02 devstack sudo[76444]: pam_unix(sudo:session): session closed for user root
Apr 28 21:59:02 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.642s {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 21:59:02 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 21:59:03 devstack sudo[76447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 28 21:59:03 devstack sudo[76447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 21:59:03 devstack sudo[76447]: pam_unix(sudo:session): session closed for user root
Apr 28 21:59:03 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.681s {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 21:59:03 devstack cinder-volume[75350]: DEBUG cinder.manager [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] Notifying Schedulers of capabilities ... {{(pid=75350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 21:59:03 devstack cinder-volume[75350]: INFO cinder.volume.manager [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] Driver initialization completed successfully.
Apr 28 21:59:03 devstack cinder-volume[75350]: INFO cinder.manager [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] Initiating service 2 cleanup
Apr 28 21:59:03 devstack cinder-volume[75350]: INFO cinder.manager [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] Service 2 cleanup completed.
Apr 28 21:59:03 devstack cinder-volume[75350]: DEBUG cinder.service [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] Creating RPC server for service cinder-volume {{(pid=75350) start /opt/stack/cinder/cinder/service.py:231}}
Apr 28 21:59:03 devstack cinder-volume[75350]: DEBUG cinder.service [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75350) start /opt/stack/cinder/cinder/service.py:237}}
Apr 28 21:59:03 devstack cinder-volume[75350]: INFO cinder.volume.manager [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Apr 28 21:59:03 devstack cinder-volume[75350]: DEBUG cinder.volume.drivers.lvm [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] Updating volume stats {{(pid=75350) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 28 21:59:03 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 21:59:03 devstack sudo[76454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 28 21:59:03 devstack sudo[76454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 21:59:04 devstack sudo[76454]: pam_unix(sudo:session): session closed for user root
Apr 28 21:59:04 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.672s {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 21:59:04 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 21:59:04 devstack sudo[76459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 28 21:59:04 devstack sudo[76459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 21:59:05 devstack sudo[76459]: pam_unix(sudo:session): session closed for user root
Apr 28 21:59:05 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.686s {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 21:59:05 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 21:59:05 devstack sudo[76462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 28 21:59:05 devstack sudo[76462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 21:59:05 devstack sudo[76462]: pam_unix(sudo:session): session closed for user root
Apr 28 21:59:05 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.647s {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 21:59:05 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 21:59:05 devstack sudo[76519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 28 21:59:05 devstack sudo[76519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 21:59:06 devstack sudo[76519]: pam_unix(sudo:session): session closed for user root
Apr 28 21:59:06 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.594s {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 21:59:06 devstack cinder-volume[75350]: INFO cinder.volume.manager [None req-267aafda-02b9-4a87-a770-9f8b11f3e67b None None] Driver post RPC initialization completed successfully.
Apr 28 21:59:13 devstack cinder-volume[75350]: DEBUG dbcounter [-] [75350] Writing DB stats cinder:SELECT=2 {{(pid=75350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 28 21:59:16 devstack cinder-volume[75350]: DEBUG dbcounter [-] [75350] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 28 21:59:52 devstack cinder-volume[75350]: DEBUG oslo_service.periodic_task [None req-0b23f739-c366-4f1b-9c08-e57875d0cf85 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 28 21:59:52 devstack cinder-volume[75350]: DEBUG cinder.volume.drivers.lvm [None req-0b23f739-c366-4f1b-9c08-e57875d0cf85 None None] Updating volume stats {{(pid=75350) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 28 21:59:52 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-0b23f739-c366-4f1b-9c08-e57875d0cf85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 21:59:52 devstack sudo[78105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 28 21:59:52 devstack sudo[78105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 21:59:53 devstack sudo[78105]: pam_unix(sudo:session): session closed for user root
Apr 28 21:59:53 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-0b23f739-c366-4f1b-9c08-e57875d0cf85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.625s {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 21:59:53 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-0b23f739-c366-4f1b-9c08-e57875d0cf85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 21:59:53 devstack sudo[78108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 28 21:59:53 devstack sudo[78108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 21:59:53 devstack sudo[78108]: pam_unix(sudo:session): session closed for user root
Apr 28 21:59:53 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-0b23f739-c366-4f1b-9c08-e57875d0cf85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.621s {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 21:59:53 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-0b23f739-c366-4f1b-9c08-e57875d0cf85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 21:59:53 devstack sudo[78139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 28 21:59:53 devstack sudo[78139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 21:59:54 devstack sudo[78139]: pam_unix(sudo:session): session closed for user root
Apr 28 21:59:54 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-0b23f739-c366-4f1b-9c08-e57875d0cf85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.594s {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 21:59:54 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-0b23f739-c366-4f1b-9c08-e57875d0cf85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 21:59:54 devstack sudo[78142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 28 21:59:54 devstack sudo[78142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 21:59:54 devstack sudo[78142]: pam_unix(sudo:session): session closed for user root
Apr 28 21:59:54 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-0b23f739-c366-4f1b-9c08-e57875d0cf85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.605s {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 21:59:54 devstack cinder-volume[75350]: DEBUG cinder.manager [None req-0b23f739-c366-4f1b-9c08-e57875d0cf85 None None] Notifying Schedulers of capabilities ... {{(pid=75350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:00:52 devstack cinder-volume[75350]: DEBUG oslo_service.periodic_task [None req-0b23f739-c366-4f1b-9c08-e57875d0cf85 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 28 22:00:52 devstack cinder-volume[75350]: DEBUG cinder.volume.drivers.lvm [None req-0b23f739-c366-4f1b-9c08-e57875d0cf85 None None] Updating volume stats {{(pid=75350) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 28 22:00:52 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-0b23f739-c366-4f1b-9c08-e57875d0cf85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:00:52 devstack sudo[81397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 28 22:00:52 devstack sudo[81397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:00:53 devstack sudo[81397]: pam_unix(sudo:session): session closed for user root
Apr 28 22:00:53 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-0b23f739-c366-4f1b-9c08-e57875d0cf85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.628s {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:00:53 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-0b23f739-c366-4f1b-9c08-e57875d0cf85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:00:53 devstack sudo[81417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 28 22:00:53 devstack sudo[81417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:00:53 devstack sudo[81417]: pam_unix(sudo:session): session closed for user root
Apr 28 22:00:53 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-0b23f739-c366-4f1b-9c08-e57875d0cf85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.619s {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:00:53 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-0b23f739-c366-4f1b-9c08-e57875d0cf85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:00:53 devstack sudo[81436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 28 22:00:53 devstack sudo[81436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:00:54 devstack sudo[81436]: pam_unix(sudo:session): session closed for user root
Apr 28 22:00:54 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-0b23f739-c366-4f1b-9c08-e57875d0cf85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.603s {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:00:54 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-0b23f739-c366-4f1b-9c08-e57875d0cf85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:00:54 devstack sudo[81439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 28 22:00:54 devstack sudo[81439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:00:54 devstack sudo[81439]: pam_unix(sudo:session): session closed for user root
Apr 28 22:00:54 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-0b23f739-c366-4f1b-9c08-e57875d0cf85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.632s {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:00:54 devstack cinder-volume[75350]: DEBUG cinder.manager [None req-0b23f739-c366-4f1b-9c08-e57875d0cf85 None None] Notifying Schedulers of capabilities ... {{(pid=75350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:01:16 devstack cinder-volume[75350]: DEBUG dbcounter [-] [75350] Writing DB stats cinder:SELECT=1 {{(pid=75350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 28 22:01:16 devstack cinder-volume[75350]: DEBUG dbcounter [-] [75350] Writing DB stats cinder:UPDATE=1 {{(pid=75350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 28 22:01:52 devstack cinder-volume[75350]: DEBUG oslo_service.periodic_task [None req-0b23f739-c366-4f1b-9c08-e57875d0cf85 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 28 22:01:52 devstack cinder-volume[75350]: DEBUG cinder.volume.drivers.lvm [None req-0b23f739-c366-4f1b-9c08-e57875d0cf85 None None] Updating volume stats {{(pid=75350) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 28 22:01:52 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-0b23f739-c366-4f1b-9c08-e57875d0cf85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:01:52 devstack sudo[82733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 28 22:01:52 devstack sudo[82733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:01:53 devstack sudo[82733]: pam_unix(sudo:session): session closed for user root
Apr 28 22:01:53 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-0b23f739-c366-4f1b-9c08-e57875d0cf85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.680s {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:01:53 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-0b23f739-c366-4f1b-9c08-e57875d0cf85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:01:53 devstack sudo[82752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 28 22:01:53 devstack sudo[82752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:01:53 devstack sudo[82752]: pam_unix(sudo:session): session closed for user root
Apr 28 22:01:53 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-0b23f739-c366-4f1b-9c08-e57875d0cf85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.650s {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:01:53 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-0b23f739-c366-4f1b-9c08-e57875d0cf85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:01:53 devstack sudo[82813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 28 22:01:53 devstack sudo[82813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:01:54 devstack sudo[82813]: pam_unix(sudo:session): session closed for user root
Apr 28 22:01:54 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-0b23f739-c366-4f1b-9c08-e57875d0cf85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.607s {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:01:54 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-0b23f739-c366-4f1b-9c08-e57875d0cf85 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:01:54 devstack sudo[82842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 28 22:01:54 devstack sudo[82842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:01:55 devstack sudo[82842]: pam_unix(sudo:session): session closed for user root
Apr 28 22:01:55 devstack cinder-volume[75350]: DEBUG oslo_concurrency.processutils [None req-0b23f739-c366-4f1b-9c08-e57875d0cf85 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.678s {{(pid=75350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:01:55 devstack cinder-volume[75350]: DEBUG cinder.manager [None req-0b23f739-c366-4f1b-9c08-e57875d0cf85 None None] Notifying Schedulers of capabilities ... {{(pid=75350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:01:56 devstack cinder-volume[75179]: INFO oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] Caught SIGTERM, stopping children
Apr 28 22:01:56 devstack cinder-volume[75179]: DEBUG oslo_concurrency.lockutils [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] Acquiring lock "singleton_lock" {{(pid=75179) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 28 22:01:56 devstack cinder-volume[75179]: DEBUG oslo_concurrency.lockutils [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] Acquired lock "singleton_lock" {{(pid=75179) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 28 22:01:56 devstack cinder-volume[75179]: DEBUG oslo_concurrency.lockutils [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] Releasing lock "singleton_lock" {{(pid=75179) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 28 22:01:56 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] Stop services. {{(pid=75179) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 28 22:01:56 devstack cinder-volume[75179]: DEBUG oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] Killing children. {{(pid=75179) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 28 22:01:56 devstack cinder-volume[75179]: INFO oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] Waiting on 1 children to exit
Apr 28 22:01:58 devstack cinder-volume[75350]: DEBUG oslo_concurrency.lockutils [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] Acquiring lock "singleton_lock" {{(pid=75350) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 28 22:01:58 devstack cinder-volume[75350]: DEBUG oslo_concurrency.lockutils [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] Acquired lock "singleton_lock" {{(pid=75350) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 28 22:01:58 devstack cinder-volume[75350]: DEBUG oslo_concurrency.lockutils [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] Releasing lock "singleton_lock" {{(pid=75350) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 28 22:01:58 devstack cinder-volume[75350]: WARNING amqp [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 28 22:01:58 devstack cinder-volume[75350]: WARNING amqp [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 28 22:01:58 devstack cinder-volume[75179]: INFO oslo_service.backend._eventlet.service [None req-03a16bf7-b614-45e1-a418-393aa81ebd91 None None] Child 75350 exited with status 0
Apr 28 22:02:01 devstack cinder-volume[83011]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83011) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 28 22:02:01 devstack cinder-volume[83011]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83011) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 28 22:02:01 devstack cinder-volume[83011]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83011) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 28 22:02:02 devstack cinder-volume[83011]: INFO dbcounter [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] Registered counter for database cinder
Apr 28 22:02:02 devstack cinder-volume[83011]: DEBUG oslo_db.sqlalchemy.engines [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83011) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 28 22:02:02 devstack cinder-volume[83011]: DEBUG dbcounter [-] [83011] Writer thread running {{(pid=83011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Apr 28 22:02:02 devstack cinder-volume[83011]: INFO cinder.rpc [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 28 22:02:02 devstack cinder-volume[83011]: INFO cinder.rpc [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 28 22:02:02 devstack cinder-volume[83011]: DEBUG oslo_db.sqlalchemy.engines [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83011) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 28 22:02:02 devstack cinder-volume[83011]: INFO cinder.volume.manager [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] Determined volume DB was empty at startup.
Apr 28 22:02:02 devstack cinder-volume[83011]: DEBUG cinder.volume.manager [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83011) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 28 22:02:02 devstack cinder-volume[83011]: INFO cinder.volume.manager [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 28 22:02:02 devstack cinder-volume[83011]: WARNING stevedore.named [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 28 22:02:02 devstack cinder-volume[83011]: WARNING castellan.key_manager [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 28 22:02:02 devstack cinder-volume[83011]: WARNING cinder.keymgr.conf_key_mgr [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 28 22:02:02 devstack cinder-volume[83011]: INFO cinder.volume.manager [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 28 22:02:02 devstack cinder-volume[83011]: DEBUG oslo_db.sqlalchemy.engines [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83011) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 28 22:02:02 devstack cinder-volume[83011]: INFO oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] Starting 1 workers
Apr 28 22:02:02 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] Started child 83295 {{(pid=83011) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 28 22:02:02 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] Full set of CONF: {{(pid=83011) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] ******************************************************************************** {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] Configuration options gathered from: {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] ================================================================================ {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] allow_availability_zone_fallback = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] allow_compression_on_image_upload = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] allowed_direct_url_schemes     = [] {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] api_rate_limit                 = True {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83295]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] auth_strategy                  = keystone {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_availability_zone      = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_host                   = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_name                   = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_stats_polling_interval = 60 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backup_api_class               = cinder.backup.api.API {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backup_name_template           = backup-%s {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backup_use_same_host           = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backup_use_temp_snapshot       = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] chap_password                  = **** {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] chap_username                  =  {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] cinder_internal_tenant_project_id = 92849d1120714bcf934bcdbd2dd49287 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] cinder_internal_tenant_user_id = ea7b5f36fac84aa3b14d55005b1c94ee {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] cluster                        = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] compression_format             = gzip {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] compute_api_class              = cinder.compute.nova.API {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] config_dir                     = [] {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] config_source                  = [] {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] control_exchange               = openstack {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] debug                          = True {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] default_availability_zone      = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] default_group_type             = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] default_volume_type            = QuobyteHD {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] disk_geometry                  = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] driver_client_cert             = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] driver_client_cert_key         = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] driver_data_namespace          = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] driver_ssl_cert_path           = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] driver_ssl_cert_verify         = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] driver_use_ssl                 = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] enable_new_services            = True {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] enable_unsupported_driver      = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] enabled_backends               = ['QuobyteHD'] {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] enforce_multipath_for_image_xfer = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] filter_function                = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] glance_api_insecure            = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] glance_api_servers             = ['http://192.168.122.185/image'] {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] glance_api_ssl_compression     = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] glance_ca_certificates_file    = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] glance_catalog_info            = image:glance:publicURL {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83295]: INFO cinder.volume.manager [None req-77708149-a82d-452e-8216-39213e86bf1b None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 28 22:02:03 devstack cinder-volume[83295]: DEBUG cinder.volume.drivers.remotefs [None req-77708149-a82d-452e-8216-39213e86bf1b None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=83295) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] glance_certfile                = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] glance_keyfile                 = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] glance_num_retries             = 3 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] glance_request_timeout         = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] goodness_function              = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] graceful_shutdown_timeout      = 5 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] group_api_class                = cinder.group.api.API {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] host                           = devstack {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] image_compress_on_upload       = True {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] image_conversion_address_space_limit = 1 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] image_conversion_cpu_limit     = 60 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] image_conversion_disable       = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] image_upload_use_cinder_backend = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] image_upload_use_internal_tenant = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] image_volume_cache_enabled     = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] image_volume_cache_max_count   = 0 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] image_volume_cache_max_size_gb = 0 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] init_host_max_objects_retrieval = 0 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] instance_format                = [instance: %(uuid)s]  {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] iscsi_target_flags             =  {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] iscsi_write_cache              = on {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] iser_helper                    = tgtadm {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] iser_ip_address                = 192.168.122.185 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] iser_port                      = 3260 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] log_color                      = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] log_config_append              = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] log_dir                        = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] log_file                       = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] log_options                    = True {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] log_rotate_interval            = 1 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] log_rotate_interval_type       = days {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] log_rotation_type              = none {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] max_age                        = 0 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] max_logfile_count              = 30 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] max_logfile_size_mb            = 200 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] max_over_subscription_ratio    = 20.0 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] message_reap_interval          = 86400 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] message_ttl                    = 2592000 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] migration_create_volume_timeout_secs = 300 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] monkey_patch                   = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] monkey_patch_modules           = [] {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] my_ip                          = 192.168.122.185 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] no_snapshot_gb_quota           = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] num_iser_scan_tries            = 3 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] num_shell_tries                = 3 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] num_volume_device_scan_tries   = 3 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] nvmeof_conn_info_version       = 1 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] nvmet_ns_id                    = 10 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] nvmet_port_id                  = 1 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] osapi_max_limit                = 1000 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] osapi_volume_ext_list          = [] {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] osapi_volume_listen_port       = 8776 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] osapi_volume_use_ssl           = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] osapi_volume_workers           = 2 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] per_volume_size_limit          = -1 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] periodic_fuzzy_delay           = 60 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] periodic_interval              = 60 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] public_endpoint                = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] publish_errors                 = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] quota_backup_gigabytes         = 1000 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] quota_backups                  = 10 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] quota_gigabytes                = 1000 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] quota_groups                   = 10 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] quota_snapshots                = 10 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] quota_volumes                  = 10 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] rate_limit_burst               = 0 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] rate_limit_except_level        = CRITICAL {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] rate_limit_interval            = 0 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] reinit_driver_count            = 3 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] replication_device             = **** {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] report_discard_supported       = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] report_interval                = 120 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] reservation_clean_interval     = 86400 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] reservation_expire             = 86400 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] reserved_image_namespaces      = [] {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] reserved_percentage            = 0 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] rpc_response_timeout           = 120 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] run_external_periodic_tasks    = True {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] scst_target_driver             = iscsi {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] scst_target_iqn_name           = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] service_down_time              = 720 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] shell_completion               = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] snapshot_name_template         = snapshot-%s {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] split_loggers                  = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] state_path                     = /opt/stack/data/cinder {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] storage_availability_zone      = nova {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] storage_protocol               = iSCSI {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] syslog_log_facility            = LOG_USER {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] target_helper                  = lioadm {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] target_ip_address              = 192.168.122.185 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] target_port                    = 3260 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] target_protocol                = iscsi {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] target_secondary_ip_addresses  = [] {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] trace_flags                    = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] transport_url                  = **** {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] until_refresh                  = 0 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] use_chap_auth                  = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] use_default_quota_class        = True {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] use_journal                    = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] use_json                       = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] use_multipath_for_image_xfer   = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] use_stderr                     = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] use_syslog                     = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83295]: DEBUG cinder.volume.drivers.quobyte [None req-77708149-a82d-452e-8216-39213e86bf1b None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=83295) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 28 22:02:03 devstack cinder-volume[83295]: WARNING cinder.volume.drivers.quobyte [None req-77708149-a82d-452e-8216-39213e86bf1b None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 28 22:02:03 devstack cinder-volume[83295]: WARNING cinder.volume.drivers.quobyte [None req-77708149-a82d-452e-8216-39213e86bf1b None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] verify_glance_signatures       = enabled {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] volume_api_class               = cinder.volume.api.API {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] volume_backend_name            = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] volume_clear                   = zero {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] volume_clear_ionice            = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83295]: DEBUG oslo_concurrency.processutils [None req-77708149-a82d-452e-8216-39213e86bf1b None None] Running cmd (subprocess): mount.quobyte {{(pid=83295) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] volume_clear_size              = 0 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] volume_copy_bps_limit          = 0 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] volume_dd_blocksize            = 1M {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] volume_name_template           = volume-%s {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] volume_service_inithost_offload = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] volume_usage_audit_period      = month {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] zoning_mode                    = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] oslo_concurrency.disable_process_locking = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] keystone_authtoken.admin_password = **** {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] keystone_authtoken.admin_token = **** {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] keystone_authtoken.admin_user  = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] keystone_authtoken.auth_port   = 35357 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] keystone_authtoken.auth_protocol = https {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] keystone_authtoken.auth_section = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] keystone_authtoken.auth_type   = password {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] keystone_authtoken.auth_uri    = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] keystone_authtoken.auth_version = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] keystone_authtoken.cache       = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] keystone_authtoken.certfile    = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] keystone_authtoken.delay_auth_decision = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] keystone_authtoken.http_connect_timeout = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] keystone_authtoken.identity_uri = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] keystone_authtoken.include_service_catalog = True {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] keystone_authtoken.insecure    = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] keystone_authtoken.interface   = public {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] keystone_authtoken.keyfile     = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] keystone_authtoken.memcache_password =  {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] keystone_authtoken.memcache_username =  {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] keystone_authtoken.region_name = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] keystone_authtoken.service_token_roles_required = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] keystone_authtoken.service_type = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] keystone_authtoken.token_cache_time = 300 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.185/identity {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] cache.backend                  = dogpile.cache.null {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] cache.backend_argument         = **** {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] cache.backend_expiration_time  = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] cache.config_prefix            = cache.oslo {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] cache.debug_cache_backend      = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] cache.enable_retry_client      = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] cache.enable_socket_keepalive  = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] cache.enabled                  = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] cache.enforce_fips_mode        = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] cache.expiration_time          = 600 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] cache.hashclient_retry_attempts = 2 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] cache.memcache_dead_retry      = 300 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] cache.memcache_pool_maxsize    = 10 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] cache.memcache_sasl_enabled    = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] cache.password                 = **** {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] cache.proxies                  = [] {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] cache.redis_db                 = 0 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] cache.redis_sentinel_service_name = mymaster {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] cache.redis_server             = localhost:6379 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] cache.retry_attempts           = 2 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] cache.retry_delay              = 0.0 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] cache.socket_keepalive_count   = 1 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] cache.socket_keepalive_idle    = 1 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] cache.socket_keepalive_interval = 1 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] cache.socket_timeout           = 1.0 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] cache.tls_allowed_ciphers      = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] cache.tls_cafile               = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] cache.tls_certfile             = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] cache.tls_enabled              = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] cache.tls_keyfile              = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] cache.username                 = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] coordination.backend_url       = **** {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] database.asyncio_connection    = **** {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] database.asyncio_slave_connection = **** {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] database.backend               = sqlalchemy {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] database.connection            = **** {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] database.connection_debug      = 0 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] database.connection_parameters =  {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] database.connection_recycle_time = 3600 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] database.connection_trace      = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] database.db_inc_retry_interval = True {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] database.db_max_retries        = 20 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] database.db_max_retry_interval = 10 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] database.db_retry_interval     = 1 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] database.max_overflow          = 50 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] database.max_pool_size         = 5 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] database.max_retries           = 10 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] database.mysql_wsrep_sync_wait = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] database.pool_timeout          = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] database.retry_interval        = 10 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] database.slave_connection      = **** {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] database.sqlite_synchronous    = True {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack quobyte-client[83296]: Reading configuration file: /etc/quobyte/client.cfg
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] database.synchronous_reader    = True {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack quobyte-client[83296]: Invalid parameters found, error: missing mount point.
Apr 28 22:02:03 devstack quobyte-client[83296]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Apr 28 22:02:03 devstack quobyte-client[83296]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] database.use_db_reconnect      = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83295]: DEBUG oslo_concurrency.processutils [None req-77708149-a82d-452e-8216-39213e86bf1b None None] CMD "mount.quobyte" returned: 1 in 0.163s {{(pid=83295) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] profiler.connection_string     = messaging:// {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] profiler.enabled               = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83295]: DEBUG oslo_concurrency.lockutils [None req-77708149-a82d-452e-8216-39213e86bf1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83295) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:02:03 devstack cinder-volume[83295]: DEBUG oslo_concurrency.lockutils [None req-77708149-a82d-452e-8216-39213e86bf1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83295) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:02:03 devstack cinder-volume[83295]: DEBUG cinder.volume.drivers.quobyte [None req-77708149-a82d-452e-8216-39213e86bf1b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] profiler.es_doc_type           = notification {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] profiler.es_scroll_size        = 10000 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] profiler.es_scroll_time        = 2m {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] profiler.filter_error_trace    = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] profiler.hmac_keys             = **** {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] profiler.sentinel_service_name = mymaster {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83295]: INFO cinder.volume.drivers.quobyte [None req-77708149-a82d-452e-8216-39213e86bf1b None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 ...
Apr 28 22:02:03 devstack cinder-volume[83295]: DEBUG oslo_concurrency.processutils [None req-77708149-a82d-452e-8216-39213e86bf1b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 -c /etc/quobyte/client-cinder.cfg {{(pid=83295) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] profiler.socket_timeout        = 0.1 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] profiler.trace_requests        = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] profiler.trace_sqlalchemy      = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] profiler_jaeger.process_tags   = {} {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] profiler_jaeger.service_name_prefix = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] profiler_otlp.service_name_prefix = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] oslo_policy.enforce_new_defaults = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: WARNING oslo_config.cfg [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] oslo_policy.enforce_scope      = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] oslo_policy.policy_default_rule = default {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] oslo_policy.policy_file        = policy.yaml {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] privsep_osbrick.group          = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] privsep_osbrick.helper_command = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] privsep_osbrick.user           = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] cinder_sys_admin.group         = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] cinder_sys_admin.helper_command = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] cinder_sys_admin.user          = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] service_user.auth_section      = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] service_user.auth_type         = password {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] service_user.cafile            = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] service_user.certfile          = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] service_user.collect_timing    = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] service_user.insecure          = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] service_user.keyfile           = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] service_user.send_service_user_token = True {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] service_user.split_loggers     = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] service_user.timeout           = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] glance.auth_section            = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] glance.auth_type               = password {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] glance.certfile                = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] glance.collect_timing          = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] glance.insecure                = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] glance.keyfile                 = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] glance.region_name             = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] glance.split_loggers           = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] glance.timeout                 = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.backend_availability_zone = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.chap_password = **** {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.chap_username =  {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.disk_geometry = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.driver_client_cert = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.driver_client_cert_key = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.driver_data_namespace = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.driver_use_ssl = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.enable_unsupported_driver = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.extra_capabilities = {} {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.filter_function = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.goodness_function = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.iscsi_target_flags =  {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.iscsi_write_cache = on {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.iser_helper   = tgtadm {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.iser_ip_address = 192.168.122.185 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.iser_port     = 3260 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.nas_host      =  {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.nas_login     = admin {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.nas_mount_options = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.nas_password  = **** {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.nas_private_key =  {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.nas_share_path =  {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.num_shell_tries = 3 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack sudo[83301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 -c /etc/quobyte/client-cinder.cfg
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.nvmet_port_id = 1 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.quobyte_client_cfg = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack sudo[83301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.quobyte_volume_url = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.replication_device = **** {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.report_discard_supported = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.reserved_percentage = 0 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.scst_target_driver = iscsi {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.scst_target_iqn_name = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.storage_protocol = iSCSI {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.target_helper = tgtadm {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.target_ip_address = 192.168.122.185 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.target_port   = 3260 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.target_protocol = iscsi {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.trace_flags   = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.unique_fqdn_network = True {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.use_chap_auth = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.volume_backend_name = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.volume_clear  = zero {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.volume_clear_ionice = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.volume_clear_size = 0 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] oslo_reports.file_event_handler = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] oslo_reports.log_dir           = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.backend_availability_zone = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.backend_host         = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.chap_password        = **** {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.chap_username        = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.chiscsi_conf         = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.disk_geometry        = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.driver_client_cert   = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.driver_client_cert_key = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.driver_data_namespace = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.driver_use_ssl       = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.extra_capabilities   = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.filter_function      = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.goodness_function    = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.iser_helper          = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.iser_ip_address      = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.iser_port            = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.iser_target_prefix   = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.nas_host             = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.nas_login            = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.nas_mount_options    = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.nas_password         = **** {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.nas_private_key      = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.nas_share_path       = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.nas_ssh_port         = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.num_shell_tries      = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.nvmet_port_id        = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.replication_device   = **** {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.report_discard_supported = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.reserved_percentage  = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.scst_target_driver   = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.storage_protocol     = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.target_helper        = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.target_ip_address    = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.target_port          = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.target_prefix        = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.target_protocol      = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.trace_flags          = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.use_chap_auth        = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.volume_clear         = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.volume_clear_size    = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] QuobyteHD.volumes_dir          = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] oslo_messaging_rabbit.ssl      = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] oslo_messaging_notifications.driver = [] {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] oslo_messaging_notifications.retry = -1 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] oslo_messaging_notifications.transport_url = **** {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] key_manager.fixed_key          = **** {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] barbican.barbican_api_version  = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] barbican.barbican_endpoint     = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] barbican.barbican_endpoint_type = public {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] barbican.barbican_region_name  = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] barbican.cafile                = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] barbican.certfile              = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] barbican.collect_timing        = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] barbican.insecure              = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] barbican.keyfile               = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] barbican.number_of_retries     = 60 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] barbican.retry_delay           = 1 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] barbican.send_service_user_token = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] barbican.split_loggers         = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] barbican.timeout               = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] barbican.verify_ssl            = True {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] barbican.verify_ssl_path       = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] barbican_service_user.auth_section = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] barbican_service_user.auth_type = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] barbican_service_user.cafile   = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] barbican_service_user.certfile = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] barbican_service_user.collect_timing = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] barbican_service_user.insecure = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] barbican_service_user.keyfile  = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] barbican_service_user.split_loggers = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] barbican_service_user.timeout  = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] vault.approle_role_id          = **** {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] vault.approle_secret_id        = **** {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] vault.kv_mountpoint            = secret {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] vault.kv_path                  = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] vault.kv_version               = 2 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] vault.namespace                = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] vault.root_token_id            = **** {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] vault.ssl_ca_crt_file          = None {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] vault.timeout                  = 60.0 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] vault.use_ssl                  = False {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:03 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] ******************************************************************************** {{(pid=83011) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}}
Apr 28 22:02:04 devstack sudo[83301]: pam_unix(sudo:session): session closed for user root
Apr 28 22:02:04 devstack cinder-volume[83295]: DEBUG oslo_concurrency.processutils [None req-77708149-a82d-452e-8216-39213e86bf1b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.887s {{(pid=83295) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:02:04 devstack cinder-volume[83295]: INFO cinder.volume.drivers.quobyte [None req-77708149-a82d-452e-8216-39213e86bf1b None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 succeeded
Apr 28 22:02:04 devstack cinder-volume[83295]: DEBUG cinder.volume.drivers.quobyte [None req-77708149-a82d-452e-8216-39213e86bf1b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:02:04 devstack cinder-volume[83295]: DEBUG oslo_concurrency.lockutils [None req-77708149-a82d-452e-8216-39213e86bf1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.906s {{(pid=83295) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:02:04 devstack cinder-volume[83295]: DEBUG oslo_concurrency.processutils [None req-77708149-a82d-452e-8216-39213e86bf1b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83295) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:02:04 devstack sudo[83390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:02:04 devstack sudo[83390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:02:04 devstack sudo[83390]: pam_unix(sudo:session): session closed for user root
Apr 28 22:02:04 devstack cinder-volume[83295]: DEBUG oslo_concurrency.processutils [None req-77708149-a82d-452e-8216-39213e86bf1b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.648s {{(pid=83295) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:02:04 devstack cinder-volume[83295]: INFO cinder.volume.driver [None req-77708149-a82d-452e-8216-39213e86bf1b None None] Driver hasn't implemented _init_vendor_properties()
Apr 28 22:02:04 devstack cinder-volume[83295]: DEBUG cinder.volume.driver [None req-77708149-a82d-452e-8216-39213e86bf1b None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6164894104004, 'free_capacity_gb': 1775.6164894104004, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83295) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 28 22:02:04 devstack cinder-volume[83295]: DEBUG oslo_db.sqlalchemy.engines [None req-77708149-a82d-452e-8216-39213e86bf1b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83295) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 28 22:02:05 devstack cinder-volume[83295]: DEBUG dbcounter [-] [83295] Writer thread running {{(pid=83295) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Apr 28 22:02:05 devstack cinder-volume[83295]: DEBUG cinder.db.sqlalchemy.api [None req-77708149-a82d-452e-8216-39213e86bf1b None None] Building query based on filter {{(pid=83295) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 28 22:02:05 devstack cinder-volume[83295]: DEBUG cinder.image.image_utils [None req-77708149-a82d-452e-8216-39213e86bf1b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83295) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 28 22:02:05 devstack cinder-volume[83295]: INFO cinder.keymgr.migration [None req-aa80fe29-e2fb-443d-9c13-5db1b44441b3 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 28 22:02:05 devstack cinder-volume[83295]: DEBUG oslo_concurrency.lockutils [None req-77708149-a82d-452e-8216-39213e86bf1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83295) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:02:05 devstack cinder-volume[83295]: DEBUG oslo_concurrency.lockutils [None req-77708149-a82d-452e-8216-39213e86bf1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83295) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:02:05 devstack cinder-volume[83295]: DEBUG cinder.volume.drivers.quobyte [None req-77708149-a82d-452e-8216-39213e86bf1b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:02:05 devstack cinder-volume[83295]: DEBUG cinder.volume.drivers.quobyte [None req-77708149-a82d-452e-8216-39213e86bf1b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:02:05 devstack cinder-volume[83295]: DEBUG oslo_concurrency.lockutils [None req-77708149-a82d-452e-8216-39213e86bf1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83295) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:02:05 devstack cinder-volume[83295]: DEBUG oslo_concurrency.processutils [None req-77708149-a82d-452e-8216-39213e86bf1b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83295) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:02:05 devstack sudo[83405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:02:05 devstack sudo[83405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:02:05 devstack sudo[83405]: pam_unix(sudo:session): session closed for user root
Apr 28 22:02:05 devstack cinder-volume[83295]: DEBUG oslo_concurrency.processutils [None req-77708149-a82d-452e-8216-39213e86bf1b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.645s {{(pid=83295) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:02:05 devstack cinder-volume[83295]: DEBUG cinder.manager [None req-77708149-a82d-452e-8216-39213e86bf1b None None] Notifying Schedulers of capabilities ... {{(pid=83295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:02:05 devstack cinder-volume[83295]: INFO cinder.volume.manager [None req-77708149-a82d-452e-8216-39213e86bf1b None None] Driver initialization completed successfully.
Apr 28 22:02:05 devstack cinder-volume[83295]: INFO cinder.manager [None req-77708149-a82d-452e-8216-39213e86bf1b None None] Initiating service 3 cleanup
Apr 28 22:02:05 devstack cinder-volume[83295]: INFO cinder.manager [None req-77708149-a82d-452e-8216-39213e86bf1b None None] Service 3 cleanup completed.
Apr 28 22:02:05 devstack cinder-volume[83295]: DEBUG cinder.service [None req-77708149-a82d-452e-8216-39213e86bf1b None None] Creating RPC server for service cinder-volume {{(pid=83295) start /opt/stack/cinder/cinder/service.py:231}}
Apr 28 22:02:05 devstack cinder-volume[83295]: DEBUG cinder.service [None req-77708149-a82d-452e-8216-39213e86bf1b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83295) start /opt/stack/cinder/cinder/service.py:237}}
Apr 28 22:02:05 devstack cinder-volume[83295]: INFO cinder.volume.manager [None req-77708149-a82d-452e-8216-39213e86bf1b None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 28 22:02:05 devstack cinder-volume[83295]: DEBUG oslo_concurrency.lockutils [None req-77708149-a82d-452e-8216-39213e86bf1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83295) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:02:05 devstack cinder-volume[83295]: DEBUG oslo_concurrency.lockutils [None req-77708149-a82d-452e-8216-39213e86bf1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83295) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:02:05 devstack cinder-volume[83295]: DEBUG cinder.volume.drivers.quobyte [None req-77708149-a82d-452e-8216-39213e86bf1b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:02:05 devstack cinder-volume[83295]: DEBUG cinder.volume.drivers.quobyte [None req-77708149-a82d-452e-8216-39213e86bf1b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:02:05 devstack cinder-volume[83295]: DEBUG oslo_concurrency.lockutils [None req-77708149-a82d-452e-8216-39213e86bf1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83295) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:02:05 devstack cinder-volume[83295]: DEBUG oslo_concurrency.processutils [None req-77708149-a82d-452e-8216-39213e86bf1b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83295) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:02:05 devstack sudo[83441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:02:05 devstack sudo[83441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:02:06 devstack sudo[83441]: pam_unix(sudo:session): session closed for user root
Apr 28 22:02:06 devstack cinder-volume[83295]: DEBUG oslo_concurrency.processutils [None req-77708149-a82d-452e-8216-39213e86bf1b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.871s {{(pid=83295) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:02:06 devstack cinder-volume[83295]: INFO cinder.volume.manager [None req-77708149-a82d-452e-8216-39213e86bf1b None None] Driver post RPC initialization completed successfully.
Apr 28 22:02:10 devstack cinder-volume[83295]: DEBUG oslo_concurrency.lockutils [None req-96678354-b12f-40b6-addc-1d3d167d0ea4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83295) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:02:10 devstack cinder-volume[83295]: DEBUG oslo_concurrency.lockutils [None req-96678354-b12f-40b6-addc-1d3d167d0ea4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83295) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:02:10 devstack cinder-volume[83295]: DEBUG cinder.volume.drivers.quobyte [None req-96678354-b12f-40b6-addc-1d3d167d0ea4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83295) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:02:10 devstack cinder-volume[83295]: DEBUG cinder.volume.drivers.quobyte [None req-96678354-b12f-40b6-addc-1d3d167d0ea4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83295) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:02:10 devstack cinder-volume[83295]: DEBUG oslo_concurrency.lockutils [None req-96678354-b12f-40b6-addc-1d3d167d0ea4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83295) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:02:10 devstack cinder-volume[83295]: DEBUG oslo_concurrency.processutils [None req-96678354-b12f-40b6-addc-1d3d167d0ea4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83295) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:02:10 devstack sudo[83604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:02:10 devstack sudo[83604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:02:10 devstack cinder-volume[83011]: INFO oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] Caught SIGTERM, stopping children
Apr 28 22:02:10 devstack cinder-volume[83011]: DEBUG oslo_concurrency.lockutils [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] Acquiring lock "singleton_lock" {{(pid=83011) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 28 22:02:10 devstack cinder-volume[83011]: DEBUG oslo_concurrency.lockutils [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] Acquired lock "singleton_lock" {{(pid=83011) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 28 22:02:10 devstack cinder-volume[83011]: DEBUG oslo_concurrency.lockutils [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] Releasing lock "singleton_lock" {{(pid=83011) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 28 22:02:10 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] Stop services. {{(pid=83011) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 28 22:02:11 devstack cinder-volume[83011]: DEBUG oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] Killing children. {{(pid=83011) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 28 22:02:11 devstack cinder-volume[83011]: INFO oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] Waiting on 1 children to exit
Apr 28 22:02:11 devstack sudo[83604]: pam_unix(sudo:session): session closed for user root
Apr 28 22:02:11 devstack cinder-volume[83295]: DEBUG oslo_concurrency.processutils [None req-96678354-b12f-40b6-addc-1d3d167d0ea4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.757s {{(pid=83295) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:02:11 devstack cinder-volume[83295]: DEBUG cinder.manager [None req-96678354-b12f-40b6-addc-1d3d167d0ea4 None None] Notifying Schedulers of capabilities ... {{(pid=83295) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo.messaging._drivers.impl_rabbit [None req-96678354-b12f-40b6-addc-1d3d167d0ea4 None None] Failed to publish message to topic 'cinder-scheduler_fanout': Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo.messaging._drivers.impl_rabbit [None req-96678354-b12f-40b6-addc-1d3d167d0ea4 None None] Unable to connect to AMQP server on 192.168.122.185:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server [None req-96678354-b12f-40b6-addc-1d3d167d0ea4 None None] Exception during message handling: oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.185:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1140, in ensure
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server     ret, channel = autoretry_method()
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server                    ^^^^^^^^^^^^^^^^^^
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 558, in _ensured
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server     return fun(*args, **kwargs)
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 641, in __call__
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server     return fun(*args, channel=channels[0], **kwargs), channels[0]
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1129, in execute_method
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server     method()
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1591, in _publish
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server     self._producer.publish(
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 190, in publish
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server     return _publish(
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 214, in _publish
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server     return channel.basic_publish(
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 1820, in basic_publish_confirm
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server     self.wait([spec.Basic.Ack, spec.Basic.Nack],
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 99, in wait
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server     self.connection.drain_events(timeout=timeout)
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 526, in drain_events
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server     while not self.blocking_read(timeout):
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server               ^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 532, in blocking_read
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server     return self.on_inbound_frame(frame)
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/method_framing.py", line 53, in on_frame
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server     callback(channel, method_sig, buf, None)
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 538, in on_inbound_method
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server     return self.channels[channel_id].dispatch_method(
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 156, in dispatch_method
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server     listener(*args)
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 293, in _on_close
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server     raise error_for_code(
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server 
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred:
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server 
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server              ^^^^^^^^^^^^^^^^^^^^^^
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 2906, in publish_service_capabilities
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server     self._publish_service_capabilities(context)
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/manager.py", line 203, in _publish_service_capabilities
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server     self.scheduler_rpcapi.update_service_capabilities(
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/scheduler/rpcapi.py", line 222, in update_service_capabilities
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server     cctxt.cast(ctxt, 'update_service_capabilities', **msg_args)
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/client.py", line 154, in cast
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server     self.transport._send(self.target, msg_ctxt, msg,
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/transport.py", line 123, in _send
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server     return self._driver.send(target, ctxt, message,
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 800, in send
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server     return self._send(target, ctxt, message, wait_for_reply, timeout,
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 775, in _send
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server     conn.fanout_send(target.topic, msg, retry=retry)
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1710, in fanout_send
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server     self._ensure_publishing(self._publish, exchange, msg, retry=retry)
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1540, in _ensure_publishing
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server     self.ensure(method, retry=retry, error_callback=_error_callback)
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1162, in ensure
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server     raise exceptions.MessageDeliveryFailure(msg)
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.185:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Apr 28 22:02:11 devstack cinder-volume[83295]: ERROR oslo_messaging.rpc.server 
Apr 28 22:02:14 devstack cinder-volume[83295]: DEBUG oslo_concurrency.lockutils [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] Acquiring lock "singleton_lock" {{(pid=83295) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 28 22:02:14 devstack cinder-volume[83295]: DEBUG oslo_concurrency.lockutils [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] Acquired lock "singleton_lock" {{(pid=83295) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 28 22:02:14 devstack cinder-volume[83295]: DEBUG oslo_concurrency.lockutils [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] Releasing lock "singleton_lock" {{(pid=83295) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 28 22:02:14 devstack cinder-volume[83295]: WARNING amqp [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 28 22:02:14 devstack cinder-volume[83295]: WARNING amqp [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 28 22:02:14 devstack cinder-volume[83011]: INFO oslo_service.backend._eventlet.service [None req-338dbaa1-4543-4372-8859-5e32d6e26149 None None] Child 83295 exited with status 0
Apr 28 22:02:18 devstack cinder-volume[83663]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83663) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 28 22:02:18 devstack cinder-volume[83663]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83663) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 28 22:02:18 devstack cinder-volume[83663]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83663) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 28 22:02:18 devstack cinder-volume[83663]: INFO dbcounter [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] Registered counter for database cinder
Apr 28 22:02:18 devstack cinder-volume[83663]: DEBUG oslo_db.sqlalchemy.engines [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83663) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG dbcounter [-] [83663] Writer thread running {{(pid=83663) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Apr 28 22:02:19 devstack cinder-volume[83663]: INFO cinder.rpc [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 28 22:02:19 devstack cinder-volume[83663]: INFO cinder.rpc [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_db.sqlalchemy.engines [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83663) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 28 22:02:19 devstack cinder-volume[83663]: INFO cinder.volume.manager [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] Determined volume DB was empty at startup.
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG cinder.volume.manager [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83663) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 28 22:02:19 devstack cinder-volume[83663]: WARNING stevedore.named [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 28 22:02:19 devstack cinder-volume[83663]: WARNING castellan.key_manager [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 28 22:02:19 devstack cinder-volume[83663]: WARNING cinder.keymgr.conf_key_mgr [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 28 22:02:19 devstack cinder-volume[83663]: INFO cinder.volume.manager [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_db.sqlalchemy.engines [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83663) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 28 22:02:19 devstack cinder-volume[83663]: INFO oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] Starting 1 workers
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] Started child 83924 {{(pid=83663) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] Full set of CONF: {{(pid=83663) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] ******************************************************************************** {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] Configuration options gathered from: {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] ================================================================================ {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] allow_availability_zone_fallback = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] allow_compression_on_image_upload = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] allowed_direct_url_schemes     = [] {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] api_rate_limit                 = True {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] auth_strategy                  = keystone {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_availability_zone      = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_host                   = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_name                   = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_stats_polling_interval = 60 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backup_api_class               = cinder.backup.api.API {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backup_name_template           = backup-%s {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backup_use_same_host           = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backup_use_temp_snapshot       = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] chap_password                  = **** {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] chap_username                  =  {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] cinder_internal_tenant_project_id = 92849d1120714bcf934bcdbd2dd49287 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] cinder_internal_tenant_user_id = ea7b5f36fac84aa3b14d55005b1c94ee {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] cluster                        = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] compression_format             = gzip {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] compute_api_class              = cinder.compute.nova.API {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] config_dir                     = [] {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83924]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] config_source                  = [] {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] control_exchange               = openstack {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] debug                          = True {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] default_availability_zone      = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] default_group_type             = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] default_volume_type            = QuobyteHD {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] disk_geometry                  = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] driver_client_cert             = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] driver_client_cert_key         = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] driver_data_namespace          = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] driver_ssl_cert_path           = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] driver_ssl_cert_verify         = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] driver_use_ssl                 = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] enable_new_services            = True {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] enable_unsupported_driver      = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] enabled_backends               = ['QuobyteHD'] {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] enforce_multipath_for_image_xfer = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] filter_function                = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] glance_api_insecure            = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] glance_api_servers             = ['http://192.168.122.185/image'] {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] glance_api_ssl_compression     = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] glance_ca_certificates_file    = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] glance_catalog_info            = image:glance:publicURL {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] glance_certfile                = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] glance_keyfile                 = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] glance_num_retries             = 3 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] glance_request_timeout         = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] goodness_function              = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] graceful_shutdown_timeout      = 5 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] group_api_class                = cinder.group.api.API {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] host                           = devstack {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] image_compress_on_upload       = True {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] image_conversion_address_space_limit = 1 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] image_conversion_cpu_limit     = 60 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] image_conversion_disable       = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] image_upload_use_cinder_backend = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] image_upload_use_internal_tenant = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] image_volume_cache_enabled     = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] image_volume_cache_max_count   = 0 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] image_volume_cache_max_size_gb = 0 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] init_host_max_objects_retrieval = 0 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] instance_format                = [instance: %(uuid)s]  {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] iscsi_target_flags             =  {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] iscsi_write_cache              = on {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] iser_helper                    = tgtadm {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] iser_ip_address                = 192.168.122.185 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] iser_port                      = 3260 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] log_color                      = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] log_config_append              = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] log_dir                        = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] log_file                       = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] log_options                    = True {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] log_rotate_interval            = 1 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] log_rotate_interval_type       = days {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] log_rotation_type              = none {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] max_age                        = 0 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] max_logfile_count              = 30 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] max_logfile_size_mb            = 200 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] max_over_subscription_ratio    = 20.0 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] message_reap_interval          = 86400 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] message_ttl                    = 2592000 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] migration_create_volume_timeout_secs = 300 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack quobyte-client[83925]: Reading configuration file: /etc/quobyte/client.cfg
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] monkey_patch                   = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] monkey_patch_modules           = [] {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] my_ip                          = 192.168.122.185 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] no_snapshot_gb_quota           = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] num_iser_scan_tries            = 3 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] num_shell_tries                = 3 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] num_volume_device_scan_tries   = 3 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack quobyte-client[83925]: Invalid parameters found, error: missing mount point.
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] nvmeof_conn_info_version       = 1 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] nvmet_ns_id                    = 10 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] nvmet_port_id                  = 1 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] osapi_max_limit                = 1000 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] osapi_volume_ext_list          = [] {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack quobyte-client[83925]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] osapi_volume_listen_port       = 8776 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] osapi_volume_use_ssl           = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] osapi_volume_workers           = 2 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] per_volume_size_limit          = -1 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] periodic_fuzzy_delay           = 60 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] periodic_interval              = 60 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack quobyte-client[83925]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Apr 28 22:02:19 devstack sudo[83926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] public_endpoint                = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] publish_errors                 = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] quota_backup_gigabytes         = 1000 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] quota_backups                  = 10 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] quota_gigabytes                = 1000 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] quota_groups                   = 10 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack sudo[83926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] quota_snapshots                = 10 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] quota_volumes                  = 10 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] rate_limit_burst               = 0 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] rate_limit_except_level        = CRITICAL {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] rate_limit_interval            = 0 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] reinit_driver_count            = 3 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] replication_device             = **** {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] report_discard_supported       = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] report_interval                = 120 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] reservation_clean_interval     = 86400 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] reservation_expire             = 86400 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] reserved_image_namespaces      = [] {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] reserved_percentage            = 0 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] rpc_response_timeout           = 120 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] run_external_periodic_tasks    = True {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] scst_target_driver             = iscsi {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] scst_target_iqn_name           = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] service_down_time              = 720 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] shell_completion               = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] snapshot_name_template         = snapshot-%s {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] split_loggers                  = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] state_path                     = /opt/stack/data/cinder {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] storage_availability_zone      = nova {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] storage_protocol               = iSCSI {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] syslog_log_facility            = LOG_USER {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] target_helper                  = lioadm {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] target_ip_address              = 192.168.122.185 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] target_port                    = 3260 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] target_protocol                = iscsi {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] target_secondary_ip_addresses  = [] {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] trace_flags                    = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] transport_url                  = **** {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] until_refresh                  = 0 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] use_chap_auth                  = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] use_default_quota_class        = True {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] use_journal                    = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] use_json                       = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] use_multipath_for_image_xfer   = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] use_stderr                     = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] use_syslog                     = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] verify_glance_signatures       = enabled {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-02ac6be6-f77d-45f7-a1a0-74d6ad9304bd None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] volume_api_class               = cinder.volume.api.API {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] volume_backend_name            = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] volume_clear                   = zero {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] volume_clear_ionice            = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] volume_clear_size              = 0 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] volume_copy_bps_limit          = 0 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] volume_dd_blocksize            = 1M {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] volume_name_template           = volume-%s {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] volume_service_inithost_offload = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] volume_usage_audit_period      = month {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] zoning_mode                    = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-02ac6be6-f77d-45f7-a1a0-74d6ad9304bd None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=83924) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] oslo_concurrency.disable_process_locking = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] keystone_authtoken.admin_password = **** {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] keystone_authtoken.admin_token = **** {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] keystone_authtoken.admin_user  = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] keystone_authtoken.auth_port   = 35357 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] keystone_authtoken.auth_protocol = https {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] keystone_authtoken.auth_section = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] keystone_authtoken.auth_type   = password {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] keystone_authtoken.auth_uri    = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] keystone_authtoken.auth_version = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] keystone_authtoken.cache       = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] keystone_authtoken.certfile    = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] keystone_authtoken.delay_auth_decision = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] keystone_authtoken.http_connect_timeout = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] keystone_authtoken.identity_uri = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] keystone_authtoken.include_service_catalog = True {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] keystone_authtoken.insecure    = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] keystone_authtoken.interface   = public {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] keystone_authtoken.keyfile     = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] keystone_authtoken.memcache_password =  {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] keystone_authtoken.memcache_username =  {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] keystone_authtoken.region_name = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] keystone_authtoken.service_token_roles_required = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] keystone_authtoken.service_type = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] keystone_authtoken.token_cache_time = 300 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.185/identity {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] cache.backend                  = dogpile.cache.null {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] cache.backend_argument         = **** {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] cache.backend_expiration_time  = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] cache.config_prefix            = cache.oslo {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] cache.debug_cache_backend      = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] cache.enable_retry_client      = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] cache.enable_socket_keepalive  = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] cache.enabled                  = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] cache.enforce_fips_mode        = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] cache.expiration_time          = 600 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] cache.hashclient_retry_attempts = 2 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] cache.memcache_dead_retry      = 300 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] cache.memcache_pool_maxsize    = 10 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] cache.memcache_sasl_enabled    = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] cache.password                 = **** {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] cache.proxies                  = [] {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] cache.redis_db                 = 0 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] cache.redis_sentinel_service_name = mymaster {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] cache.redis_server             = localhost:6379 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] cache.retry_attempts           = 2 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] cache.retry_delay              = 0.0 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] cache.socket_keepalive_count   = 1 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] cache.socket_keepalive_idle    = 1 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] cache.socket_keepalive_interval = 1 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] cache.socket_timeout           = 1.0 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] cache.tls_allowed_ciphers      = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] cache.tls_cafile               = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] cache.tls_certfile             = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] cache.tls_enabled              = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] cache.tls_keyfile              = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] cache.username                 = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] coordination.backend_url       = **** {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] database.asyncio_connection    = **** {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] database.asyncio_slave_connection = **** {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] database.backend               = sqlalchemy {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] database.connection            = **** {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] database.connection_debug      = 0 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] database.connection_parameters =  {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] database.connection_recycle_time = 3600 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] database.connection_trace      = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] database.db_inc_retry_interval = True {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] database.db_max_retries        = 20 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] database.db_max_retry_interval = 10 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] database.db_retry_interval     = 1 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] database.max_overflow          = 50 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] database.max_pool_size         = 5 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] database.max_retries           = 10 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] database.mysql_wsrep_sync_wait = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] database.pool_timeout          = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] database.retry_interval        = 10 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] database.slave_connection      = **** {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] database.sqlite_synchronous    = True {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] database.synchronous_reader    = True {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] database.use_db_reconnect      = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] profiler.connection_string     = messaging:// {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] profiler.enabled               = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] profiler.es_doc_type           = notification {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] profiler.es_scroll_size        = 10000 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] profiler.es_scroll_time        = 2m {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] profiler.filter_error_trace    = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] profiler.hmac_keys             = **** {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] profiler.sentinel_service_name = mymaster {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] profiler.socket_timeout        = 0.1 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] profiler.trace_requests        = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:19 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] profiler.trace_sqlalchemy      = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] profiler_jaeger.process_tags   = {} {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] profiler_jaeger.service_name_prefix = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] profiler_otlp.service_name_prefix = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] oslo_policy.enforce_new_defaults = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: WARNING oslo_config.cfg [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] oslo_policy.enforce_scope      = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] oslo_policy.policy_default_rule = default {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] oslo_policy.policy_file        = policy.yaml {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] privsep_osbrick.group          = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] privsep_osbrick.helper_command = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] privsep_osbrick.user           = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] cinder_sys_admin.group         = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] cinder_sys_admin.helper_command = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] cinder_sys_admin.user          = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] service_user.auth_section      = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] service_user.auth_type         = password {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] service_user.cafile            = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] service_user.certfile          = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] service_user.collect_timing    = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] service_user.insecure          = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] service_user.keyfile           = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] service_user.send_service_user_token = True {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] service_user.split_loggers     = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] service_user.timeout           = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] glance.auth_section            = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] glance.auth_type               = password {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] glance.certfile                = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] glance.collect_timing          = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] glance.insecure                = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] glance.keyfile                 = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] glance.region_name             = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] glance.split_loggers           = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] glance.timeout                 = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.backend_availability_zone = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.chap_password = **** {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.chap_username =  {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.disk_geometry = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.driver_client_cert = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.driver_client_cert_key = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.driver_data_namespace = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.driver_use_ssl = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.enable_unsupported_driver = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.extra_capabilities = {} {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.filter_function = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.goodness_function = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.iscsi_target_flags =  {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.iscsi_write_cache = on {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.iser_helper   = tgtadm {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.iser_ip_address = 192.168.122.185 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.iser_port     = 3260 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.nas_host      =  {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.nas_login     = admin {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.nas_mount_options = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.nas_password  = **** {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.nas_private_key =  {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.nas_share_path =  {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.num_shell_tries = 3 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.nvmet_port_id = 1 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.quobyte_client_cfg = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.quobyte_volume_url = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.replication_device = **** {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.report_discard_supported = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.reserved_percentage = 0 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.scst_target_driver = iscsi {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.scst_target_iqn_name = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.storage_protocol = iSCSI {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.target_helper = tgtadm {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.target_ip_address = 192.168.122.185 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.target_port   = 3260 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.target_protocol = iscsi {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.trace_flags   = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.unique_fqdn_network = True {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.use_chap_auth = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.volume_backend_name = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.volume_clear  = zero {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.volume_clear_ionice = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.volume_clear_size = 0 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] oslo_reports.file_event_handler = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] oslo_reports.log_dir           = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.backend_availability_zone = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.backend_host         = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.chap_password        = **** {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.chap_username        = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.chiscsi_conf         = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.disk_geometry        = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.driver_client_cert   = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.driver_client_cert_key = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.driver_data_namespace = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.driver_use_ssl       = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.extra_capabilities   = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.filter_function      = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.goodness_function    = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.iser_helper          = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.iser_ip_address      = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.iser_port            = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.iser_target_prefix   = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.nas_host             = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.nas_login            = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.nas_mount_options    = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.nas_password         = **** {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.nas_private_key      = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.nas_share_path       = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.nas_ssh_port         = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.num_shell_tries      = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.nvmet_port_id        = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.replication_device   = **** {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.report_discard_supported = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.reserved_percentage  = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.scst_target_driver   = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.storage_protocol     = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.target_helper        = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.target_ip_address    = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.target_port          = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.target_prefix        = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.target_protocol      = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.trace_flags          = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.use_chap_auth        = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.volume_clear         = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.volume_clear_size    = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] QuobyteHD.volumes_dir          = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-02ac6be6-f77d-45f7-a1a0-74d6ad9304bd None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=83924) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.quobyte [None req-02ac6be6-f77d-45f7-a1a0-74d6ad9304bd None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] oslo_messaging_rabbit.ssl      = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.quobyte [None req-02ac6be6-f77d-45f7-a1a0-74d6ad9304bd None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-02ac6be6-f77d-45f7-a1a0-74d6ad9304bd None None] Running cmd (subprocess): mount.quobyte {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] oslo_messaging_notifications.driver = [] {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] oslo_messaging_notifications.retry = -1 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] oslo_messaging_notifications.transport_url = **** {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] key_manager.fixed_key          = **** {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] barbican.barbican_api_version  = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] barbican.barbican_endpoint     = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] barbican.barbican_endpoint_type = public {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] barbican.barbican_region_name  = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] barbican.cafile                = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] barbican.certfile              = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] barbican.collect_timing        = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] barbican.insecure              = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] barbican.keyfile               = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] barbican.number_of_retries     = 60 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] barbican.retry_delay           = 1 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] barbican.send_service_user_token = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] barbican.split_loggers         = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] barbican.timeout               = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] barbican.verify_ssl            = True {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] barbican.verify_ssl_path       = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] barbican_service_user.auth_section = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] barbican_service_user.auth_type = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] barbican_service_user.cafile   = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] barbican_service_user.certfile = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] barbican_service_user.collect_timing = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] barbican_service_user.insecure = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] barbican_service_user.keyfile  = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] barbican_service_user.split_loggers = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] barbican_service_user.timeout  = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] vault.approle_role_id          = **** {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] vault.approle_secret_id        = **** {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] vault.kv_mountpoint            = secret {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] vault.kv_path                  = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] vault.kv_version               = 2 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] vault.namespace                = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] vault.root_token_id            = **** {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] vault.ssl_ca_crt_file          = None {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] vault.timeout                  = 60.0 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] vault.use_ssl                  = False {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 28 22:02:20 devstack cinder-volume[83663]: DEBUG oslo_service.backend._eventlet.service [None req-c52aad7a-1e2b-4de6-9a91-a756f26e0094 None None] ******************************************************************************** {{(pid=83663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}}
Apr 28 22:02:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-02ac6be6-f77d-45f7-a1a0-74d6ad9304bd None None] CMD "mount.quobyte" returned: 1 in 0.060s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:02:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-02ac6be6-f77d-45f7-a1a0-74d6ad9304bd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:02:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-02ac6be6-f77d-45f7-a1a0-74d6ad9304bd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:02:20 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-02ac6be6-f77d-45f7-a1a0-74d6ad9304bd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:02:20 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-02ac6be6-f77d-45f7-a1a0-74d6ad9304bd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:02:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-02ac6be6-f77d-45f7-a1a0-74d6ad9304bd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:02:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-02ac6be6-f77d-45f7-a1a0-74d6ad9304bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:02:20 devstack sudo[83926]: pam_unix(sudo:session): session closed for user root
Apr 28 22:02:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-02ac6be6-f77d-45f7-a1a0-74d6ad9304bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.594s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:02:20 devstack cinder-volume[83924]: INFO cinder.volume.driver [None req-02ac6be6-f77d-45f7-a1a0-74d6ad9304bd None None] Driver hasn't implemented _init_vendor_properties()
Apr 28 22:02:20 devstack cinder-volume[83924]: DEBUG cinder.volume.driver [None req-02ac6be6-f77d-45f7-a1a0-74d6ad9304bd None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5839881896973, 'free_capacity_gb': 1775.5839881896973, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83924) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 28 22:02:20 devstack cinder-volume[83924]: DEBUG oslo_db.sqlalchemy.engines [None req-02ac6be6-f77d-45f7-a1a0-74d6ad9304bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83924) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 28 22:02:20 devstack cinder-volume[83924]: DEBUG dbcounter [-] [83924] Writer thread running {{(pid=83924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Apr 28 22:02:20 devstack cinder-volume[83924]: DEBUG cinder.db.sqlalchemy.api [None req-02ac6be6-f77d-45f7-a1a0-74d6ad9304bd None None] Building query based on filter {{(pid=83924) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 28 22:02:20 devstack cinder-volume[83924]: DEBUG cinder.image.image_utils [None req-02ac6be6-f77d-45f7-a1a0-74d6ad9304bd None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83924) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 28 22:02:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-02ac6be6-f77d-45f7-a1a0-74d6ad9304bd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:02:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-02ac6be6-f77d-45f7-a1a0-74d6ad9304bd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:02:20 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-02ac6be6-f77d-45f7-a1a0-74d6ad9304bd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:02:20 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-02ac6be6-f77d-45f7-a1a0-74d6ad9304bd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:02:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-02ac6be6-f77d-45f7-a1a0-74d6ad9304bd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:02:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-02ac6be6-f77d-45f7-a1a0-74d6ad9304bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:02:20 devstack cinder-volume[83924]: INFO cinder.keymgr.migration [None req-50b27fc7-c16a-44fc-80f4-752524c9812d None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 28 22:02:20 devstack sudo[83929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:02:20 devstack sudo[83929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:02:20 devstack sudo[83929]: pam_unix(sudo:session): session closed for user root
Apr 28 22:02:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-02ac6be6-f77d-45f7-a1a0-74d6ad9304bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.600s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:02:20 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-02ac6be6-f77d-45f7-a1a0-74d6ad9304bd None None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:02:20 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-02ac6be6-f77d-45f7-a1a0-74d6ad9304bd None None] Driver initialization completed successfully.
Apr 28 22:02:20 devstack cinder-volume[83924]: INFO cinder.manager [None req-02ac6be6-f77d-45f7-a1a0-74d6ad9304bd None None] Initiating service 3 cleanup
Apr 28 22:02:20 devstack cinder-volume[83924]: INFO cinder.manager [None req-02ac6be6-f77d-45f7-a1a0-74d6ad9304bd None None] Service 3 cleanup completed.
Apr 28 22:02:20 devstack cinder-volume[83924]: DEBUG cinder.service [None req-02ac6be6-f77d-45f7-a1a0-74d6ad9304bd None None] Creating RPC server for service cinder-volume {{(pid=83924) start /opt/stack/cinder/cinder/service.py:231}}
Apr 28 22:02:20 devstack cinder-volume[83924]: DEBUG cinder.service [None req-02ac6be6-f77d-45f7-a1a0-74d6ad9304bd None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83924) start /opt/stack/cinder/cinder/service.py:237}}
Apr 28 22:02:21 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-02ac6be6-f77d-45f7-a1a0-74d6ad9304bd None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 28 22:02:21 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-02ac6be6-f77d-45f7-a1a0-74d6ad9304bd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:02:21 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-02ac6be6-f77d-45f7-a1a0-74d6ad9304bd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:02:21 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-02ac6be6-f77d-45f7-a1a0-74d6ad9304bd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:02:21 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-02ac6be6-f77d-45f7-a1a0-74d6ad9304bd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:02:21 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-02ac6be6-f77d-45f7-a1a0-74d6ad9304bd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:02:21 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-02ac6be6-f77d-45f7-a1a0-74d6ad9304bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:02:21 devstack sudo[83934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:02:21 devstack sudo[83934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:02:21 devstack sudo[83934]: pam_unix(sudo:session): session closed for user root
Apr 28 22:02:21 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-02ac6be6-f77d-45f7-a1a0-74d6ad9304bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.580s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:02:21 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-02ac6be6-f77d-45f7-a1a0-74d6ad9304bd None None] Driver post RPC initialization completed successfully.
Apr 28 22:02:29 devstack cinder-volume[83663]: DEBUG dbcounter [-] [83663] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=83663) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 28 22:02:30 devstack cinder-volume[83924]: DEBUG dbcounter [-] [83924] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=83924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 28 22:02:31 devstack cinder-volume[83924]: DEBUG dbcounter [-] [83924] Writing DB stats cinder:SELECT=2 {{(pid=83924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 28 22:03:17 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7eb923c-9104-4f3a-8ec2-9dea6f2ac6cf tempest-VolumesTestJSON-1789549530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:03:17 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b7eb923c-9104-4f3a-8ec2-9dea6f2ac6cf tempest-VolumesTestJSON-1789549530 None] Flow 'volume_create_manager' (40c916f0-a1f5-4ca4-9db6-e6225b8c39dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:03:17 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b7eb923c-9104-4f3a-8ec2-9dea6f2ac6cf tempest-VolumesTestJSON-1789549530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82af6aad-10d5-46cc-b219-d645ef796bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:03:17 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b7eb923c-9104-4f3a-8ec2-9dea6f2ac6cf tempest-VolumesTestJSON-1789549530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82af6aad-10d5-46cc-b219-d645ef796bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:02:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1902389850',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fea0507f-b3e9-4c03-a55b-df74100768dc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0b9df4abc04d49dc95270a7e3806e0cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:03:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:03:18Z,use_quota=True,user_id='b511a40f0e96458c9d78792808f00366',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:03:17 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b7eb923c-9104-4f3a-8ec2-9dea6f2ac6cf tempest-VolumesTestJSON-1789549530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b2120a4-c2ef-481a-b174-9b4c94ebf34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:03:17 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b7eb923c-9104-4f3a-8ec2-9dea6f2ac6cf tempest-VolumesTestJSON-1789549530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b2120a4-c2ef-481a-b174-9b4c94ebf34c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:03:17 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b7eb923c-9104-4f3a-8ec2-9dea6f2ac6cf tempest-VolumesTestJSON-1789549530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (073b205f-622e-4120-a1e6-e09e75b4b176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:03:17 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b7eb923c-9104-4f3a-8ec2-9dea6f2ac6cf tempest-VolumesTestJSON-1789549530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (073b205f-622e-4120-a1e6-e09e75b4b176) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fea0507f-b3e9-4c03-a55b-df74100768dc', 'volume_name': 'volume-fea0507f-b3e9-4c03-a55b-df74100768dc', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:03:17 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b7eb923c-9104-4f3a-8ec2-9dea6f2ac6cf tempest-VolumesTestJSON-1789549530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cae5278-e7e4-489f-9b31-9f79664d024b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:03:18 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b7eb923c-9104-4f3a-8ec2-9dea6f2ac6cf tempest-VolumesTestJSON-1789549530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cae5278-e7e4-489f-9b31-9f79664d024b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:03:18 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b7eb923c-9104-4f3a-8ec2-9dea6f2ac6cf tempest-VolumesTestJSON-1789549530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (808d5d91-71b7-4b20-be85-81b4e728f8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:03:18 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-b7eb923c-9104-4f3a-8ec2-9dea6f2ac6cf tempest-VolumesTestJSON-1789549530 None] Volume fea0507f-b3e9-4c03-a55b-df74100768dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fea0507f-b3e9-4c03-a55b-df74100768dc', 'volume_size': 1}
Apr 28 22:03:18 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b7eb923c-9104-4f3a-8ec2-9dea6f2ac6cf tempest-VolumesTestJSON-1789549530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:03:18 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b7eb923c-9104-4f3a-8ec2-9dea6f2ac6cf tempest-VolumesTestJSON-1789549530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:03:18 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-b7eb923c-9104-4f3a-8ec2-9dea6f2ac6cf tempest-VolumesTestJSON-1789549530 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:02:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1902389850',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fea0507f-b3e9-4c03-a55b-df74100768dc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0b9df4abc04d49dc95270a7e3806e0cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:03:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:03:18Z,use_quota=True,user_id='b511a40f0e96458c9d78792808f00366',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:03:18 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-b7eb923c-9104-4f3a-8ec2-9dea6f2ac6cf tempest-VolumesTestJSON-1789549530 None] Creating volume fea0507f-b3e9-4c03-a55b-df74100768dc {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:03:18 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b7eb923c-9104-4f3a-8ec2-9dea6f2ac6cf tempest-VolumesTestJSON-1789549530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:03:18 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b7eb923c-9104-4f3a-8ec2-9dea6f2ac6cf tempest-VolumesTestJSON-1789549530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:03:18 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-b7eb923c-9104-4f3a-8ec2-9dea6f2ac6cf tempest-VolumesTestJSON-1789549530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:03:18 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-b7eb923c-9104-4f3a-8ec2-9dea6f2ac6cf tempest-VolumesTestJSON-1789549530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:03:18 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b7eb923c-9104-4f3a-8ec2-9dea6f2ac6cf tempest-VolumesTestJSON-1789549530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:03:18 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-b7eb923c-9104-4f3a-8ec2-9dea6f2ac6cf tempest-VolumesTestJSON-1789549530 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:03:18 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-b7eb923c-9104-4f3a-8ec2-9dea6f2ac6cf tempest-VolumesTestJSON-1789549530 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:03:18 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b7eb923c-9104-4f3a-8ec2-9dea6f2ac6cf tempest-VolumesTestJSON-1789549530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-fea0507f-b3e9-4c03-a55b-df74100768dc 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:03:18 devstack sudo[84078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-fea0507f-b3e9-4c03-a55b-df74100768dc 1073741824
Apr 28 22:03:18 devstack sudo[84078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:03:18 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [req-9379e7db-99f5-412d-8732-1ef8681fda43 req-fc2a6621-ec71-49aa-b2e3-32e496b7e377 tempest-VolumesSnapshotsTestJSON-48231436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:03:18 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [req-9379e7db-99f5-412d-8732-1ef8681fda43 req-fc2a6621-ec71-49aa-b2e3-32e496b7e377 tempest-VolumesSnapshotsTestJSON-48231436 None] Flow 'volume_create_manager' (e9b3363c-ed78-42c5-8e0e-0799e98ca380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:03:18 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [req-9379e7db-99f5-412d-8732-1ef8681fda43 req-fc2a6621-ec71-49aa-b2e3-32e496b7e377 tempest-VolumesSnapshotsTestJSON-48231436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0625e4bd-a0cf-4cb6-98ab-d3d4f74512e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:03:18 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [req-9379e7db-99f5-412d-8732-1ef8681fda43 req-fc2a6621-ec71-49aa-b2e3-32e496b7e377 tempest-VolumesSnapshotsTestJSON-48231436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0625e4bd-a0cf-4cb6-98ab-d3d4f74512e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:02:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1217134328',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84dc3a094acc4176beb2af9c0861edd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:03:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:03:18Z,use_quota=True,user_id='d64ae6f387f24a15a567047335c966b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:03:18 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [req-9379e7db-99f5-412d-8732-1ef8681fda43 req-fc2a6621-ec71-49aa-b2e3-32e496b7e377 tempest-VolumesSnapshotsTestJSON-48231436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14235876-f13e-4098-8a2c-617a3ed3a8a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:03:18 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [req-9379e7db-99f5-412d-8732-1ef8681fda43 req-fc2a6621-ec71-49aa-b2e3-32e496b7e377 tempest-VolumesSnapshotsTestJSON-48231436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14235876-f13e-4098-8a2c-617a3ed3a8a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:03:18 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [req-9379e7db-99f5-412d-8732-1ef8681fda43 req-fc2a6621-ec71-49aa-b2e3-32e496b7e377 tempest-VolumesSnapshotsTestJSON-48231436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8c48ee1-de5d-461f-b8b0-5268abffb472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:03:18 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [req-9379e7db-99f5-412d-8732-1ef8681fda43 req-fc2a6621-ec71-49aa-b2e3-32e496b7e377 tempest-VolumesSnapshotsTestJSON-48231436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8c48ee1-de5d-461f-b8b0-5268abffb472) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4', 'volume_name': 'volume-eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:03:18 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [req-9379e7db-99f5-412d-8732-1ef8681fda43 req-fc2a6621-ec71-49aa-b2e3-32e496b7e377 tempest-VolumesSnapshotsTestJSON-48231436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0246740e-e884-4f76-8716-69e4b53b62a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:03:18 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [req-9379e7db-99f5-412d-8732-1ef8681fda43 req-fc2a6621-ec71-49aa-b2e3-32e496b7e377 tempest-VolumesSnapshotsTestJSON-48231436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0246740e-e884-4f76-8716-69e4b53b62a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:03:18 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [req-9379e7db-99f5-412d-8732-1ef8681fda43 req-fc2a6621-ec71-49aa-b2e3-32e496b7e377 tempest-VolumesSnapshotsTestJSON-48231436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f52570ed-c70e-4993-bc20-1ad4f8cc78f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:03:18 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [req-9379e7db-99f5-412d-8732-1ef8681fda43 req-fc2a6621-ec71-49aa-b2e3-32e496b7e377 tempest-VolumesSnapshotsTestJSON-48231436 None] Volume eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4', 'volume_size': 1}
Apr 28 22:03:18 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [req-9379e7db-99f5-412d-8732-1ef8681fda43 req-fc2a6621-ec71-49aa-b2e3-32e496b7e377 tempest-VolumesSnapshotsTestJSON-48231436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:03:19 devstack sudo[84078]: pam_unix(sudo:session): session closed for user root
Apr 28 22:03:19 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b7eb923c-9104-4f3a-8ec2-9dea6f2ac6cf tempest-VolumesTestJSON-1789549530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-fea0507f-b3e9-4c03-a55b-df74100768dc 1073741824" returned: 0 in 1.356s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:03:19 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b7eb923c-9104-4f3a-8ec2-9dea6f2ac6cf tempest-VolumesTestJSON-1789549530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-fea0507f-b3e9-4c03-a55b-df74100768dc {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:03:19 devstack sudo[84399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-fea0507f-b3e9-4c03-a55b-df74100768dc
Apr 28 22:03:19 devstack sudo[84399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:03:20 devstack sudo[84399]: pam_unix(sudo:session): session closed for user root
Apr 28 22:03:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b7eb923c-9104-4f3a-8ec2-9dea6f2ac6cf tempest-VolumesTestJSON-1789549530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-fea0507f-b3e9-4c03-a55b-df74100768dc" returned: 0 in 0.848s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:03:20 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-b7eb923c-9104-4f3a-8ec2-9dea6f2ac6cf tempest-VolumesTestJSON-1789549530 None] <== create_volume: return (2269ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:03:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b7eb923c-9104-4f3a-8ec2-9dea6f2ac6cf tempest-VolumesTestJSON-1789549530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.272s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:03:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [req-9379e7db-99f5-412d-8732-1ef8681fda43 req-fc2a6621-ec71-49aa-b2e3-32e496b7e377 tempest-VolumesSnapshotsTestJSON-48231436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.634s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:03:20 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [req-9379e7db-99f5-412d-8732-1ef8681fda43 req-fc2a6621-ec71-49aa-b2e3-32e496b7e377 tempest-VolumesSnapshotsTestJSON-48231436 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:02:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1217134328',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84dc3a094acc4176beb2af9c0861edd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:03:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:03:18Z,use_quota=True,user_id='d64ae6f387f24a15a567047335c966b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:03:20 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [req-9379e7db-99f5-412d-8732-1ef8681fda43 req-fc2a6621-ec71-49aa-b2e3-32e496b7e377 tempest-VolumesSnapshotsTestJSON-48231436 None] Creating volume eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:03:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [req-9379e7db-99f5-412d-8732-1ef8681fda43 req-fc2a6621-ec71-49aa-b2e3-32e496b7e377 tempest-VolumesSnapshotsTestJSON-48231436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:03:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [req-9379e7db-99f5-412d-8732-1ef8681fda43 req-fc2a6621-ec71-49aa-b2e3-32e496b7e377 tempest-VolumesSnapshotsTestJSON-48231436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:03:20 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [req-9379e7db-99f5-412d-8732-1ef8681fda43 req-fc2a6621-ec71-49aa-b2e3-32e496b7e377 tempest-VolumesSnapshotsTestJSON-48231436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:03:20 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [req-9379e7db-99f5-412d-8732-1ef8681fda43 req-fc2a6621-ec71-49aa-b2e3-32e496b7e377 tempest-VolumesSnapshotsTestJSON-48231436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:03:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [req-9379e7db-99f5-412d-8732-1ef8681fda43 req-fc2a6621-ec71-49aa-b2e3-32e496b7e377 tempest-VolumesSnapshotsTestJSON-48231436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:03:20 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [req-9379e7db-99f5-412d-8732-1ef8681fda43 req-fc2a6621-ec71-49aa-b2e3-32e496b7e377 tempest-VolumesSnapshotsTestJSON-48231436 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:03:20 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [req-9379e7db-99f5-412d-8732-1ef8681fda43 req-fc2a6621-ec71-49aa-b2e3-32e496b7e377 tempest-VolumesSnapshotsTestJSON-48231436 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:03:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-9379e7db-99f5-412d-8732-1ef8681fda43 req-fc2a6621-ec71-49aa-b2e3-32e496b7e377 tempest-VolumesSnapshotsTestJSON-48231436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:03:20 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b7eb923c-9104-4f3a-8ec2-9dea6f2ac6cf tempest-VolumesTestJSON-1789549530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (808d5d91-71b7-4b20-be85-81b4e728f8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fea0507f-b3e9-4c03-a55b-df74100768dc', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:03:20 devstack sudo[84406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4 1073741824
Apr 28 22:03:20 devstack sudo[84406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:03:20 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b7eb923c-9104-4f3a-8ec2-9dea6f2ac6cf tempest-VolumesTestJSON-1789549530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5af87a1d-3ead-4aa0-b1af-ff99eee1f504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:03:20 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-b7eb923c-9104-4f3a-8ec2-9dea6f2ac6cf tempest-VolumesTestJSON-1789549530 None] Volume volume-fea0507f-b3e9-4c03-a55b-df74100768dc (fea0507f-b3e9-4c03-a55b-df74100768dc): created successfully
Apr 28 22:03:20 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b7eb923c-9104-4f3a-8ec2-9dea6f2ac6cf tempest-VolumesTestJSON-1789549530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5af87a1d-3ead-4aa0-b1af-ff99eee1f504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:03:20 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b7eb923c-9104-4f3a-8ec2-9dea6f2ac6cf tempest-VolumesTestJSON-1789549530 None] Flow 'volume_create_manager' (40c916f0-a1f5-4ca4-9db6-e6225b8c39dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:03:20 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-b7eb923c-9104-4f3a-8ec2-9dea6f2ac6cf tempest-VolumesTestJSON-1789549530 None] Created volume successfully.
Apr 28 22:03:21 devstack sudo[84406]: pam_unix(sudo:session): session closed for user root
Apr 28 22:03:21 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-9379e7db-99f5-412d-8732-1ef8681fda43 req-fc2a6621-ec71-49aa-b2e3-32e496b7e377 tempest-VolumesSnapshotsTestJSON-48231436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4 1073741824" returned: 0 in 1.094s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:03:21 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-9379e7db-99f5-412d-8732-1ef8681fda43 req-fc2a6621-ec71-49aa-b2e3-32e496b7e377 tempest-VolumesSnapshotsTestJSON-48231436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:03:21 devstack sudo[84431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4
Apr 28 22:03:21 devstack sudo[84431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:03:22 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-787b67c2-fe34-4c4a-95ca-55a3bd481d40 tempest-VolumesTestJSON-1789549530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:03:22 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-787b67c2-fe34-4c4a-95ca-55a3bd481d40 tempest-VolumesTestJSON-1789549530 None] Flow 'volume_create_manager' (34446597-fe2f-48d4-b965-f1f27b2eea21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:03:22 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-787b67c2-fe34-4c4a-95ca-55a3bd481d40 tempest-VolumesTestJSON-1789549530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4f2b29e-d76c-44ef-b5e7-85c25cab3159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:03:22 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-787b67c2-fe34-4c4a-95ca-55a3bd481d40 tempest-VolumesTestJSON-1789549530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4f2b29e-d76c-44ef-b5e7-85c25cab3159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:03:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-183909110',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27d74a55-c669-4a4e-88f4-89670e08d739,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0b9df4abc04d49dc95270a7e3806e0cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:03:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:03:22Z,use_quota=True,user_id='b511a40f0e96458c9d78792808f00366',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:03:22 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-787b67c2-fe34-4c4a-95ca-55a3bd481d40 tempest-VolumesTestJSON-1789549530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c20ac669-77a3-4d5a-9854-e238f9722b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:03:22 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-787b67c2-fe34-4c4a-95ca-55a3bd481d40 tempest-VolumesTestJSON-1789549530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c20ac669-77a3-4d5a-9854-e238f9722b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:03:22 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-787b67c2-fe34-4c4a-95ca-55a3bd481d40 tempest-VolumesTestJSON-1789549530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (812803be-112c-40fd-8241-82673ec89fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:03:22 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-787b67c2-fe34-4c4a-95ca-55a3bd481d40 tempest-VolumesTestJSON-1789549530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (812803be-112c-40fd-8241-82673ec89fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27d74a55-c669-4a4e-88f4-89670e08d739', 'volume_name': 'volume-27d74a55-c669-4a4e-88f4-89670e08d739', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:03:22 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-787b67c2-fe34-4c4a-95ca-55a3bd481d40 tempest-VolumesTestJSON-1789549530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fb8ad6c-821e-4e13-b7d9-33cf3e2f5072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:03:22 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-787b67c2-fe34-4c4a-95ca-55a3bd481d40 tempest-VolumesTestJSON-1789549530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fb8ad6c-821e-4e13-b7d9-33cf3e2f5072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:03:22 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-787b67c2-fe34-4c4a-95ca-55a3bd481d40 tempest-VolumesTestJSON-1789549530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (124c8292-1056-4ec9-b99d-f947a7d9b50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:03:22 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-787b67c2-fe34-4c4a-95ca-55a3bd481d40 tempest-VolumesTestJSON-1789549530 None] Volume 27d74a55-c669-4a4e-88f4-89670e08d739: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27d74a55-c669-4a4e-88f4-89670e08d739', 'volume_size': 1}
Apr 28 22:03:22 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-787b67c2-fe34-4c4a-95ca-55a3bd481d40 tempest-VolumesTestJSON-1789549530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:03:22 devstack sudo[84431]: pam_unix(sudo:session): session closed for user root
Apr 28 22:03:22 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-9379e7db-99f5-412d-8732-1ef8681fda43 req-fc2a6621-ec71-49aa-b2e3-32e496b7e377 tempest-VolumesSnapshotsTestJSON-48231436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4" returned: 0 in 0.927s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:03:22 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [req-9379e7db-99f5-412d-8732-1ef8681fda43 req-fc2a6621-ec71-49aa-b2e3-32e496b7e377 tempest-VolumesSnapshotsTestJSON-48231436 None] <== create_volume: return (2078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:03:22 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [req-9379e7db-99f5-412d-8732-1ef8681fda43 req-fc2a6621-ec71-49aa-b2e3-32e496b7e377 tempest-VolumesSnapshotsTestJSON-48231436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.086s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:03:22 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-787b67c2-fe34-4c4a-95ca-55a3bd481d40 tempest-VolumesTestJSON-1789549530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.121s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:03:22 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-787b67c2-fe34-4c4a-95ca-55a3bd481d40 tempest-VolumesTestJSON-1789549530 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:03:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-183909110',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27d74a55-c669-4a4e-88f4-89670e08d739,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0b9df4abc04d49dc95270a7e3806e0cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:03:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:03:22Z,use_quota=True,user_id='b511a40f0e96458c9d78792808f00366',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:03:22 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-787b67c2-fe34-4c4a-95ca-55a3bd481d40 tempest-VolumesTestJSON-1789549530 None] Creating volume 27d74a55-c669-4a4e-88f4-89670e08d739 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:03:22 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-787b67c2-fe34-4c4a-95ca-55a3bd481d40 tempest-VolumesTestJSON-1789549530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:03:22 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-787b67c2-fe34-4c4a-95ca-55a3bd481d40 tempest-VolumesTestJSON-1789549530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:03:22 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-787b67c2-fe34-4c4a-95ca-55a3bd481d40 tempest-VolumesTestJSON-1789549530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:03:22 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-787b67c2-fe34-4c4a-95ca-55a3bd481d40 tempest-VolumesTestJSON-1789549530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:03:22 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-787b67c2-fe34-4c4a-95ca-55a3bd481d40 tempest-VolumesTestJSON-1789549530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:03:22 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-787b67c2-fe34-4c4a-95ca-55a3bd481d40 tempest-VolumesTestJSON-1789549530 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:03:22 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-787b67c2-fe34-4c4a-95ca-55a3bd481d40 tempest-VolumesTestJSON-1789549530 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:03:22 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-787b67c2-fe34-4c4a-95ca-55a3bd481d40 tempest-VolumesTestJSON-1789549530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-27d74a55-c669-4a4e-88f4-89670e08d739 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:03:22 devstack sudo[84436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-27d74a55-c669-4a4e-88f4-89670e08d739 1073741824
Apr 28 22:03:22 devstack sudo[84436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:03:22 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [req-9379e7db-99f5-412d-8732-1ef8681fda43 req-fc2a6621-ec71-49aa-b2e3-32e496b7e377 tempest-VolumesSnapshotsTestJSON-48231436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f52570ed-c70e-4993-bc20-1ad4f8cc78f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:03:22 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [req-9379e7db-99f5-412d-8732-1ef8681fda43 req-fc2a6621-ec71-49aa-b2e3-32e496b7e377 tempest-VolumesSnapshotsTestJSON-48231436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73080821-dc93-442b-8e02-c5be21a5eaf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:03:22 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [req-9379e7db-99f5-412d-8732-1ef8681fda43 req-fc2a6621-ec71-49aa-b2e3-32e496b7e377 tempest-VolumesSnapshotsTestJSON-48231436 None] Volume volume-eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4 (eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4): created successfully
Apr 28 22:03:22 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [req-9379e7db-99f5-412d-8732-1ef8681fda43 req-fc2a6621-ec71-49aa-b2e3-32e496b7e377 tempest-VolumesSnapshotsTestJSON-48231436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73080821-dc93-442b-8e02-c5be21a5eaf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:03:22 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [req-9379e7db-99f5-412d-8732-1ef8681fda43 req-fc2a6621-ec71-49aa-b2e3-32e496b7e377 tempest-VolumesSnapshotsTestJSON-48231436 None] Flow 'volume_create_manager' (e9b3363c-ed78-42c5-8e0e-0799e98ca380) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:03:22 devstack cinder-volume[83924]: INFO cinder.volume.manager [req-9379e7db-99f5-412d-8732-1ef8681fda43 req-fc2a6621-ec71-49aa-b2e3-32e496b7e377 tempest-VolumesSnapshotsTestJSON-48231436 None] Created volume successfully.
Apr 28 22:03:23 devstack sudo[84436]: pam_unix(sudo:session): session closed for user root
Apr 28 22:03:23 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-787b67c2-fe34-4c4a-95ca-55a3bd481d40 tempest-VolumesTestJSON-1789549530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-27d74a55-c669-4a4e-88f4-89670e08d739 1073741824" returned: 0 in 1.134s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:03:23 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-787b67c2-fe34-4c4a-95ca-55a3bd481d40 tempest-VolumesTestJSON-1789549530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-27d74a55-c669-4a4e-88f4-89670e08d739 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:03:23 devstack sudo[84445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-27d74a55-c669-4a4e-88f4-89670e08d739
Apr 28 22:03:23 devstack sudo[84445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:03:23 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [req-2e6e5c3e-fc60-4c14-ad65-fed0bae749a0 req-09743f0f-1023-4da4-a0f1-4a76625f7a5a tempest-VolumesSnapshotsTestJSON-48231436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:03:24 devstack sudo[84445]: pam_unix(sudo:session): session closed for user root
Apr 28 22:03:24 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-787b67c2-fe34-4c4a-95ca-55a3bd481d40 tempest-VolumesTestJSON-1789549530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-27d74a55-c669-4a4e-88f4-89670e08d739" returned: 0 in 0.820s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:03:24 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-787b67c2-fe34-4c4a-95ca-55a3bd481d40 tempest-VolumesTestJSON-1789549530 None] <== create_volume: return (2004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:03:24 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-787b67c2-fe34-4c4a-95ca-55a3bd481d40 tempest-VolumesTestJSON-1789549530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.007s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:03:24 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [req-2e6e5c3e-fc60-4c14-ad65-fed0bae749a0 req-09743f0f-1023-4da4-a0f1-4a76625f7a5a tempest-VolumesSnapshotsTestJSON-48231436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.658s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:03:24 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-787b67c2-fe34-4c4a-95ca-55a3bd481d40 tempest-VolumesTestJSON-1789549530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (124c8292-1056-4ec9-b99d-f947a7d9b50e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27d74a55-c669-4a4e-88f4-89670e08d739', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:03:24 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-787b67c2-fe34-4c4a-95ca-55a3bd481d40 tempest-VolumesTestJSON-1789549530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5034391b-0060-4df7-bc83-5f8e5c356c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:03:24 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [req-2e6e5c3e-fc60-4c14-ad65-fed0bae749a0 req-09743f0f-1023-4da4-a0f1-4a76625f7a5a tempest-VolumesSnapshotsTestJSON-48231436 None] Creating offline snapshot 38c4d336-8b6b-4530-b31f-132aa250db61 of volume eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4 {{(pid=83924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 22:03:24 devstack cinder-volume[83924]: INFO oslo.privsep.daemon [req-2e6e5c3e-fc60-4c14-ad65-fed0bae749a0 req-09743f0f-1023-4da4-a0f1-4a76625f7a5a tempest-VolumesSnapshotsTestJSON-48231436 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpif9jcgi3/privsep.sock']
Apr 28 22:03:24 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-787b67c2-fe34-4c4a-95ca-55a3bd481d40 tempest-VolumesTestJSON-1789549530 None] Volume volume-27d74a55-c669-4a4e-88f4-89670e08d739 (27d74a55-c669-4a4e-88f4-89670e08d739): created successfully
Apr 28 22:03:24 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-787b67c2-fe34-4c4a-95ca-55a3bd481d40 tempest-VolumesTestJSON-1789549530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5034391b-0060-4df7-bc83-5f8e5c356c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:03:24 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-787b67c2-fe34-4c4a-95ca-55a3bd481d40 tempest-VolumesTestJSON-1789549530 None] Flow 'volume_create_manager' (34446597-fe2f-48d4-b965-f1f27b2eea21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:03:24 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-787b67c2-fe34-4c4a-95ca-55a3bd481d40 tempest-VolumesTestJSON-1789549530 None] Created volume successfully.
Apr 28 22:03:24 devstack sudo[84459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpif9jcgi3/privsep.sock
Apr 28 22:03:24 devstack sudo[84459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:03:25 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-b146e070-895d-4a44-9156-0f89ebb7da24 tempest-VolumesTestJSON-1789549530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:03:25 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b146e070-895d-4a44-9156-0f89ebb7da24 tempest-VolumesTestJSON-1789549530 None] Flow 'volume_create_manager' (3cafe9c3-8856-4e96-ab4c-053756bd9830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:03:26 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b146e070-895d-4a44-9156-0f89ebb7da24 tempest-VolumesTestJSON-1789549530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c1e0151-613f-43dd-88d1-c278b0521778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:03:26 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b146e070-895d-4a44-9156-0f89ebb7da24 tempest-VolumesTestJSON-1789549530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c1e0151-613f-43dd-88d1-c278b0521778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:03:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-293790527',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f2d8afb-aaae-46a5-96e3-d59d8b48d22f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0b9df4abc04d49dc95270a7e3806e0cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:03:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:03:26Z,use_quota=True,user_id='b511a40f0e96458c9d78792808f00366',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:03:26 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b146e070-895d-4a44-9156-0f89ebb7da24 tempest-VolumesTestJSON-1789549530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0320851e-ab32-4a7d-946c-4ee9eee44aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:03:26 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b146e070-895d-4a44-9156-0f89ebb7da24 tempest-VolumesTestJSON-1789549530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0320851e-ab32-4a7d-946c-4ee9eee44aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:03:26 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b146e070-895d-4a44-9156-0f89ebb7da24 tempest-VolumesTestJSON-1789549530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9289a81-c7e3-4e84-8d55-e7178e380023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:03:26 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b146e070-895d-4a44-9156-0f89ebb7da24 tempest-VolumesTestJSON-1789549530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9289a81-c7e3-4e84-8d55-e7178e380023) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f2d8afb-aaae-46a5-96e3-d59d8b48d22f', 'volume_name': 'volume-7f2d8afb-aaae-46a5-96e3-d59d8b48d22f', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:03:26 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b146e070-895d-4a44-9156-0f89ebb7da24 tempest-VolumesTestJSON-1789549530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cd458b4-c28a-45ff-a9cf-442971beaea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:03:26 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b146e070-895d-4a44-9156-0f89ebb7da24 tempest-VolumesTestJSON-1789549530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cd458b4-c28a-45ff-a9cf-442971beaea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:03:26 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b146e070-895d-4a44-9156-0f89ebb7da24 tempest-VolumesTestJSON-1789549530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e253758-19e3-404a-8299-8f638d7ae571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:03:26 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-b146e070-895d-4a44-9156-0f89ebb7da24 tempest-VolumesTestJSON-1789549530 None] Volume 7f2d8afb-aaae-46a5-96e3-d59d8b48d22f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f2d8afb-aaae-46a5-96e3-d59d8b48d22f', 'volume_size': 1}
Apr 28 22:03:26 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b146e070-895d-4a44-9156-0f89ebb7da24 tempest-VolumesTestJSON-1789549530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:03:26 devstack sudo[84459]: pam_unix(sudo:session): session closed for user root
Apr 28 22:03:26 devstack cinder-volume[83924]: INFO oslo.privsep.daemon [req-2e6e5c3e-fc60-4c14-ad65-fed0bae749a0 req-09743f0f-1023-4da4-a0f1-4a76625f7a5a tempest-VolumesSnapshotsTestJSON-48231436 None] Spawned new privsep daemon via rootwrap
Apr 28 22:03:26 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [req-2e6e5c3e-fc60-4c14-ad65-fed0bae749a0 req-09743f0f-1023-4da4-a0f1-4a76625f7a5a tempest-VolumesSnapshotsTestJSON-48231436 None] Accepted privsep connection to /tmp/tmpif9jcgi3/privsep.sock {{(pid=83924) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:418}}
Apr 28 22:03:26 devstack cinder-volume[83924]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 28 22:03:26 devstack cinder-volume[83924]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 28 22:03:26 devstack cinder-volume[83924]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Apr 28 22:03:26 devstack cinder-volume[83924]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84465
Apr 28 22:03:26 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9bd45e1-c26f-485d-84d8-19c269eb1a10]: (2,) {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:03:26 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ec7509-2504-43e8-abbf-615d91b7ac46]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:03:26 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-2e6e5c3e-fc60-4c14-ad65-fed0bae749a0 req-09743f0f-1023-4da4-a0f1-4a76625f7a5a tempest-VolumesSnapshotsTestJSON-48231436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:03:26 devstack sudo[84467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4
Apr 28 22:03:26 devstack sudo[84467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:03:27 devstack sudo[84467]: pam_unix(sudo:session): session closed for user root
Apr 28 22:03:27 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-2e6e5c3e-fc60-4c14-ad65-fed0bae749a0 req-09743f0f-1023-4da4-a0f1-4a76625f7a5a tempest-VolumesSnapshotsTestJSON-48231436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4" returned: 0 in 1.008s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:03:27 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-2e6e5c3e-fc60-4c14-ad65-fed0bae749a0 req-09743f0f-1023-4da4-a0f1-4a76625f7a5a tempest-VolumesSnapshotsTestJSON-48231436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4.38c4d336-8b6b-4530-b31f-132aa250db61 1G {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:03:27 devstack sudo[84513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4.38c4d336-8b6b-4530-b31f-132aa250db61 1G
Apr 28 22:03:27 devstack sudo[84513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:03:28 devstack sudo[84513]: pam_unix(sudo:session): session closed for user root
Apr 28 22:03:28 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-2e6e5c3e-fc60-4c14-ad65-fed0bae749a0 req-09743f0f-1023-4da4-a0f1-4a76625f7a5a tempest-VolumesSnapshotsTestJSON-48231436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4.38c4d336-8b6b-4530-b31f-132aa250db61 1G" returned: 0 in 1.277s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:03:28 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-2e6e5c3e-fc60-4c14-ad65-fed0bae749a0 req-09743f0f-1023-4da4-a0f1-4a76625f7a5a tempest-VolumesSnapshotsTestJSON-48231436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4.38c4d336-8b6b-4530-b31f-132aa250db61 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:03:28 devstack sudo[84522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4.38c4d336-8b6b-4530-b31f-132aa250db61
Apr 28 22:03:28 devstack sudo[84522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:03:29 devstack sudo[84522]: pam_unix(sudo:session): session closed for user root
Apr 28 22:03:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-2e6e5c3e-fc60-4c14-ad65-fed0bae749a0 req-09743f0f-1023-4da4-a0f1-4a76625f7a5a tempest-VolumesSnapshotsTestJSON-48231436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4.38c4d336-8b6b-4530-b31f-132aa250db61" returned: 0 in 1.121s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:03:29 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [req-2e6e5c3e-fc60-4c14-ad65-fed0bae749a0 req-09743f0f-1023-4da4-a0f1-4a76625f7a5a tempest-VolumesSnapshotsTestJSON-48231436 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4.38c4d336-8b6b-4530-b31f-132aa250db61 is being set with open permissions: ugo+rw
Apr 28 22:03:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-2e6e5c3e-fc60-4c14-ad65-fed0bae749a0 req-09743f0f-1023-4da4-a0f1-4a76625f7a5a tempest-VolumesSnapshotsTestJSON-48231436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4.38c4d336-8b6b-4530-b31f-132aa250db61 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:03:29 devstack sudo[84533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4.38c4d336-8b6b-4530-b31f-132aa250db61
Apr 28 22:03:29 devstack sudo[84533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:03:31 devstack sudo[84533]: pam_unix(sudo:session): session closed for user root
Apr 28 22:03:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-2e6e5c3e-fc60-4c14-ad65-fed0bae749a0 req-09743f0f-1023-4da4-a0f1-4a76625f7a5a tempest-VolumesSnapshotsTestJSON-48231436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4.38c4d336-8b6b-4530-b31f-132aa250db61" returned: 0 in 1.362s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:03:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-2e6e5c3e-fc60-4c14-ad65-fed0bae749a0 req-09743f0f-1023-4da4-a0f1-4a76625f7a5a tempest-VolumesSnapshotsTestJSON-48231436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4.info {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:03:31 devstack sudo[84536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4.info
Apr 28 22:03:31 devstack sudo[84536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:03:31 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-48aed3ac-8671-4dfd-8ea0-e65331e8ca93 tempest-VolumesAdminNegativeTest-1452946245 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:03:31 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-48aed3ac-8671-4dfd-8ea0-e65331e8ca93 tempest-VolumesAdminNegativeTest-1452946245 None] Flow 'volume_create_manager' (c4e43421-223d-43cd-aeaf-03506715c54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:03:31 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-48aed3ac-8671-4dfd-8ea0-e65331e8ca93 tempest-VolumesAdminNegativeTest-1452946245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b690845d-75ea-403f-9a22-bfdcae2d6d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:03:31 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-48aed3ac-8671-4dfd-8ea0-e65331e8ca93 tempest-VolumesAdminNegativeTest-1452946245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b690845d-75ea-403f-9a22-bfdcae2d6d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:03:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-818703718',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9312d68d-f454-4eed-bd16-04200c66cf5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61da3c4aff844e928ebfb6564f0e432c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:03:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:03:31Z,use_quota=True,user_id='379e8657c5334a089197f986a9139cc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:03:31 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-48aed3ac-8671-4dfd-8ea0-e65331e8ca93 tempest-VolumesAdminNegativeTest-1452946245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a936175-4626-475a-9ed5-48f52a9a5ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:03:31 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-48aed3ac-8671-4dfd-8ea0-e65331e8ca93 tempest-VolumesAdminNegativeTest-1452946245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a936175-4626-475a-9ed5-48f52a9a5ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:03:31 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-48aed3ac-8671-4dfd-8ea0-e65331e8ca93 tempest-VolumesAdminNegativeTest-1452946245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e88db5fd-4ce6-45c3-bec8-b83487917235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:03:31 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-48aed3ac-8671-4dfd-8ea0-e65331e8ca93 tempest-VolumesAdminNegativeTest-1452946245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e88db5fd-4ce6-45c3-bec8-b83487917235) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9312d68d-f454-4eed-bd16-04200c66cf5c', 'volume_name': 'volume-9312d68d-f454-4eed-bd16-04200c66cf5c', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:03:31 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-48aed3ac-8671-4dfd-8ea0-e65331e8ca93 tempest-VolumesAdminNegativeTest-1452946245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (547a6930-6a96-42e6-801b-9be7bdea03e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:03:31 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-48aed3ac-8671-4dfd-8ea0-e65331e8ca93 tempest-VolumesAdminNegativeTest-1452946245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (547a6930-6a96-42e6-801b-9be7bdea03e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:03:31 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-48aed3ac-8671-4dfd-8ea0-e65331e8ca93 tempest-VolumesAdminNegativeTest-1452946245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (798d37ad-4701-4d95-a550-8d5afa93ce9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:03:31 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-48aed3ac-8671-4dfd-8ea0-e65331e8ca93 tempest-VolumesAdminNegativeTest-1452946245 None] Volume 9312d68d-f454-4eed-bd16-04200c66cf5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9312d68d-f454-4eed-bd16-04200c66cf5c', 'volume_size': 1}
Apr 28 22:03:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-48aed3ac-8671-4dfd-8ea0-e65331e8ca93 tempest-VolumesAdminNegativeTest-1452946245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:03:32 devstack sudo[84536]: pam_unix(sudo:session): session closed for user root
Apr 28 22:03:32 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-2e6e5c3e-fc60-4c14-ad65-fed0bae749a0 req-09743f0f-1023-4da4-a0f1-4a76625f7a5a tempest-VolumesSnapshotsTestJSON-48231436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4.info" returned: 0 in 1.387s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:03:32 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [req-2e6e5c3e-fc60-4c14-ad65-fed0bae749a0 req-09743f0f-1023-4da4-a0f1-4a76625f7a5a tempest-VolumesSnapshotsTestJSON-48231436 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4.info is being set with open permissions: ugo+rw
Apr 28 22:03:32 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-2e6e5c3e-fc60-4c14-ad65-fed0bae749a0 req-09743f0f-1023-4da4-a0f1-4a76625f7a5a tempest-VolumesSnapshotsTestJSON-48231436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4.info {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:03:32 devstack sudo[84541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4.info
Apr 28 22:03:32 devstack sudo[84541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:03:33 devstack sudo[84541]: pam_unix(sudo:session): session closed for user root
Apr 28 22:03:33 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-2e6e5c3e-fc60-4c14-ad65-fed0bae749a0 req-09743f0f-1023-4da4-a0f1-4a76625f7a5a tempest-VolumesSnapshotsTestJSON-48231436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4.info" returned: 0 in 0.854s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:03:33 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [req-2e6e5c3e-fc60-4c14-ad65-fed0bae749a0 req-09743f0f-1023-4da4-a0f1-4a76625f7a5a tempest-VolumesSnapshotsTestJSON-48231436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 8.980s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:03:33 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b146e070-895d-4a44-9156-0f89ebb7da24 tempest-VolumesTestJSON-1789549530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.289s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:03:33 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-b146e070-895d-4a44-9156-0f89ebb7da24 tempest-VolumesTestJSON-1789549530 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:03:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-293790527',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f2d8afb-aaae-46a5-96e3-d59d8b48d22f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0b9df4abc04d49dc95270a7e3806e0cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:03:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:03:26Z,use_quota=True,user_id='b511a40f0e96458c9d78792808f00366',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:03:33 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-b146e070-895d-4a44-9156-0f89ebb7da24 tempest-VolumesTestJSON-1789549530 None] Creating volume 7f2d8afb-aaae-46a5-96e3-d59d8b48d22f {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:03:33 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b146e070-895d-4a44-9156-0f89ebb7da24 tempest-VolumesTestJSON-1789549530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:03:33 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b146e070-895d-4a44-9156-0f89ebb7da24 tempest-VolumesTestJSON-1789549530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:03:33 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-b146e070-895d-4a44-9156-0f89ebb7da24 tempest-VolumesTestJSON-1789549530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:03:33 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-b146e070-895d-4a44-9156-0f89ebb7da24 tempest-VolumesTestJSON-1789549530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:03:33 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b146e070-895d-4a44-9156-0f89ebb7da24 tempest-VolumesTestJSON-1789549530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:03:33 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-b146e070-895d-4a44-9156-0f89ebb7da24 tempest-VolumesTestJSON-1789549530 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:03:33 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-b146e070-895d-4a44-9156-0f89ebb7da24 tempest-VolumesTestJSON-1789549530 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:03:33 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b146e070-895d-4a44-9156-0f89ebb7da24 tempest-VolumesTestJSON-1789549530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7f2d8afb-aaae-46a5-96e3-d59d8b48d22f 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:03:33 devstack sudo[84573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7f2d8afb-aaae-46a5-96e3-d59d8b48d22f 1073741824
Apr 28 22:03:33 devstack sudo[84573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:03:33 devstack cinder-volume[83924]: INFO cinder.volume.manager [req-2e6e5c3e-fc60-4c14-ad65-fed0bae749a0 req-09743f0f-1023-4da4-a0f1-4a76625f7a5a tempest-VolumesSnapshotsTestJSON-48231436 None] Create snapshot completed successfully
Apr 28 22:03:34 devstack cinder-volume[83924]: DEBUG cinder.coordination [req-7473af87-6cff-4097-b52a-2ed251768acd req-d5eb79df-210b-44fa-a360-146ee0e72c80 tempest-VolumesSnapshotsTestJSON-48231436 None] Acquiring lock "cinder-38c4d336-8b6b-4530-b31f-132aa250db61-delete_snapshot" by "delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:03:34 devstack cinder-volume[83924]: DEBUG cinder.coordination [req-7473af87-6cff-4097-b52a-2ed251768acd req-d5eb79df-210b-44fa-a360-146ee0e72c80 tempest-VolumesSnapshotsTestJSON-48231436 None] Lock "cinder-38c4d336-8b6b-4530-b31f-132aa250db61-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:03:34 devstack cinder-volume[83924]: DEBUG cinder.coordination [req-7473af87-6cff-4097-b52a-2ed251768acd req-d5eb79df-210b-44fa-a360-146ee0e72c80 tempest-VolumesSnapshotsTestJSON-48231436 None] Acquiring lock "cinder-quobyte-eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4" by "delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:03:34 devstack cinder-volume[83924]: DEBUG cinder.coordination [req-7473af87-6cff-4097-b52a-2ed251768acd req-d5eb79df-210b-44fa-a360-146ee0e72c80 tempest-VolumesSnapshotsTestJSON-48231436 None] Lock "cinder-quobyte-eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4" acquired by "delete_snapshot" :: waited 0.040s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:03:34 devstack cinder-volume[83924]: DEBUG cinder.coordination [req-7473af87-6cff-4097-b52a-2ed251768acd req-d5eb79df-210b-44fa-a360-146ee0e72c80 tempest-VolumesSnapshotsTestJSON-48231436 None] Acquiring lock "cinder-quobyte-38c4d336-8b6b-4530-b31f-132aa250db61" by "_delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:03:34 devstack cinder-volume[83924]: DEBUG cinder.coordination [req-7473af87-6cff-4097-b52a-2ed251768acd req-d5eb79df-210b-44fa-a360-146ee0e72c80 tempest-VolumesSnapshotsTestJSON-48231436 None] Lock "cinder-quobyte-38c4d336-8b6b-4530-b31f-132aa250db61" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:03:34 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [req-7473af87-6cff-4097-b52a-2ed251768acd req-d5eb79df-210b-44fa-a360-146ee0e72c80 tempest-VolumesSnapshotsTestJSON-48231436 None] Deleting offline snapshot 38c4d336-8b6b-4530-b31f-132aa250db61 of volume eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4 {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 22:03:34 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [req-7473af87-6cff-4097-b52a-2ed251768acd req-d5eb79df-210b-44fa-a360-146ee0e72c80 tempest-VolumesSnapshotsTestJSON-48231436 None] snapshot_file for this snap is: volume-eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4.38c4d336-8b6b-4530-b31f-132aa250db61 {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 22:03:34 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4efea97-76f5-4445-92f6-182ea626c2d3]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:03:34 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-7473af87-6cff-4097-b52a-2ed251768acd req-d5eb79df-210b-44fa-a360-146ee0e72c80 tempest-VolumesSnapshotsTestJSON-48231436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4.38c4d336-8b6b-4530-b31f-132aa250db61 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:03:34 devstack sudo[84573]: pam_unix(sudo:session): session closed for user root
Apr 28 22:03:34 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b146e070-895d-4a44-9156-0f89ebb7da24 tempest-VolumesTestJSON-1789549530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7f2d8afb-aaae-46a5-96e3-d59d8b48d22f 1073741824" returned: 0 in 1.296s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:03:34 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b146e070-895d-4a44-9156-0f89ebb7da24 tempest-VolumesTestJSON-1789549530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7f2d8afb-aaae-46a5-96e3-d59d8b48d22f {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:03:34 devstack sudo[84594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4.38c4d336-8b6b-4530-b31f-132aa250db61
Apr 28 22:03:34 devstack sudo[84594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:03:34 devstack sudo[84595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7f2d8afb-aaae-46a5-96e3-d59d8b48d22f
Apr 28 22:03:34 devstack sudo[84595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:03:35 devstack sudo[84594]: pam_unix(sudo:session): session closed for user root
Apr 28 22:03:35 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-7473af87-6cff-4097-b52a-2ed251768acd req-d5eb79df-210b-44fa-a360-146ee0e72c80 tempest-VolumesSnapshotsTestJSON-48231436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4.38c4d336-8b6b-4530-b31f-132aa250db61" returned: 0 in 1.022s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:03:35 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [req-7473af87-6cff-4097-b52a-2ed251768acd req-d5eb79df-210b-44fa-a360-146ee0e72c80 tempest-VolumesSnapshotsTestJSON-48231436 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 22:03:35 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00fa65b-7bb8-4f1e-a733-2d2c88693d24]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:03:35 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-7473af87-6cff-4097-b52a-2ed251768acd req-d5eb79df-210b-44fa-a360-146ee0e72c80 tempest-VolumesSnapshotsTestJSON-48231436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:03:35 devstack sudo[84595]: pam_unix(sudo:session): session closed for user root
Apr 28 22:03:35 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b146e070-895d-4a44-9156-0f89ebb7da24 tempest-VolumesTestJSON-1789549530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7f2d8afb-aaae-46a5-96e3-d59d8b48d22f" returned: 0 in 0.966s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:03:35 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-b146e070-895d-4a44-9156-0f89ebb7da24 tempest-VolumesTestJSON-1789549530 None] <== create_volume: return (2343ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:03:35 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b146e070-895d-4a44-9156-0f89ebb7da24 tempest-VolumesTestJSON-1789549530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.353s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:03:35 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-48aed3ac-8671-4dfd-8ea0-e65331e8ca93 tempest-VolumesAdminNegativeTest-1452946245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.991s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:03:35 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-48aed3ac-8671-4dfd-8ea0-e65331e8ca93 tempest-VolumesAdminNegativeTest-1452946245 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:03:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-818703718',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9312d68d-f454-4eed-bd16-04200c66cf5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61da3c4aff844e928ebfb6564f0e432c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:03:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:03:31Z,use_quota=True,user_id='379e8657c5334a089197f986a9139cc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:03:35 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-48aed3ac-8671-4dfd-8ea0-e65331e8ca93 tempest-VolumesAdminNegativeTest-1452946245 None] Creating volume 9312d68d-f454-4eed-bd16-04200c66cf5c {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:03:35 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-48aed3ac-8671-4dfd-8ea0-e65331e8ca93 tempest-VolumesAdminNegativeTest-1452946245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:03:35 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-48aed3ac-8671-4dfd-8ea0-e65331e8ca93 tempest-VolumesAdminNegativeTest-1452946245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:03:35 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-48aed3ac-8671-4dfd-8ea0-e65331e8ca93 tempest-VolumesAdminNegativeTest-1452946245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:03:35 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-48aed3ac-8671-4dfd-8ea0-e65331e8ca93 tempest-VolumesAdminNegativeTest-1452946245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:03:35 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-48aed3ac-8671-4dfd-8ea0-e65331e8ca93 tempest-VolumesAdminNegativeTest-1452946245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:03:35 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-48aed3ac-8671-4dfd-8ea0-e65331e8ca93 tempest-VolumesAdminNegativeTest-1452946245 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:03:35 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-48aed3ac-8671-4dfd-8ea0-e65331e8ca93 tempest-VolumesAdminNegativeTest-1452946245 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:03:35 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-48aed3ac-8671-4dfd-8ea0-e65331e8ca93 tempest-VolumesAdminNegativeTest-1452946245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9312d68d-f454-4eed-bd16-04200c66cf5c 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:03:35 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b146e070-895d-4a44-9156-0f89ebb7da24 tempest-VolumesTestJSON-1789549530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e253758-19e3-404a-8299-8f638d7ae571) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f2d8afb-aaae-46a5-96e3-d59d8b48d22f', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:03:35 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b146e070-895d-4a44-9156-0f89ebb7da24 tempest-VolumesTestJSON-1789549530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f9f3f10-3333-4028-9871-93e37db178e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:03:35 devstack sudo[84606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9312d68d-f454-4eed-bd16-04200c66cf5c 1073741824
Apr 28 22:03:35 devstack sudo[84606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:03:35 devstack sudo[84605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4
Apr 28 22:03:35 devstack sudo[84605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:03:35 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-b146e070-895d-4a44-9156-0f89ebb7da24 tempest-VolumesTestJSON-1789549530 None] Volume volume-7f2d8afb-aaae-46a5-96e3-d59d8b48d22f (7f2d8afb-aaae-46a5-96e3-d59d8b48d22f): created successfully
Apr 28 22:03:35 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b146e070-895d-4a44-9156-0f89ebb7da24 tempest-VolumesTestJSON-1789549530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f9f3f10-3333-4028-9871-93e37db178e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:03:35 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b146e070-895d-4a44-9156-0f89ebb7da24 tempest-VolumesTestJSON-1789549530 None] Flow 'volume_create_manager' (3cafe9c3-8856-4e96-ab4c-053756bd9830) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:03:35 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-b146e070-895d-4a44-9156-0f89ebb7da24 tempest-VolumesTestJSON-1789549530 None] Created volume successfully.
Apr 28 22:03:36 devstack sudo[84605]: pam_unix(sudo:session): session closed for user root
Apr 28 22:03:36 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-7473af87-6cff-4097-b52a-2ed251768acd req-d5eb79df-210b-44fa-a360-146ee0e72c80 tempest-VolumesSnapshotsTestJSON-48231436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4" returned: 0 in 1.284s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:03:36 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-7473af87-6cff-4097-b52a-2ed251768acd req-d5eb79df-210b-44fa-a360-146ee0e72c80 tempest-VolumesSnapshotsTestJSON-48231436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4.38c4d336-8b6b-4530-b31f-132aa250db61 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:03:37 devstack sudo[84615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4.38c4d336-8b6b-4530-b31f-132aa250db61
Apr 28 22:03:37 devstack sudo[84615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:03:37 devstack sudo[84606]: pam_unix(sudo:session): session closed for user root
Apr 28 22:03:37 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-48aed3ac-8671-4dfd-8ea0-e65331e8ca93 tempest-VolumesAdminNegativeTest-1452946245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9312d68d-f454-4eed-bd16-04200c66cf5c 1073741824" returned: 0 in 1.510s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:03:37 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-48aed3ac-8671-4dfd-8ea0-e65331e8ca93 tempest-VolumesAdminNegativeTest-1452946245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9312d68d-f454-4eed-bd16-04200c66cf5c {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:03:37 devstack sudo[84618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9312d68d-f454-4eed-bd16-04200c66cf5c
Apr 28 22:03:37 devstack sudo[84618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:03:37 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-054a9863-7b36-47e4-8a0f-a1e4b11a49b9 tempest-VolumesTestJSON-1789549530 None] Acquiring lock "cinder-7f2d8afb-aaae-46a5-96e3-d59d8b48d22f-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:03:37 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-054a9863-7b36-47e4-8a0f-a1e4b11a49b9 tempest-VolumesTestJSON-1789549530 None] Lock "cinder-7f2d8afb-aaae-46a5-96e3-d59d8b48d22f-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:03:37 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-054a9863-7b36-47e4-8a0f-a1e4b11a49b9 tempest-VolumesTestJSON-1789549530 None] Acquiring lock "cinder-quobyte-7f2d8afb-aaae-46a5-96e3-d59d8b48d22f" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:03:38 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-054a9863-7b36-47e4-8a0f-a1e4b11a49b9 tempest-VolumesTestJSON-1789549530 None] Lock "cinder-quobyte-7f2d8afb-aaae-46a5-96e3-d59d8b48d22f" acquired by "delete_volume" :: waited 0.041s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:03:38 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e536babb-ab87-4f93-a86c-b7ce863e1d71]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:03:38 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-054a9863-7b36-47e4-8a0f-a1e4b11a49b9 tempest-VolumesTestJSON-1789549530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7f2d8afb-aaae-46a5-96e3-d59d8b48d22f {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:03:38 devstack sudo[84625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7f2d8afb-aaae-46a5-96e3-d59d8b48d22f
Apr 28 22:03:38 devstack sudo[84625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:03:38 devstack sudo[84618]: pam_unix(sudo:session): session closed for user root
Apr 28 22:03:38 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-48aed3ac-8671-4dfd-8ea0-e65331e8ca93 tempest-VolumesAdminNegativeTest-1452946245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9312d68d-f454-4eed-bd16-04200c66cf5c" returned: 0 in 0.937s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:03:38 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-48aed3ac-8671-4dfd-8ea0-e65331e8ca93 tempest-VolumesAdminNegativeTest-1452946245 None] <== create_volume: return (2525ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:03:38 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-48aed3ac-8671-4dfd-8ea0-e65331e8ca93 tempest-VolumesAdminNegativeTest-1452946245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.529s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:03:38 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-48aed3ac-8671-4dfd-8ea0-e65331e8ca93 tempest-VolumesAdminNegativeTest-1452946245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (798d37ad-4701-4d95-a550-8d5afa93ce9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9312d68d-f454-4eed-bd16-04200c66cf5c', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:03:38 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-48aed3ac-8671-4dfd-8ea0-e65331e8ca93 tempest-VolumesAdminNegativeTest-1452946245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f36d3ec-a34a-4941-86b2-658ef851cdce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:03:38 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-48aed3ac-8671-4dfd-8ea0-e65331e8ca93 tempest-VolumesAdminNegativeTest-1452946245 None] Volume volume-9312d68d-f454-4eed-bd16-04200c66cf5c (9312d68d-f454-4eed-bd16-04200c66cf5c): created successfully
Apr 28 22:03:38 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-48aed3ac-8671-4dfd-8ea0-e65331e8ca93 tempest-VolumesAdminNegativeTest-1452946245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f36d3ec-a34a-4941-86b2-658ef851cdce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:03:38 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-48aed3ac-8671-4dfd-8ea0-e65331e8ca93 tempest-VolumesAdminNegativeTest-1452946245 None] Flow 'volume_create_manager' (c4e43421-223d-43cd-aeaf-03506715c54b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:03:38 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-48aed3ac-8671-4dfd-8ea0-e65331e8ca93 tempest-VolumesAdminNegativeTest-1452946245 None] Created volume successfully.
Apr 28 22:03:38 devstack sudo[84615]: pam_unix(sudo:session): session closed for user root
Apr 28 22:03:38 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-7473af87-6cff-4097-b52a-2ed251768acd req-d5eb79df-210b-44fa-a360-146ee0e72c80 tempest-VolumesSnapshotsTestJSON-48231436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4.38c4d336-8b6b-4530-b31f-132aa250db61" returned: 0 in 1.490s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:03:38 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-7473af87-6cff-4097-b52a-2ed251768acd req-d5eb79df-210b-44fa-a360-146ee0e72c80 tempest-VolumesSnapshotsTestJSON-48231436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4.38c4d336-8b6b-4530-b31f-132aa250db61 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:03:38 devstack sudo[84627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4.38c4d336-8b6b-4530-b31f-132aa250db61
Apr 28 22:03:38 devstack sudo[84627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:03:39 devstack sudo[84625]: pam_unix(sudo:session): session closed for user root
Apr 28 22:03:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-054a9863-7b36-47e4-8a0f-a1e4b11a49b9 tempest-VolumesTestJSON-1789549530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7f2d8afb-aaae-46a5-96e3-d59d8b48d22f" returned: 0 in 1.121s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:03:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-054a9863-7b36-47e4-8a0f-a1e4b11a49b9 tempest-VolumesTestJSON-1789549530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7f2d8afb-aaae-46a5-96e3-d59d8b48d22f {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:03:39 devstack sudo[84632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7f2d8afb-aaae-46a5-96e3-d59d8b48d22f
Apr 28 22:03:39 devstack sudo[84632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:03:39 devstack sudo[84627]: pam_unix(sudo:session): session closed for user root
Apr 28 22:03:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-7473af87-6cff-4097-b52a-2ed251768acd req-d5eb79df-210b-44fa-a360-146ee0e72c80 tempest-VolumesSnapshotsTestJSON-48231436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4.38c4d336-8b6b-4530-b31f-132aa250db61" returned: 0 in 0.960s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:03:39 devstack cinder-volume[83924]: DEBUG cinder.coordination [req-7473af87-6cff-4097-b52a-2ed251768acd req-d5eb79df-210b-44fa-a360-146ee0e72c80 tempest-VolumesSnapshotsTestJSON-48231436 None] Lock "cinder-quobyte-38c4d336-8b6b-4530-b31f-132aa250db61" released by "_delete_snapshot" :: held 4.971s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:03:39 devstack cinder-volume[83924]: DEBUG cinder.coordination [req-7473af87-6cff-4097-b52a-2ed251768acd req-d5eb79df-210b-44fa-a360-146ee0e72c80 tempest-VolumesSnapshotsTestJSON-48231436 None] Lock "cinder-quobyte-eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4" released by "delete_snapshot" :: held 5.027s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:03:39 devstack cinder-volume[83924]: WARNING cinder.quota [req-7473af87-6cff-4097-b52a-2ed251768acd req-d5eb79df-210b-44fa-a360-146ee0e72c80 tempest-VolumesSnapshotsTestJSON-48231436 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 28 22:03:39 devstack cinder-volume[83924]: WARNING cinder.quota [req-7473af87-6cff-4097-b52a-2ed251768acd req-d5eb79df-210b-44fa-a360-146ee0e72c80 tempest-VolumesSnapshotsTestJSON-48231436 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 28 22:03:39 devstack cinder-volume[83924]: DEBUG oslo_service.periodic_task [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83924) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 28 22:03:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:03:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:03:39 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:03:39 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:03:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:03:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:03:39 devstack sudo[84635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:03:39 devstack cinder-volume[83924]: DEBUG cinder.quota [req-7473af87-6cff-4097-b52a-2ed251768acd req-d5eb79df-210b-44fa-a360-146ee0e72c80 tempest-VolumesSnapshotsTestJSON-48231436 None] Created reservations ['0af75554-6dc5-4442-b3bf-0e0517f4baa3', '6e27d8c5-46d7-45e7-92cd-3bf328454f9a', '87e1568b-46bd-4b7d-a227-01562329056f', 'a92242ad-33a4-4569-be41-59b9da8b8d52'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:03:39 devstack sudo[84635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:03:39 devstack cinder-volume[83924]: INFO cinder.volume.manager [req-7473af87-6cff-4097-b52a-2ed251768acd req-d5eb79df-210b-44fa-a360-146ee0e72c80 tempest-VolumesSnapshotsTestJSON-48231436 None] Delete snapshot completed successfully.
Apr 28 22:03:39 devstack cinder-volume[83924]: DEBUG cinder.coordination [req-7473af87-6cff-4097-b52a-2ed251768acd req-d5eb79df-210b-44fa-a360-146ee0e72c80 tempest-VolumesSnapshotsTestJSON-48231436 None] Lock "cinder-38c4d336-8b6b-4530-b31f-132aa250db61-delete_snapshot" released by "delete_snapshot" :: held 5.506s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:03:40 devstack sudo[84632]: pam_unix(sudo:session): session closed for user root
Apr 28 22:03:40 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-054a9863-7b36-47e4-8a0f-a1e4b11a49b9 tempest-VolumesTestJSON-1789549530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7f2d8afb-aaae-46a5-96e3-d59d8b48d22f" returned: 0 in 1.109s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:03:40 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-054a9863-7b36-47e4-8a0f-a1e4b11a49b9 tempest-VolumesTestJSON-1789549530 None] Lock "cinder-quobyte-7f2d8afb-aaae-46a5-96e3-d59d8b48d22f" released by "delete_volume" :: held 2.312s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:03:40 devstack cinder-volume[83924]: WARNING cinder.quota [None req-054a9863-7b36-47e4-8a0f-a1e4b11a49b9 tempest-VolumesTestJSON-1789549530 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 28 22:03:40 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-054a9863-7b36-47e4-8a0f-a1e4b11a49b9 tempest-VolumesTestJSON-1789549530 None] Created reservations ['3820a87c-9885-40d9-b9a4-76237d36c1f7', '4d6b3deb-4a3e-4b10-bf3d-14f5fdae9b1b', '59b89338-b69b-4cbe-9c43-e075621d7827', '465586e6-5c98-4531-9a68-e0571ddb5c72'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:03:40 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-eb37a9a2-58c9-47dc-bad1-862f7554579d tempest-VolumesAdminNegativeTest-1452946245 None] Acquiring lock "cinder-9312d68d-f454-4eed-bd16-04200c66cf5c-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:03:40 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-eb37a9a2-58c9-47dc-bad1-862f7554579d tempest-VolumesAdminNegativeTest-1452946245 None] Lock "cinder-9312d68d-f454-4eed-bd16-04200c66cf5c-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:03:40 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-054a9863-7b36-47e4-8a0f-a1e4b11a49b9 tempest-VolumesTestJSON-1789549530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:03:40 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-054a9863-7b36-47e4-8a0f-a1e4b11a49b9 tempest-VolumesTestJSON-1789549530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:03:40 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-054a9863-7b36-47e4-8a0f-a1e4b11a49b9 tempest-VolumesTestJSON-1789549530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:03:40 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-054a9863-7b36-47e4-8a0f-a1e4b11a49b9 tempest-VolumesTestJSON-1789549530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:03:40 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-054a9863-7b36-47e4-8a0f-a1e4b11a49b9 tempest-VolumesTestJSON-1789549530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:03:40 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-054a9863-7b36-47e4-8a0f-a1e4b11a49b9 tempest-VolumesTestJSON-1789549530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:03:40 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-eb37a9a2-58c9-47dc-bad1-862f7554579d tempest-VolumesAdminNegativeTest-1452946245 None] Acquiring lock "cinder-quobyte-9312d68d-f454-4eed-bd16-04200c66cf5c" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:03:40 devstack sudo[84639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:03:40 devstack sudo[84639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:03:40 devstack cinder-volume[83924]: DEBUG cinder.coordination [req-7652af2f-a196-442b-b26d-5627d4f69902 req-56a5ba18-56c8-4786-87f9-39108f9756bc tempest-VolumesSnapshotsTestJSON-48231436 None] Acquiring lock "cinder-eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:03:40 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-eb37a9a2-58c9-47dc-bad1-862f7554579d tempest-VolumesAdminNegativeTest-1452946245 None] Lock "cinder-quobyte-9312d68d-f454-4eed-bd16-04200c66cf5c" acquired by "delete_volume" :: waited 0.080s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:03:40 devstack cinder-volume[83924]: DEBUG cinder.coordination [req-7652af2f-a196-442b-b26d-5627d4f69902 req-56a5ba18-56c8-4786-87f9-39108f9756bc tempest-VolumesSnapshotsTestJSON-48231436 None] Lock "cinder-eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:03:40 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[92eecb7b-e14c-44aa-9da0-c855b76caf3d]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:03:40 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-eb37a9a2-58c9-47dc-bad1-862f7554579d tempest-VolumesAdminNegativeTest-1452946245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9312d68d-f454-4eed-bd16-04200c66cf5c {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:03:41 devstack sudo[84635]: pam_unix(sudo:session): session closed for user root
Apr 28 22:03:41 devstack cinder-volume[83924]: DEBUG cinder.coordination [req-7652af2f-a196-442b-b26d-5627d4f69902 req-56a5ba18-56c8-4786-87f9-39108f9756bc tempest-VolumesSnapshotsTestJSON-48231436 None] Acquiring lock "cinder-quobyte-eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:03:41 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 1.398s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:03:41 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:03:41 devstack cinder-volume[83924]: DEBUG cinder.coordination [req-7652af2f-a196-442b-b26d-5627d4f69902 req-56a5ba18-56c8-4786-87f9-39108f9756bc tempest-VolumesSnapshotsTestJSON-48231436 None] Lock "cinder-quobyte-eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4" acquired by "delete_volume" :: waited 0.051s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:03:41 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03368d9-46ed-4750-8460-d652c909fbae]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:03:41 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-7652af2f-a196-442b-b26d-5627d4f69902 req-56a5ba18-56c8-4786-87f9-39108f9756bc tempest-VolumesSnapshotsTestJSON-48231436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:03:41 devstack sudo[84641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9312d68d-f454-4eed-bd16-04200c66cf5c
Apr 28 22:03:41 devstack sudo[84641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:03:41 devstack sudo[84643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4
Apr 28 22:03:41 devstack sudo[84643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:03:41 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-c5c256a6-6b5a-4a87-8145-f7426dad355c tempest-VolumesTestJSON-1789549530 None] Acquiring lock "cinder-27d74a55-c669-4a4e-88f4-89670e08d739-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:03:41 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-c5c256a6-6b5a-4a87-8145-f7426dad355c tempest-VolumesTestJSON-1789549530 None] Lock "cinder-27d74a55-c669-4a4e-88f4-89670e08d739-delete_volume" acquired by "delete_volume" :: waited 0.114s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:03:41 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-c5c256a6-6b5a-4a87-8145-f7426dad355c tempest-VolumesTestJSON-1789549530 None] Acquiring lock "cinder-quobyte-27d74a55-c669-4a4e-88f4-89670e08d739" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:03:42 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-c5c256a6-6b5a-4a87-8145-f7426dad355c tempest-VolumesTestJSON-1789549530 None] Lock "cinder-quobyte-27d74a55-c669-4a4e-88f4-89670e08d739" acquired by "delete_volume" :: waited 0.077s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:03:42 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b5bdb9-cee2-4b9a-984c-f90b044a170b]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:03:42 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c5c256a6-6b5a-4a87-8145-f7426dad355c tempest-VolumesTestJSON-1789549530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-27d74a55-c669-4a4e-88f4-89670e08d739 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:03:42 devstack sudo[84639]: pam_unix(sudo:session): session closed for user root
Apr 28 22:03:42 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-054a9863-7b36-47e4-8a0f-a1e4b11a49b9 tempest-VolumesTestJSON-1789549530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 1.477s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:03:42 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-054a9863-7b36-47e4-8a0f-a1e4b11a49b9 tempest-VolumesTestJSON-1789549530 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:03:42 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-054a9863-7b36-47e4-8a0f-a1e4b11a49b9 tempest-VolumesTestJSON-1789549530 None] Deleted volume successfully.
Apr 28 22:03:42 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-054a9863-7b36-47e4-8a0f-a1e4b11a49b9 tempest-VolumesTestJSON-1789549530 None] Lock "cinder-7f2d8afb-aaae-46a5-96e3-d59d8b48d22f-delete_volume" released by "delete_volume" :: held 4.409s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:03:42 devstack sudo[84689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-27d74a55-c669-4a4e-88f4-89670e08d739
Apr 28 22:03:42 devstack sudo[84689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:03:42 devstack sudo[84643]: pam_unix(sudo:session): session closed for user root
Apr 28 22:03:42 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-7652af2f-a196-442b-b26d-5627d4f69902 req-56a5ba18-56c8-4786-87f9-39108f9756bc tempest-VolumesSnapshotsTestJSON-48231436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4" returned: 0 in 1.393s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:03:42 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-7652af2f-a196-442b-b26d-5627d4f69902 req-56a5ba18-56c8-4786-87f9-39108f9756bc tempest-VolumesSnapshotsTestJSON-48231436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:03:42 devstack sudo[84699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4
Apr 28 22:03:42 devstack sudo[84699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:03:42 devstack sudo[84641]: pam_unix(sudo:session): session closed for user root
Apr 28 22:03:42 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-eb37a9a2-58c9-47dc-bad1-862f7554579d tempest-VolumesAdminNegativeTest-1452946245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9312d68d-f454-4eed-bd16-04200c66cf5c" returned: 0 in 1.765s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:03:42 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-eb37a9a2-58c9-47dc-bad1-862f7554579d tempest-VolumesAdminNegativeTest-1452946245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9312d68d-f454-4eed-bd16-04200c66cf5c {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:03:42 devstack sudo[84701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9312d68d-f454-4eed-bd16-04200c66cf5c
Apr 28 22:03:42 devstack sudo[84701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:03:43 devstack sudo[84689]: pam_unix(sudo:session): session closed for user root
Apr 28 22:03:43 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c5c256a6-6b5a-4a87-8145-f7426dad355c tempest-VolumesTestJSON-1789549530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-27d74a55-c669-4a4e-88f4-89670e08d739" returned: 0 in 1.053s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:03:43 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c5c256a6-6b5a-4a87-8145-f7426dad355c tempest-VolumesTestJSON-1789549530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-27d74a55-c669-4a4e-88f4-89670e08d739 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:03:43 devstack sudo[84707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-27d74a55-c669-4a4e-88f4-89670e08d739
Apr 28 22:03:43 devstack sudo[84707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:03:43 devstack sudo[84701]: pam_unix(sudo:session): session closed for user root
Apr 28 22:03:43 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-eb37a9a2-58c9-47dc-bad1-862f7554579d tempest-VolumesAdminNegativeTest-1452946245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9312d68d-f454-4eed-bd16-04200c66cf5c" returned: 0 in 0.782s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:03:43 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-eb37a9a2-58c9-47dc-bad1-862f7554579d tempest-VolumesAdminNegativeTest-1452946245 None] Lock "cinder-quobyte-9312d68d-f454-4eed-bd16-04200c66cf5c" released by "delete_volume" :: held 2.651s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:03:43 devstack sudo[84699]: pam_unix(sudo:session): session closed for user root
Apr 28 22:03:43 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-7652af2f-a196-442b-b26d-5627d4f69902 req-56a5ba18-56c8-4786-87f9-39108f9756bc tempest-VolumesSnapshotsTestJSON-48231436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4" returned: 0 in 0.934s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:03:43 devstack cinder-volume[83924]: DEBUG cinder.coordination [req-7652af2f-a196-442b-b26d-5627d4f69902 req-56a5ba18-56c8-4786-87f9-39108f9756bc tempest-VolumesSnapshotsTestJSON-48231436 None] Lock "cinder-quobyte-eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4" released by "delete_volume" :: held 2.436s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:03:43 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-eb37a9a2-58c9-47dc-bad1-862f7554579d tempest-VolumesAdminNegativeTest-1452946245 None] Created reservations ['3dcd47aa-d63d-4e85-a34c-011cc18030ba', '96bb9b34-d450-4666-b657-aa84523f7dd9', '66cc9b4e-70ed-4030-b670-29f775b3c169', '140a9601-c441-472b-a8e2-704b03a8640a'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:03:43 devstack cinder-volume[83924]: DEBUG cinder.quota [req-7652af2f-a196-442b-b26d-5627d4f69902 req-56a5ba18-56c8-4786-87f9-39108f9756bc tempest-VolumesSnapshotsTestJSON-48231436 None] Created reservations ['edc404ed-a092-4a7d-bdd0-7abe097e9fc6', '101b85d0-21a0-4a1a-9b28-aefb5ad0bb84', 'bfcdd1e7-b3c7-45bb-92e6-112d5cb84afc', 'b6974237-083f-4954-97e2-09cc8a93eac1'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:03:43 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-eb37a9a2-58c9-47dc-bad1-862f7554579d tempest-VolumesAdminNegativeTest-1452946245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:03:43 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-eb37a9a2-58c9-47dc-bad1-862f7554579d tempest-VolumesAdminNegativeTest-1452946245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:03:43 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-eb37a9a2-58c9-47dc-bad1-862f7554579d tempest-VolumesAdminNegativeTest-1452946245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:03:43 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-eb37a9a2-58c9-47dc-bad1-862f7554579d tempest-VolumesAdminNegativeTest-1452946245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:03:43 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-eb37a9a2-58c9-47dc-bad1-862f7554579d tempest-VolumesAdminNegativeTest-1452946245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:03:43 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-eb37a9a2-58c9-47dc-bad1-862f7554579d tempest-VolumesAdminNegativeTest-1452946245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:03:43 devstack sudo[84711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:03:43 devstack sudo[84711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:03:43 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [req-7652af2f-a196-442b-b26d-5627d4f69902 req-56a5ba18-56c8-4786-87f9-39108f9756bc tempest-VolumesSnapshotsTestJSON-48231436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:03:43 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [req-7652af2f-a196-442b-b26d-5627d4f69902 req-56a5ba18-56c8-4786-87f9-39108f9756bc tempest-VolumesSnapshotsTestJSON-48231436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:03:43 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [req-7652af2f-a196-442b-b26d-5627d4f69902 req-56a5ba18-56c8-4786-87f9-39108f9756bc tempest-VolumesSnapshotsTestJSON-48231436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:03:43 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [req-7652af2f-a196-442b-b26d-5627d4f69902 req-56a5ba18-56c8-4786-87f9-39108f9756bc tempest-VolumesSnapshotsTestJSON-48231436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:03:43 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [req-7652af2f-a196-442b-b26d-5627d4f69902 req-56a5ba18-56c8-4786-87f9-39108f9756bc tempest-VolumesSnapshotsTestJSON-48231436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:03:43 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-7652af2f-a196-442b-b26d-5627d4f69902 req-56a5ba18-56c8-4786-87f9-39108f9756bc tempest-VolumesSnapshotsTestJSON-48231436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:03:43 devstack sudo[84714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:03:43 devstack sudo[84714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:03:43 devstack sudo[84707]: pam_unix(sudo:session): session closed for user root
Apr 28 22:03:43 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c5c256a6-6b5a-4a87-8145-f7426dad355c tempest-VolumesTestJSON-1789549530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-27d74a55-c669-4a4e-88f4-89670e08d739" returned: 0 in 0.724s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:03:43 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-c5c256a6-6b5a-4a87-8145-f7426dad355c tempest-VolumesTestJSON-1789549530 None] Lock "cinder-quobyte-27d74a55-c669-4a4e-88f4-89670e08d739" released by "delete_volume" :: held 1.870s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:03:44 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-c5c256a6-6b5a-4a87-8145-f7426dad355c tempest-VolumesTestJSON-1789549530 None] Created reservations ['f2d58489-925a-4c32-a5a1-739ec6d45ab7', '15437d21-74e1-4ef3-aad6-86ffc660ba04', '4eced245-9364-445d-b0e8-dd863684c1f7', 'bdc760ce-cab0-490b-9fed-64a3464ff492'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:03:44 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-c5c256a6-6b5a-4a87-8145-f7426dad355c tempest-VolumesTestJSON-1789549530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:03:44 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-c5c256a6-6b5a-4a87-8145-f7426dad355c tempest-VolumesTestJSON-1789549530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:03:44 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-c5c256a6-6b5a-4a87-8145-f7426dad355c tempest-VolumesTestJSON-1789549530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:03:44 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-c5c256a6-6b5a-4a87-8145-f7426dad355c tempest-VolumesTestJSON-1789549530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:03:44 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-c5c256a6-6b5a-4a87-8145-f7426dad355c tempest-VolumesTestJSON-1789549530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:03:44 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c5c256a6-6b5a-4a87-8145-f7426dad355c tempest-VolumesTestJSON-1789549530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:03:44 devstack sudo[84716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:03:44 devstack sudo[84716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:03:44 devstack sudo[84711]: pam_unix(sudo:session): session closed for user root
Apr 28 22:03:44 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-eb37a9a2-58c9-47dc-bad1-862f7554579d tempest-VolumesAdminNegativeTest-1452946245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.789s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:03:44 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-eb37a9a2-58c9-47dc-bad1-862f7554579d tempest-VolumesAdminNegativeTest-1452946245 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:03:44 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-eb37a9a2-58c9-47dc-bad1-862f7554579d tempest-VolumesAdminNegativeTest-1452946245 None] Deleted volume successfully.
Apr 28 22:03:44 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-eb37a9a2-58c9-47dc-bad1-862f7554579d tempest-VolumesAdminNegativeTest-1452946245 None] Lock "cinder-9312d68d-f454-4eed-bd16-04200c66cf5c-delete_volume" released by "delete_volume" :: held 3.946s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:03:44 devstack sudo[84714]: pam_unix(sudo:session): session closed for user root
Apr 28 22:03:44 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-7652af2f-a196-442b-b26d-5627d4f69902 req-56a5ba18-56c8-4786-87f9-39108f9756bc tempest-VolumesSnapshotsTestJSON-48231436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 1.080s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:03:44 devstack cinder-volume[83924]: DEBUG cinder.manager [req-7652af2f-a196-442b-b26d-5627d4f69902 req-56a5ba18-56c8-4786-87f9-39108f9756bc tempest-VolumesSnapshotsTestJSON-48231436 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:03:44 devstack cinder-volume[83924]: INFO cinder.volume.manager [req-7652af2f-a196-442b-b26d-5627d4f69902 req-56a5ba18-56c8-4786-87f9-39108f9756bc tempest-VolumesSnapshotsTestJSON-48231436 None] Deleted volume successfully.
Apr 28 22:03:44 devstack cinder-volume[83924]: DEBUG cinder.coordination [req-7652af2f-a196-442b-b26d-5627d4f69902 req-56a5ba18-56c8-4786-87f9-39108f9756bc tempest-VolumesSnapshotsTestJSON-48231436 None] Lock "cinder-eefd8a5f-4db4-4b41-af6c-2eb475cd6cd4-delete_volume" released by "delete_volume" :: held 4.030s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:03:45 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-2b297fa1-08c4-4191-b0cd-7e6ea2a332e3 tempest-VolumesTestJSON-1789549530 None] Acquiring lock "cinder-fea0507f-b3e9-4c03-a55b-df74100768dc-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:03:45 devstack sudo[84716]: pam_unix(sudo:session): session closed for user root
Apr 28 22:03:45 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c5c256a6-6b5a-4a87-8145-f7426dad355c tempest-VolumesTestJSON-1789549530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 1.066s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:03:45 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-c5c256a6-6b5a-4a87-8145-f7426dad355c tempest-VolumesTestJSON-1789549530 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:03:45 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-c5c256a6-6b5a-4a87-8145-f7426dad355c tempest-VolumesTestJSON-1789549530 None] Deleted volume successfully.
Apr 28 22:03:45 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-2b297fa1-08c4-4191-b0cd-7e6ea2a332e3 tempest-VolumesTestJSON-1789549530 None] Lock "cinder-fea0507f-b3e9-4c03-a55b-df74100768dc-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:03:45 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-c5c256a6-6b5a-4a87-8145-f7426dad355c tempest-VolumesTestJSON-1789549530 None] Lock "cinder-27d74a55-c669-4a4e-88f4-89670e08d739-delete_volume" released by "delete_volume" :: held 3.516s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:03:45 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-2b297fa1-08c4-4191-b0cd-7e6ea2a332e3 tempest-VolumesTestJSON-1789549530 None] Acquiring lock "cinder-quobyte-fea0507f-b3e9-4c03-a55b-df74100768dc" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:03:45 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-2b297fa1-08c4-4191-b0cd-7e6ea2a332e3 tempest-VolumesTestJSON-1789549530 None] Lock "cinder-quobyte-fea0507f-b3e9-4c03-a55b-df74100768dc" acquired by "delete_volume" :: waited 0.031s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:03:45 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9621ac-b38d-4dc0-b008-a08be3c00f3e]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:03:45 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-2b297fa1-08c4-4191-b0cd-7e6ea2a332e3 tempest-VolumesTestJSON-1789549530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-fea0507f-b3e9-4c03-a55b-df74100768dc {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:03:45 devstack sudo[84731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-fea0507f-b3e9-4c03-a55b-df74100768dc
Apr 28 22:03:45 devstack sudo[84731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:03:46 devstack sudo[84731]: pam_unix(sudo:session): session closed for user root
Apr 28 22:03:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-2b297fa1-08c4-4191-b0cd-7e6ea2a332e3 tempest-VolumesTestJSON-1789549530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-fea0507f-b3e9-4c03-a55b-df74100768dc" returned: 0 in 1.190s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:03:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-2b297fa1-08c4-4191-b0cd-7e6ea2a332e3 tempest-VolumesTestJSON-1789549530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-fea0507f-b3e9-4c03-a55b-df74100768dc {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:03:46 devstack sudo[84776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-fea0507f-b3e9-4c03-a55b-df74100768dc
Apr 28 22:03:46 devstack sudo[84776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:03:47 devstack sudo[84776]: pam_unix(sudo:session): session closed for user root
Apr 28 22:03:47 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-2b297fa1-08c4-4191-b0cd-7e6ea2a332e3 tempest-VolumesTestJSON-1789549530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-fea0507f-b3e9-4c03-a55b-df74100768dc" returned: 0 in 0.726s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:03:47 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-2b297fa1-08c4-4191-b0cd-7e6ea2a332e3 tempest-VolumesTestJSON-1789549530 None] Lock "cinder-quobyte-fea0507f-b3e9-4c03-a55b-df74100768dc" released by "delete_volume" :: held 1.998s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:03:47 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-2b297fa1-08c4-4191-b0cd-7e6ea2a332e3 tempest-VolumesTestJSON-1789549530 None] Created reservations ['ccb2d10a-50ea-48d7-a8f0-10f4fd54bd1e', '5942c1cc-8b88-4489-a425-294a28ba446a', '56ef3976-29ca-4801-b961-3532434ec3fb', '143f416d-b59b-4473-921b-a249d11db236'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:03:47 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-2b297fa1-08c4-4191-b0cd-7e6ea2a332e3 tempest-VolumesTestJSON-1789549530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:03:47 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-2b297fa1-08c4-4191-b0cd-7e6ea2a332e3 tempest-VolumesTestJSON-1789549530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:03:47 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-2b297fa1-08c4-4191-b0cd-7e6ea2a332e3 tempest-VolumesTestJSON-1789549530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:03:47 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-2b297fa1-08c4-4191-b0cd-7e6ea2a332e3 tempest-VolumesTestJSON-1789549530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:03:47 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-2b297fa1-08c4-4191-b0cd-7e6ea2a332e3 tempest-VolumesTestJSON-1789549530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:03:47 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-2b297fa1-08c4-4191-b0cd-7e6ea2a332e3 tempest-VolumesTestJSON-1789549530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:03:47 devstack sudo[84780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:03:47 devstack sudo[84780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:03:48 devstack sudo[84780]: pam_unix(sudo:session): session closed for user root
Apr 28 22:03:48 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-2b297fa1-08c4-4191-b0cd-7e6ea2a332e3 tempest-VolumesTestJSON-1789549530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.877s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:03:48 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-2b297fa1-08c4-4191-b0cd-7e6ea2a332e3 tempest-VolumesTestJSON-1789549530 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:03:48 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-2b297fa1-08c4-4191-b0cd-7e6ea2a332e3 tempest-VolumesTestJSON-1789549530 None] Deleted volume successfully.
Apr 28 22:03:48 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-2b297fa1-08c4-4191-b0cd-7e6ea2a332e3 tempest-VolumesTestJSON-1789549530 None] Lock "cinder-fea0507f-b3e9-4c03-a55b-df74100768dc-delete_volume" released by "delete_volume" :: held 3.316s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:03:55 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-58b51b47-14ff-41b3-afe9-2e8fe05c4e40 tempest-BackendsCapabilitiesAdminTestsJSON-1811825432 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5839881896973, 'free_capacity_gb': 1775.5839881896973, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83924) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 28 22:03:55 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-43e15f6a-527b-4196-9fd5-92eebd82b5a5 tempest-BackendsCapabilitiesAdminTestsJSON-1811825432 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5839881896973, 'free_capacity_gb': 1775.5839881896973, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83924) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 28 22:03:55 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-abee71e0-06ba-4ef7-a9d8-d202ba011896 tempest-GroupsTest-1275307344 None] Group tempest-Group1-604789294: creating
Apr 28 22:03:55 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-abee71e0-06ba-4ef7-a9d8-d202ba011896 tempest-GroupsTest-1275307344 None] Group tempest-Group1-604789294: created successfully
Apr 28 22:03:55 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-abee71e0-06ba-4ef7-a9d8-d202ba011896 tempest-GroupsTest-1275307344 None] Create group completed successfully.
Apr 28 22:03:57 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-a17c27b1-7b8b-406f-8fae-43f47288fc2b tempest-GroupsTest-1275307344 None] Group tempest-Group2-1301567558: creating
Apr 28 22:03:57 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-a17c27b1-7b8b-406f-8fae-43f47288fc2b tempest-GroupsTest-1275307344 None] Group tempest-Group2-1301567558: created successfully
Apr 28 22:03:57 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-a17c27b1-7b8b-406f-8fae-43f47288fc2b tempest-GroupsTest-1275307344 None] Create group completed successfully.
Apr 28 22:03:59 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6db3189-c367-4560-9e68-9e2ed40af1d8 tempest-GroupsTest-1275307344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:03:59 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f6db3189-c367-4560-9e68-9e2ed40af1d8 tempest-GroupsTest-1275307344 None] Flow 'volume_create_manager' (8b1d7d40-1710-4be2-8217-252cecfcddbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:03:59 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f6db3189-c367-4560-9e68-9e2ed40af1d8 tempest-GroupsTest-1275307344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05f9ecec-e7f5-4cf3-af8b-c4b908c8e2ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:03:59 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f6db3189-c367-4560-9e68-9e2ed40af1d8 tempest-GroupsTest-1275307344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05f9ecec-e7f5-4cf3-af8b-c4b908c8e2ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:03:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1318950981',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b608123f-3b6d-41a3-8fd7-58307ac40708,host='devstack@QuobyteHD#QuobyteHD',id=0f9b8a04-6c40-43de-aa94-5d648a246420,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcc4ccf6c1cf4c0d9244decb56b34fd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:03:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:03:59Z,use_quota=True,user_id='9da56184b2e348e8aa0b6991c57fb394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bf75713-af75-430a-9bc5-b614f7f375dc),volume_type_id=9bf75713-af75-430a-9bc5-b614f7f375dc)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:03:59 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f6db3189-c367-4560-9e68-9e2ed40af1d8 tempest-GroupsTest-1275307344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de298409-00db-4184-b6bd-e79b065f3fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:03:59 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f6db3189-c367-4560-9e68-9e2ed40af1d8 tempest-GroupsTest-1275307344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de298409-00db-4184-b6bd-e79b065f3fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:03:59 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f6db3189-c367-4560-9e68-9e2ed40af1d8 tempest-GroupsTest-1275307344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0ac7972-4fdc-428f-9d2a-9933a3ff110f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:03:59 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f6db3189-c367-4560-9e68-9e2ed40af1d8 tempest-GroupsTest-1275307344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0ac7972-4fdc-428f-9d2a-9933a3ff110f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f9b8a04-6c40-43de-aa94-5d648a246420', 'volume_name': 'volume-0f9b8a04-6c40-43de-aa94-5d648a246420', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:03:59 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f6db3189-c367-4560-9e68-9e2ed40af1d8 tempest-GroupsTest-1275307344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a71fbe06-a66e-4dee-b0fb-ba3c561b9dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:03:59 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f6db3189-c367-4560-9e68-9e2ed40af1d8 tempest-GroupsTest-1275307344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a71fbe06-a66e-4dee-b0fb-ba3c561b9dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:03:59 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f6db3189-c367-4560-9e68-9e2ed40af1d8 tempest-GroupsTest-1275307344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c05671c1-d6b5-4260-bfbd-fc91d8159d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:03:59 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-f6db3189-c367-4560-9e68-9e2ed40af1d8 tempest-GroupsTest-1275307344 None] Volume 0f9b8a04-6c40-43de-aa94-5d648a246420: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f9b8a04-6c40-43de-aa94-5d648a246420', 'volume_size': 1}
Apr 28 22:03:59 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f6db3189-c367-4560-9e68-9e2ed40af1d8 tempest-GroupsTest-1275307344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:03:59 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f6db3189-c367-4560-9e68-9e2ed40af1d8 tempest-GroupsTest-1275307344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:03:59 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-f6db3189-c367-4560-9e68-9e2ed40af1d8 tempest-GroupsTest-1275307344 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=b608123f-3b6d-41a3-8fd7-58307ac40708,created_at=2026-04-28T20:03:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1318950981',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b608123f-3b6d-41a3-8fd7-58307ac40708,host='devstack@QuobyteHD#QuobyteHD',id=0f9b8a04-6c40-43de-aa94-5d648a246420,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcc4ccf6c1cf4c0d9244decb56b34fd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:03:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:03:59Z,use_quota=True,user_id='9da56184b2e348e8aa0b6991c57fb394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bf75713-af75-430a-9bc5-b614f7f375dc),volume_type_id=9bf75713-af75-430a-9bc5-b614f7f375dc)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:03:59 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-f6db3189-c367-4560-9e68-9e2ed40af1d8 tempest-GroupsTest-1275307344 None] Creating volume 0f9b8a04-6c40-43de-aa94-5d648a246420 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:03:59 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f6db3189-c367-4560-9e68-9e2ed40af1d8 tempest-GroupsTest-1275307344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:03:59 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f6db3189-c367-4560-9e68-9e2ed40af1d8 tempest-GroupsTest-1275307344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:03:59 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-f6db3189-c367-4560-9e68-9e2ed40af1d8 tempest-GroupsTest-1275307344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:03:59 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-f6db3189-c367-4560-9e68-9e2ed40af1d8 tempest-GroupsTest-1275307344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:03:59 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f6db3189-c367-4560-9e68-9e2ed40af1d8 tempest-GroupsTest-1275307344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:03:59 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-f6db3189-c367-4560-9e68-9e2ed40af1d8 tempest-GroupsTest-1275307344 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:03:59 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-f6db3189-c367-4560-9e68-9e2ed40af1d8 tempest-GroupsTest-1275307344 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:03:59 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f6db3189-c367-4560-9e68-9e2ed40af1d8 tempest-GroupsTest-1275307344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-0f9b8a04-6c40-43de-aa94-5d648a246420 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:03:59 devstack sudo[84870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-0f9b8a04-6c40-43de-aa94-5d648a246420 1073741824
Apr 28 22:03:59 devstack sudo[84870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:04:00 devstack sudo[84870]: pam_unix(sudo:session): session closed for user root
Apr 28 22:04:00 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f6db3189-c367-4560-9e68-9e2ed40af1d8 tempest-GroupsTest-1275307344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-0f9b8a04-6c40-43de-aa94-5d648a246420 1073741824" returned: 0 in 1.597s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:04:00 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f6db3189-c367-4560-9e68-9e2ed40af1d8 tempest-GroupsTest-1275307344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-0f9b8a04-6c40-43de-aa94-5d648a246420 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:04:00 devstack sudo[84884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-0f9b8a04-6c40-43de-aa94-5d648a246420
Apr 28 22:04:00 devstack sudo[84884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:04:01 devstack sudo[84884]: pam_unix(sudo:session): session closed for user root
Apr 28 22:04:01 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f6db3189-c367-4560-9e68-9e2ed40af1d8 tempest-GroupsTest-1275307344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-0f9b8a04-6c40-43de-aa94-5d648a246420" returned: 0 in 1.053s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:04:01 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-f6db3189-c367-4560-9e68-9e2ed40af1d8 tempest-GroupsTest-1275307344 None] <== create_volume: return (2726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:04:01 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f6db3189-c367-4560-9e68-9e2ed40af1d8 tempest-GroupsTest-1275307344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.730s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:04:01 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f6db3189-c367-4560-9e68-9e2ed40af1d8 tempest-GroupsTest-1275307344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c05671c1-d6b5-4260-bfbd-fc91d8159d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f9b8a04-6c40-43de-aa94-5d648a246420', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:04:01 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f6db3189-c367-4560-9e68-9e2ed40af1d8 tempest-GroupsTest-1275307344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d3f0daa-d97d-4b18-8184-5d9e074c228f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:04:01 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-f6db3189-c367-4560-9e68-9e2ed40af1d8 tempest-GroupsTest-1275307344 None] Volume volume-0f9b8a04-6c40-43de-aa94-5d648a246420 (0f9b8a04-6c40-43de-aa94-5d648a246420): created successfully
Apr 28 22:04:01 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f6db3189-c367-4560-9e68-9e2ed40af1d8 tempest-GroupsTest-1275307344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d3f0daa-d97d-4b18-8184-5d9e074c228f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:04:02 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f6db3189-c367-4560-9e68-9e2ed40af1d8 tempest-GroupsTest-1275307344 None] Flow 'volume_create_manager' (8b1d7d40-1710-4be2-8217-252cecfcddbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:04:02 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-f6db3189-c367-4560-9e68-9e2ed40af1d8 tempest-GroupsTest-1275307344 None] Created volume successfully.
Apr 28 22:04:03 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d530f0d-146d-42a2-a283-fb8db450145e tempest-DeleteServersTestJSON-1890352589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:04:03 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-6d530f0d-146d-42a2-a283-fb8db450145e tempest-DeleteServersTestJSON-1890352589 None] Flow 'volume_create_manager' (3934bd6c-efb6-464c-ba85-bf88313f6dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:04:03 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-6d530f0d-146d-42a2-a283-fb8db450145e tempest-DeleteServersTestJSON-1890352589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e269545f-dc53-4584-b993-7a04ad1dd715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:04:03 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-6d530f0d-146d-42a2-a283-fb8db450145e tempest-DeleteServersTestJSON-1890352589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e269545f-dc53-4584-b993-7a04ad1dd715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:04:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1546369456',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e011d270-7828-4df0-9f95-01344b9a4aa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='763eb5ae8d3040efbe15b3bc08e97a59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:04:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:04:03Z,use_quota=True,user_id='44ceb7c3880d4a488b16f45548b97f48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:04:03 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-6d530f0d-146d-42a2-a283-fb8db450145e tempest-DeleteServersTestJSON-1890352589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dd5e661-569d-4718-9c79-60a458e832ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:04:03 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-6d530f0d-146d-42a2-a283-fb8db450145e tempest-DeleteServersTestJSON-1890352589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dd5e661-569d-4718-9c79-60a458e832ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:04:03 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-6d530f0d-146d-42a2-a283-fb8db450145e tempest-DeleteServersTestJSON-1890352589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef3981ac-42e9-4d3d-901c-f5cdceaef722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:04:03 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-6d530f0d-146d-42a2-a283-fb8db450145e tempest-DeleteServersTestJSON-1890352589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef3981ac-42e9-4d3d-901c-f5cdceaef722) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e011d270-7828-4df0-9f95-01344b9a4aa5', 'volume_name': 'volume-e011d270-7828-4df0-9f95-01344b9a4aa5', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:04:03 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-6d530f0d-146d-42a2-a283-fb8db450145e tempest-DeleteServersTestJSON-1890352589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9cc2fa0-ad17-4f2a-80f1-0b9bab5be851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:04:03 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-6d530f0d-146d-42a2-a283-fb8db450145e tempest-DeleteServersTestJSON-1890352589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9cc2fa0-ad17-4f2a-80f1-0b9bab5be851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:04:03 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-6d530f0d-146d-42a2-a283-fb8db450145e tempest-DeleteServersTestJSON-1890352589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4c038f4-e3af-45a9-bca4-6aa4caa74235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:04:03 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-6d530f0d-146d-42a2-a283-fb8db450145e tempest-DeleteServersTestJSON-1890352589 None] Volume e011d270-7828-4df0-9f95-01344b9a4aa5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e011d270-7828-4df0-9f95-01344b9a4aa5', 'volume_size': 1}
Apr 28 22:04:03 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-6d530f0d-146d-42a2-a283-fb8db450145e tempest-DeleteServersTestJSON-1890352589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:04:03 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-6d530f0d-146d-42a2-a283-fb8db450145e tempest-DeleteServersTestJSON-1890352589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:04:03 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-6d530f0d-146d-42a2-a283-fb8db450145e tempest-DeleteServersTestJSON-1890352589 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:04:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1546369456',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e011d270-7828-4df0-9f95-01344b9a4aa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='763eb5ae8d3040efbe15b3bc08e97a59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:04:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:04:03Z,use_quota=True,user_id='44ceb7c3880d4a488b16f45548b97f48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:04:03 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-6d530f0d-146d-42a2-a283-fb8db450145e tempest-DeleteServersTestJSON-1890352589 None] Creating volume e011d270-7828-4df0-9f95-01344b9a4aa5 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:04:03 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-6d530f0d-146d-42a2-a283-fb8db450145e tempest-DeleteServersTestJSON-1890352589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:04:03 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-6d530f0d-146d-42a2-a283-fb8db450145e tempest-DeleteServersTestJSON-1890352589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:04:03 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-6d530f0d-146d-42a2-a283-fb8db450145e tempest-DeleteServersTestJSON-1890352589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:04:03 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-6d530f0d-146d-42a2-a283-fb8db450145e tempest-DeleteServersTestJSON-1890352589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:04:03 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-6d530f0d-146d-42a2-a283-fb8db450145e tempest-DeleteServersTestJSON-1890352589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:04:03 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-6d530f0d-146d-42a2-a283-fb8db450145e tempest-DeleteServersTestJSON-1890352589 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:04:03 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-6d530f0d-146d-42a2-a283-fb8db450145e tempest-DeleteServersTestJSON-1890352589 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:04:03 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-6d530f0d-146d-42a2-a283-fb8db450145e tempest-DeleteServersTestJSON-1890352589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-e011d270-7828-4df0-9f95-01344b9a4aa5 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:04:03 devstack sudo[84888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-e011d270-7828-4df0-9f95-01344b9a4aa5 1073741824
Apr 28 22:04:03 devstack sudo[84888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:04:03 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-d37760a7-d446-4edf-9e8e-f0be5d3a031d tempest-GroupsTest-1275307344 None] Acquiring lock "cinder-quobyte-0f9b8a04-6c40-43de-aa94-5d648a246420" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:04:03 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-d37760a7-d446-4edf-9e8e-f0be5d3a031d tempest-GroupsTest-1275307344 None] Lock "cinder-quobyte-0f9b8a04-6c40-43de-aa94-5d648a246420" acquired by "delete_volume" :: waited 0.042s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:04:04 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d15d233-79a0-4fca-b837-833558f68348]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:04:04 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-d37760a7-d446-4edf-9e8e-f0be5d3a031d tempest-GroupsTest-1275307344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-0f9b8a04-6c40-43de-aa94-5d648a246420 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:04:04 devstack sudo[84890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-0f9b8a04-6c40-43de-aa94-5d648a246420
Apr 28 22:04:04 devstack sudo[84890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:04:04 devstack sudo[84888]: pam_unix(sudo:session): session closed for user root
Apr 28 22:04:04 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-6d530f0d-146d-42a2-a283-fb8db450145e tempest-DeleteServersTestJSON-1890352589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-e011d270-7828-4df0-9f95-01344b9a4aa5 1073741824" returned: 0 in 1.510s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:04:04 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-6d530f0d-146d-42a2-a283-fb8db450145e tempest-DeleteServersTestJSON-1890352589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-e011d270-7828-4df0-9f95-01344b9a4aa5 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:04:04 devstack sudo[84901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-e011d270-7828-4df0-9f95-01344b9a4aa5
Apr 28 22:04:04 devstack sudo[84901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:04:05 devstack sudo[84890]: pam_unix(sudo:session): session closed for user root
Apr 28 22:04:05 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-d37760a7-d446-4edf-9e8e-f0be5d3a031d tempest-GroupsTest-1275307344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-0f9b8a04-6c40-43de-aa94-5d648a246420" returned: 0 in 1.098s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:04:05 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-d37760a7-d446-4edf-9e8e-f0be5d3a031d tempest-GroupsTest-1275307344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-0f9b8a04-6c40-43de-aa94-5d648a246420 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:04:05 devstack sudo[84904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-0f9b8a04-6c40-43de-aa94-5d648a246420
Apr 28 22:04:05 devstack sudo[84904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:04:05 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-bd74b9c8-6515-4d50-994d-54dd526e97df tempest-GroupSnapshotsV319Test-2094907535 None] Group tempest-GroupSnapshotsV319Test-Group-268149172: creating
Apr 28 22:04:05 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-bd74b9c8-6515-4d50-994d-54dd526e97df tempest-GroupSnapshotsV319Test-2094907535 None] Group tempest-GroupSnapshotsV319Test-Group-268149172: created successfully
Apr 28 22:04:05 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-bd74b9c8-6515-4d50-994d-54dd526e97df tempest-GroupSnapshotsV319Test-2094907535 None] Create group completed successfully.
Apr 28 22:04:06 devstack sudo[84904]: pam_unix(sudo:session): session closed for user root
Apr 28 22:04:06 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-d37760a7-d446-4edf-9e8e-f0be5d3a031d tempest-GroupsTest-1275307344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-0f9b8a04-6c40-43de-aa94-5d648a246420" returned: 0 in 0.912s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:04:06 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-d37760a7-d446-4edf-9e8e-f0be5d3a031d tempest-GroupsTest-1275307344 None] Lock "cinder-quobyte-0f9b8a04-6c40-43de-aa94-5d648a246420" released by "delete_volume" :: held 2.086s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:04:06 devstack sudo[84901]: pam_unix(sudo:session): session closed for user root
Apr 28 22:04:06 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-6d530f0d-146d-42a2-a283-fb8db450145e tempest-DeleteServersTestJSON-1890352589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-e011d270-7828-4df0-9f95-01344b9a4aa5" returned: 0 in 1.154s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:04:06 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-6d530f0d-146d-42a2-a283-fb8db450145e tempest-DeleteServersTestJSON-1890352589 None] <== create_volume: return (2758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:04:06 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-6d530f0d-146d-42a2-a283-fb8db450145e tempest-DeleteServersTestJSON-1890352589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.760s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:04:06 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-6d530f0d-146d-42a2-a283-fb8db450145e tempest-DeleteServersTestJSON-1890352589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4c038f4-e3af-45a9-bca4-6aa4caa74235) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e011d270-7828-4df0-9f95-01344b9a4aa5', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:04:06 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-6d530f0d-146d-42a2-a283-fb8db450145e tempest-DeleteServersTestJSON-1890352589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc203f89-ed07-4363-9c0d-9b30b45c1279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:04:06 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-d37760a7-d446-4edf-9e8e-f0be5d3a031d tempest-GroupsTest-1275307344 None] Created reservations ['460328b3-979c-4e16-b611-306552bc6614'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:04:06 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-6d530f0d-146d-42a2-a283-fb8db450145e tempest-DeleteServersTestJSON-1890352589 None] Volume volume-e011d270-7828-4df0-9f95-01344b9a4aa5 (e011d270-7828-4df0-9f95-01344b9a4aa5): created successfully
Apr 28 22:04:06 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-6d530f0d-146d-42a2-a283-fb8db450145e tempest-DeleteServersTestJSON-1890352589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc203f89-ed07-4363-9c0d-9b30b45c1279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:04:06 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-6d530f0d-146d-42a2-a283-fb8db450145e tempest-DeleteServersTestJSON-1890352589 None] Flow 'volume_create_manager' (3934bd6c-efb6-464c-ba85-bf88313f6dc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:04:06 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-6d530f0d-146d-42a2-a283-fb8db450145e tempest-DeleteServersTestJSON-1890352589 None] Created volume successfully.
Apr 28 22:04:06 devstack cinder-volume[83924]: WARNING cinder.quota [None req-d37760a7-d446-4edf-9e8e-f0be5d3a031d tempest-GroupsTest-1275307344 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-929703856 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-929703856, it is now deprecated. Please use the default quota class for default quota.
Apr 28 22:04:06 devstack cinder-volume[83924]: WARNING cinder.quota [None req-d37760a7-d446-4edf-9e8e-f0be5d3a031d tempest-GroupsTest-1275307344 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-929703856 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-929703856, it is now deprecated. Please use the default quota class for default quota.
Apr 28 22:04:06 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-d37760a7-d446-4edf-9e8e-f0be5d3a031d tempest-GroupsTest-1275307344 None] Created reservations ['b13d2de0-2dcb-4065-a22d-381dcfbfeb31', '7fe52837-e75c-404d-a023-409e7cbc7474', '5005924a-1167-446f-a634-86d4b5c35931', '254eb084-006e-4f96-9c2f-8e1eab89bb59'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:04:06 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-d37760a7-d446-4edf-9e8e-f0be5d3a031d tempest-GroupsTest-1275307344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:04:06 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-d37760a7-d446-4edf-9e8e-f0be5d3a031d tempest-GroupsTest-1275307344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:04:06 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-d37760a7-d446-4edf-9e8e-f0be5d3a031d tempest-GroupsTest-1275307344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:04:06 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-d37760a7-d446-4edf-9e8e-f0be5d3a031d tempest-GroupsTest-1275307344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:04:06 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-d37760a7-d446-4edf-9e8e-f0be5d3a031d tempest-GroupsTest-1275307344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:04:06 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-d37760a7-d446-4edf-9e8e-f0be5d3a031d tempest-GroupsTest-1275307344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:04:06 devstack sudo[84908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:04:06 devstack sudo[84908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:04:07 devstack sudo[84908]: pam_unix(sudo:session): session closed for user root
Apr 28 22:04:07 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-d37760a7-d446-4edf-9e8e-f0be5d3a031d tempest-GroupsTest-1275307344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.766s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:04:07 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-d37760a7-d446-4edf-9e8e-f0be5d3a031d tempest-GroupsTest-1275307344 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:04:07 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-d37760a7-d446-4edf-9e8e-f0be5d3a031d tempest-GroupsTest-1275307344 None] Delete group completed successfully.
Apr 28 22:04:07 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ae6373e-e04c-4879-8488-4fec4144117a tempest-GroupSnapshotsV319Test-2094907535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:04:07 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-1ae6373e-e04c-4879-8488-4fec4144117a tempest-GroupSnapshotsV319Test-2094907535 None] Flow 'volume_create_manager' (35c0aa5c-925e-41db-b3bc-5e34f9f1e920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:04:07 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-1ae6373e-e04c-4879-8488-4fec4144117a tempest-GroupSnapshotsV319Test-2094907535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa1cdf39-e81c-4b0d-97ea-3c2eaa2967a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:04:07 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-1ae6373e-e04c-4879-8488-4fec4144117a tempest-GroupSnapshotsV319Test-2094907535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa1cdf39-e81c-4b0d-97ea-3c2eaa2967a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:04:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1240902883',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6c82c692-357f-44d6-97cd-9c24712336be,host='devstack@QuobyteHD#QuobyteHD',id=f75f3ebb-cd0b-4648-91cf-09292996e39b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='790ca6f7260242b597c0c3ea558edfbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:04:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:04:07Z,use_quota=True,user_id='57a18e1c2e36423d9bc6c2e12e127f5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67282c11-3599-475c-8193-4e89756e00df),volume_type_id=67282c11-3599-475c-8193-4e89756e00df)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:04:07 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-1ae6373e-e04c-4879-8488-4fec4144117a tempest-GroupSnapshotsV319Test-2094907535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bc2703c-5b47-4952-affc-8287c9be54a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:04:07 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-1ae6373e-e04c-4879-8488-4fec4144117a tempest-GroupSnapshotsV319Test-2094907535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bc2703c-5b47-4952-affc-8287c9be54a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:04:07 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-1ae6373e-e04c-4879-8488-4fec4144117a tempest-GroupSnapshotsV319Test-2094907535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a1e6844-c13e-4f9e-b0e3-5f770df65544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:04:07 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-1ae6373e-e04c-4879-8488-4fec4144117a tempest-GroupSnapshotsV319Test-2094907535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a1e6844-c13e-4f9e-b0e3-5f770df65544) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f75f3ebb-cd0b-4648-91cf-09292996e39b', 'volume_name': 'volume-f75f3ebb-cd0b-4648-91cf-09292996e39b', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:04:07 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-1ae6373e-e04c-4879-8488-4fec4144117a tempest-GroupSnapshotsV319Test-2094907535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81bb9f65-9fa3-4be8-8b04-643735160344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:04:07 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-1ae6373e-e04c-4879-8488-4fec4144117a tempest-GroupSnapshotsV319Test-2094907535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81bb9f65-9fa3-4be8-8b04-643735160344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:04:07 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-1ae6373e-e04c-4879-8488-4fec4144117a tempest-GroupSnapshotsV319Test-2094907535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (931223ab-312d-4b62-b247-cdcc51dbec7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:04:07 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-1ae6373e-e04c-4879-8488-4fec4144117a tempest-GroupSnapshotsV319Test-2094907535 None] Volume f75f3ebb-cd0b-4648-91cf-09292996e39b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f75f3ebb-cd0b-4648-91cf-09292996e39b', 'volume_size': 1}
Apr 28 22:04:07 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-1ae6373e-e04c-4879-8488-4fec4144117a tempest-GroupSnapshotsV319Test-2094907535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:04:07 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-1ae6373e-e04c-4879-8488-4fec4144117a tempest-GroupSnapshotsV319Test-2094907535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:04:07 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-1ae6373e-e04c-4879-8488-4fec4144117a tempest-GroupSnapshotsV319Test-2094907535 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=6c82c692-357f-44d6-97cd-9c24712336be,created_at=2026-04-28T20:04:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1240902883',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6c82c692-357f-44d6-97cd-9c24712336be,host='devstack@QuobyteHD#QuobyteHD',id=f75f3ebb-cd0b-4648-91cf-09292996e39b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='790ca6f7260242b597c0c3ea558edfbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:04:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:04:07Z,use_quota=True,user_id='57a18e1c2e36423d9bc6c2e12e127f5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67282c11-3599-475c-8193-4e89756e00df),volume_type_id=67282c11-3599-475c-8193-4e89756e00df)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:04:07 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-1ae6373e-e04c-4879-8488-4fec4144117a tempest-GroupSnapshotsV319Test-2094907535 None] Creating volume f75f3ebb-cd0b-4648-91cf-09292996e39b {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:04:07 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-1ae6373e-e04c-4879-8488-4fec4144117a tempest-GroupSnapshotsV319Test-2094907535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:04:07 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-1ae6373e-e04c-4879-8488-4fec4144117a tempest-GroupSnapshotsV319Test-2094907535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:04:07 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-1ae6373e-e04c-4879-8488-4fec4144117a tempest-GroupSnapshotsV319Test-2094907535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:04:07 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-1ae6373e-e04c-4879-8488-4fec4144117a tempest-GroupSnapshotsV319Test-2094907535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:04:07 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-1ae6373e-e04c-4879-8488-4fec4144117a tempest-GroupSnapshotsV319Test-2094907535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:04:07 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-1ae6373e-e04c-4879-8488-4fec4144117a tempest-GroupSnapshotsV319Test-2094907535 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:04:07 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-1ae6373e-e04c-4879-8488-4fec4144117a tempest-GroupSnapshotsV319Test-2094907535 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:04:07 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-1ae6373e-e04c-4879-8488-4fec4144117a tempest-GroupSnapshotsV319Test-2094907535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f75f3ebb-cd0b-4648-91cf-09292996e39b 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:04:07 devstack sudo[84913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f75f3ebb-cd0b-4648-91cf-09292996e39b 1073741824
Apr 28 22:04:07 devstack sudo[84913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:04:07 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-fb3c58f0-7780-49f2-9413-a06f368e06d4 tempest-GroupsTest-1275307344 None] Created reservations ['7d2cfc29-2104-4fa9-9ed8-1afff93c583f'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:04:07 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-fb3c58f0-7780-49f2-9413-a06f368e06d4 tempest-GroupsTest-1275307344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:04:07 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-fb3c58f0-7780-49f2-9413-a06f368e06d4 tempest-GroupsTest-1275307344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:04:07 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-fb3c58f0-7780-49f2-9413-a06f368e06d4 tempest-GroupsTest-1275307344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:04:07 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-fb3c58f0-7780-49f2-9413-a06f368e06d4 tempest-GroupsTest-1275307344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:04:07 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-fb3c58f0-7780-49f2-9413-a06f368e06d4 tempest-GroupsTest-1275307344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:04:07 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-fb3c58f0-7780-49f2-9413-a06f368e06d4 tempest-GroupsTest-1275307344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:04:07 devstack sudo[84915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:04:07 devstack sudo[84915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:04:08 devstack sudo[84915]: pam_unix(sudo:session): session closed for user root
Apr 28 22:04:08 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-fb3c58f0-7780-49f2-9413-a06f368e06d4 tempest-GroupsTest-1275307344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.733s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:04:08 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-fb3c58f0-7780-49f2-9413-a06f368e06d4 tempest-GroupsTest-1275307344 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:04:08 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-fb3c58f0-7780-49f2-9413-a06f368e06d4 tempest-GroupsTest-1275307344 None] Delete group completed successfully.
Apr 28 22:04:08 devstack sudo[84913]: pam_unix(sudo:session): session closed for user root
Apr 28 22:04:08 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-1ae6373e-e04c-4879-8488-4fec4144117a tempest-GroupSnapshotsV319Test-2094907535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f75f3ebb-cd0b-4648-91cf-09292996e39b 1073741824" returned: 0 in 1.008s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:04:08 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-1ae6373e-e04c-4879-8488-4fec4144117a tempest-GroupSnapshotsV319Test-2094907535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f75f3ebb-cd0b-4648-91cf-09292996e39b {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:04:08 devstack sudo[84922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f75f3ebb-cd0b-4648-91cf-09292996e39b
Apr 28 22:04:08 devstack sudo[84922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:04:09 devstack sudo[84922]: pam_unix(sudo:session): session closed for user root
Apr 28 22:04:09 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-1ae6373e-e04c-4879-8488-4fec4144117a tempest-GroupSnapshotsV319Test-2094907535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f75f3ebb-cd0b-4648-91cf-09292996e39b" returned: 0 in 1.228s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:04:09 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-1ae6373e-e04c-4879-8488-4fec4144117a tempest-GroupSnapshotsV319Test-2094907535 None] <== create_volume: return (2290ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:04:09 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-1ae6373e-e04c-4879-8488-4fec4144117a tempest-GroupSnapshotsV319Test-2094907535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.297s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:04:09 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-1ae6373e-e04c-4879-8488-4fec4144117a tempest-GroupSnapshotsV319Test-2094907535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (931223ab-312d-4b62-b247-cdcc51dbec7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f75f3ebb-cd0b-4648-91cf-09292996e39b', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:04:09 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-1ae6373e-e04c-4879-8488-4fec4144117a tempest-GroupSnapshotsV319Test-2094907535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f244380c-71f1-49f3-b997-5f75bf4143bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:04:09 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-1ae6373e-e04c-4879-8488-4fec4144117a tempest-GroupSnapshotsV319Test-2094907535 None] Volume volume-f75f3ebb-cd0b-4648-91cf-09292996e39b (f75f3ebb-cd0b-4648-91cf-09292996e39b): created successfully
Apr 28 22:04:09 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-1ae6373e-e04c-4879-8488-4fec4144117a tempest-GroupSnapshotsV319Test-2094907535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f244380c-71f1-49f3-b997-5f75bf4143bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:04:09 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-1ae6373e-e04c-4879-8488-4fec4144117a tempest-GroupSnapshotsV319Test-2094907535 None] Flow 'volume_create_manager' (35c0aa5c-925e-41db-b3bc-5e34f9f1e920) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:04:09 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-1ae6373e-e04c-4879-8488-4fec4144117a tempest-GroupSnapshotsV319Test-2094907535 None] Created volume successfully.
Apr 28 22:04:10 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-41e31266-cb67-4bdb-ba50-249fa388627f tempest-GroupsTest-1275307344 None] Group tempest-GroupsTest-Group-1717500777: creating
Apr 28 22:04:10 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-41e31266-cb67-4bdb-ba50-249fa388627f tempest-GroupsTest-1275307344 None] Group tempest-GroupsTest-Group-1717500777: created successfully
Apr 28 22:04:10 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-41e31266-cb67-4bdb-ba50-249fa388627f tempest-GroupsTest-1275307344 None] Create group completed successfully.
Apr 28 22:04:11 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-c60df49d-9f1e-4b08-abd0-1d34eb86d37c tempest-GroupSnapshotsV319Test-2094907535 None] GroupSnapshot ae41f17a-0432-471c-b424-05705fe1929c: creating.
Apr 28 22:04:11 devstack cinder-volume[83924]: DEBUG dbcounter [-] [83924] Writing DB stats cinder:SELECT=65,cinder:UPDATE=93,cinder:DELETE=9,cinder:INSERT=19 {{(pid=83924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 28 22:04:11 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-c60df49d-9f1e-4b08-abd0-1d34eb86d37c tempest-GroupSnapshotsV319Test-2094907535 None] Group snapshot ae41f17a-0432-471c-b424-05705fe1929c: creating. {{(pid=83924) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 28 22:04:11 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-c60df49d-9f1e-4b08-abd0-1d34eb86d37c tempest-GroupSnapshotsV319Test-2094907535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:04:11 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-c60df49d-9f1e-4b08-abd0-1d34eb86d37c tempest-GroupSnapshotsV319Test-2094907535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:04:11 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-c60df49d-9f1e-4b08-abd0-1d34eb86d37c tempest-GroupSnapshotsV319Test-2094907535 None] Creating offline snapshot cce66caa-a707-4f69-a878-732a4b2dd735 of volume f75f3ebb-cd0b-4648-91cf-09292996e39b {{(pid=83924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 22:04:11 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[53816834-45e2-4b2a-8d71-df973623b07b]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:04:11 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c60df49d-9f1e-4b08-abd0-1d34eb86d37c tempest-GroupSnapshotsV319Test-2094907535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f75f3ebb-cd0b-4648-91cf-09292996e39b {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:04:11 devstack sudo[84965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f75f3ebb-cd0b-4648-91cf-09292996e39b
Apr 28 22:04:11 devstack sudo[84965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:04:12 devstack cinder-volume[83924]: DEBUG dbcounter [-] [83924] Writing DB stats cinder:UPDATE=84,cinder:SELECT=80,cinder:INSERT=20,cinder:DELETE=5 {{(pid=83924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 28 22:04:12 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c41b1cd-544d-4016-89cf-1fb3845a2a18 tempest-GroupsTest-1275307344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:04:12 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-2c41b1cd-544d-4016-89cf-1fb3845a2a18 tempest-GroupsTest-1275307344 None] Flow 'volume_create_manager' (e9a42f42-201e-4d29-ae7a-80abda4fb819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:04:12 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-2c41b1cd-544d-4016-89cf-1fb3845a2a18 tempest-GroupsTest-1275307344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efe6cf82-8ecd-4672-a76a-5e0e768a29f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:04:12 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-2c41b1cd-544d-4016-89cf-1fb3845a2a18 tempest-GroupsTest-1275307344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efe6cf82-8ecd-4672-a76a-5e0e768a29f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:04:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-808616082',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=72c79378-b359-4da9-bbd4-e4a1c3fc8e38,host='devstack@QuobyteHD#QuobyteHD',id=dd01b527-dc5e-466b-bfa8-602db9b2d135,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcc4ccf6c1cf4c0d9244decb56b34fd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:04:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:04:12Z,use_quota=True,user_id='9da56184b2e348e8aa0b6991c57fb394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7862a5d2-db4e-47e9-99f4-864878c73b8e),volume_type_id=7862a5d2-db4e-47e9-99f4-864878c73b8e)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:04:12 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-2c41b1cd-544d-4016-89cf-1fb3845a2a18 tempest-GroupsTest-1275307344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (364b6b0d-937c-48ad-ae51-1b9aa2fe1ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:04:12 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-2c41b1cd-544d-4016-89cf-1fb3845a2a18 tempest-GroupsTest-1275307344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (364b6b0d-937c-48ad-ae51-1b9aa2fe1ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:04:12 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-2c41b1cd-544d-4016-89cf-1fb3845a2a18 tempest-GroupsTest-1275307344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b70a013b-35dc-4074-9505-0bc17dc592ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:04:12 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-2c41b1cd-544d-4016-89cf-1fb3845a2a18 tempest-GroupsTest-1275307344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b70a013b-35dc-4074-9505-0bc17dc592ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd01b527-dc5e-466b-bfa8-602db9b2d135', 'volume_name': 'volume-dd01b527-dc5e-466b-bfa8-602db9b2d135', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:04:12 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-2c41b1cd-544d-4016-89cf-1fb3845a2a18 tempest-GroupsTest-1275307344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4ffe0d2-60ba-4998-916b-e83b512a451c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:04:12 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-2c41b1cd-544d-4016-89cf-1fb3845a2a18 tempest-GroupsTest-1275307344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4ffe0d2-60ba-4998-916b-e83b512a451c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:04:12 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-2c41b1cd-544d-4016-89cf-1fb3845a2a18 tempest-GroupsTest-1275307344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ce608a3-aedc-48c0-9f9e-77d5f8c21bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:04:12 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-2c41b1cd-544d-4016-89cf-1fb3845a2a18 tempest-GroupsTest-1275307344 None] Volume dd01b527-dc5e-466b-bfa8-602db9b2d135: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd01b527-dc5e-466b-bfa8-602db9b2d135', 'volume_size': 1}
Apr 28 22:04:12 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-2c41b1cd-544d-4016-89cf-1fb3845a2a18 tempest-GroupsTest-1275307344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:04:12 devstack sudo[84965]: pam_unix(sudo:session): session closed for user root
Apr 28 22:04:12 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c60df49d-9f1e-4b08-abd0-1d34eb86d37c tempest-GroupSnapshotsV319Test-2094907535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f75f3ebb-cd0b-4648-91cf-09292996e39b" returned: 0 in 1.244s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:04:12 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c60df49d-9f1e-4b08-abd0-1d34eb86d37c tempest-GroupSnapshotsV319Test-2094907535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f75f3ebb-cd0b-4648-91cf-09292996e39b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f75f3ebb-cd0b-4648-91cf-09292996e39b.cce66caa-a707-4f69-a878-732a4b2dd735 1G {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:04:12 devstack sudo[84971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f75f3ebb-cd0b-4648-91cf-09292996e39b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f75f3ebb-cd0b-4648-91cf-09292996e39b.cce66caa-a707-4f69-a878-732a4b2dd735 1G
Apr 28 22:04:12 devstack sudo[84971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:04:13 devstack cinder-volume[83924]: WARNING py.warnings [req-d90ecfc6-0753-438f-a95f-994e6ff9d7ee req-539a9e59-9ebb-4143-a0cb-d933f3386d34 tempest-DeleteServersTestJSON-1890352589 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes".  Apply join condition(s) between each element to resolve.
Apr 28 22:04:13 devstack cinder-volume[83924]:   .first()
Apr 28 22:04:13 devstack cinder-volume[83924]: 
Apr 28 22:04:13 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [req-d90ecfc6-0753-438f-a95f-994e6ff9d7ee req-539a9e59-9ebb-4143-a0cb-d933f3386d34 tempest-DeleteServersTestJSON-1890352589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:04:14 devstack sudo[84971]: pam_unix(sudo:session): session closed for user root
Apr 28 22:04:14 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c60df49d-9f1e-4b08-abd0-1d34eb86d37c tempest-GroupSnapshotsV319Test-2094907535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f75f3ebb-cd0b-4648-91cf-09292996e39b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f75f3ebb-cd0b-4648-91cf-09292996e39b.cce66caa-a707-4f69-a878-732a4b2dd735 1G" returned: 0 in 1.213s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:04:14 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c60df49d-9f1e-4b08-abd0-1d34eb86d37c tempest-GroupSnapshotsV319Test-2094907535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f75f3ebb-cd0b-4648-91cf-09292996e39b -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f75f3ebb-cd0b-4648-91cf-09292996e39b.cce66caa-a707-4f69-a878-732a4b2dd735 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:04:14 devstack sudo[85005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f75f3ebb-cd0b-4648-91cf-09292996e39b -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f75f3ebb-cd0b-4648-91cf-09292996e39b.cce66caa-a707-4f69-a878-732a4b2dd735
Apr 28 22:04:14 devstack sudo[85005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:04:14 devstack sudo[85005]: pam_unix(sudo:session): session closed for user root
Apr 28 22:04:14 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c60df49d-9f1e-4b08-abd0-1d34eb86d37c tempest-GroupSnapshotsV319Test-2094907535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f75f3ebb-cd0b-4648-91cf-09292996e39b -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f75f3ebb-cd0b-4648-91cf-09292996e39b.cce66caa-a707-4f69-a878-732a4b2dd735" returned: 0 in 0.730s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:04:14 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-c60df49d-9f1e-4b08-abd0-1d34eb86d37c tempest-GroupSnapshotsV319Test-2094907535 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f75f3ebb-cd0b-4648-91cf-09292996e39b.cce66caa-a707-4f69-a878-732a4b2dd735 is being set with open permissions: ugo+rw: NotImplementedError
Apr 28 22:04:14 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c60df49d-9f1e-4b08-abd0-1d34eb86d37c tempest-GroupSnapshotsV319Test-2094907535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f75f3ebb-cd0b-4648-91cf-09292996e39b.cce66caa-a707-4f69-a878-732a4b2dd735 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:04:14 devstack sudo[85011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f75f3ebb-cd0b-4648-91cf-09292996e39b.cce66caa-a707-4f69-a878-732a4b2dd735
Apr 28 22:04:14 devstack sudo[85011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:04:15 devstack sudo[85011]: pam_unix(sudo:session): session closed for user root
Apr 28 22:04:15 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c60df49d-9f1e-4b08-abd0-1d34eb86d37c tempest-GroupSnapshotsV319Test-2094907535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f75f3ebb-cd0b-4648-91cf-09292996e39b.cce66caa-a707-4f69-a878-732a4b2dd735" returned: 0 in 0.599s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:04:15 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c60df49d-9f1e-4b08-abd0-1d34eb86d37c tempest-GroupSnapshotsV319Test-2094907535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f75f3ebb-cd0b-4648-91cf-09292996e39b.info {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:04:15 devstack sudo[85014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f75f3ebb-cd0b-4648-91cf-09292996e39b.info
Apr 28 22:04:15 devstack sudo[85014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:04:16 devstack sudo[85014]: pam_unix(sudo:session): session closed for user root
Apr 28 22:04:16 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c60df49d-9f1e-4b08-abd0-1d34eb86d37c tempest-GroupSnapshotsV319Test-2094907535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f75f3ebb-cd0b-4648-91cf-09292996e39b.info" returned: 0 in 0.648s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:04:16 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-c60df49d-9f1e-4b08-abd0-1d34eb86d37c tempest-GroupSnapshotsV319Test-2094907535 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f75f3ebb-cd0b-4648-91cf-09292996e39b.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 28 22:04:16 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c60df49d-9f1e-4b08-abd0-1d34eb86d37c tempest-GroupSnapshotsV319Test-2094907535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f75f3ebb-cd0b-4648-91cf-09292996e39b.info {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:04:16 devstack sudo[85017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f75f3ebb-cd0b-4648-91cf-09292996e39b.info
Apr 28 22:04:16 devstack sudo[85017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:04:16 devstack sudo[85017]: pam_unix(sudo:session): session closed for user root
Apr 28 22:04:16 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c60df49d-9f1e-4b08-abd0-1d34eb86d37c tempest-GroupSnapshotsV319Test-2094907535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f75f3ebb-cd0b-4648-91cf-09292996e39b.info" returned: 0 in 0.664s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:04:16 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-c60df49d-9f1e-4b08-abd0-1d34eb86d37c tempest-GroupSnapshotsV319Test-2094907535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.232s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:04:16 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-2c41b1cd-544d-4016-89cf-1fb3845a2a18 tempest-GroupsTest-1275307344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.133s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:04:16 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-2c41b1cd-544d-4016-89cf-1fb3845a2a18 tempest-GroupsTest-1275307344 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=72c79378-b359-4da9-bbd4-e4a1c3fc8e38,created_at=2026-04-28T20:04:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-808616082',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=72c79378-b359-4da9-bbd4-e4a1c3fc8e38,host='devstack@QuobyteHD#QuobyteHD',id=dd01b527-dc5e-466b-bfa8-602db9b2d135,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcc4ccf6c1cf4c0d9244decb56b34fd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:04:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:04:12Z,use_quota=True,user_id='9da56184b2e348e8aa0b6991c57fb394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7862a5d2-db4e-47e9-99f4-864878c73b8e),volume_type_id=7862a5d2-db4e-47e9-99f4-864878c73b8e)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:04:16 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-2c41b1cd-544d-4016-89cf-1fb3845a2a18 tempest-GroupsTest-1275307344 None] Creating volume dd01b527-dc5e-466b-bfa8-602db9b2d135 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:04:16 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-2c41b1cd-544d-4016-89cf-1fb3845a2a18 tempest-GroupsTest-1275307344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:04:16 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-2c41b1cd-544d-4016-89cf-1fb3845a2a18 tempest-GroupsTest-1275307344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:04:16 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-2c41b1cd-544d-4016-89cf-1fb3845a2a18 tempest-GroupsTest-1275307344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:04:16 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-2c41b1cd-544d-4016-89cf-1fb3845a2a18 tempest-GroupsTest-1275307344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:04:16 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-2c41b1cd-544d-4016-89cf-1fb3845a2a18 tempest-GroupsTest-1275307344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:04:16 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-2c41b1cd-544d-4016-89cf-1fb3845a2a18 tempest-GroupsTest-1275307344 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:04:16 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-2c41b1cd-544d-4016-89cf-1fb3845a2a18 tempest-GroupsTest-1275307344 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:04:16 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-2c41b1cd-544d-4016-89cf-1fb3845a2a18 tempest-GroupsTest-1275307344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-dd01b527-dc5e-466b-bfa8-602db9b2d135 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:04:16 devstack sudo[85020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-dd01b527-dc5e-466b-bfa8-602db9b2d135 1073741824
Apr 28 22:04:16 devstack sudo[85020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:04:16 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-c60df49d-9f1e-4b08-abd0-1d34eb86d37c tempest-GroupSnapshotsV319Test-2094907535 None] group_snapshot ae41f17a-0432-471c-b424-05705fe1929c: created successfully
Apr 28 22:04:17 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-7554c96f-5054-4e0c-858e-0417ff55541a tempest-GroupSnapshotsV319Test-2094907535 None] group_snapshot ae41f17a-0432-471c-b424-05705fe1929c: deleting
Apr 28 22:04:17 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-7554c96f-5054-4e0c-858e-0417ff55541a tempest-GroupSnapshotsV319Test-2094907535 None] group_snapshot ae41f17a-0432-471c-b424-05705fe1929c: deleting {{(pid=83924) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 28 22:04:17 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-7554c96f-5054-4e0c-858e-0417ff55541a tempest-GroupSnapshotsV319Test-2094907535 None] Acquiring lock "cinder-quobyte-f75f3ebb-cd0b-4648-91cf-09292996e39b" by "delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:04:17 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-7554c96f-5054-4e0c-858e-0417ff55541a tempest-GroupSnapshotsV319Test-2094907535 None] Lock "cinder-quobyte-f75f3ebb-cd0b-4648-91cf-09292996e39b" acquired by "delete_snapshot" :: waited 0.021s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:04:17 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-7554c96f-5054-4e0c-858e-0417ff55541a tempest-GroupSnapshotsV319Test-2094907535 None] Acquiring lock "cinder-quobyte-cce66caa-a707-4f69-a878-732a4b2dd735" by "_delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:04:17 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-7554c96f-5054-4e0c-858e-0417ff55541a tempest-GroupSnapshotsV319Test-2094907535 None] Lock "cinder-quobyte-cce66caa-a707-4f69-a878-732a4b2dd735" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:04:17 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-7554c96f-5054-4e0c-858e-0417ff55541a tempest-GroupSnapshotsV319Test-2094907535 None] Deleting offline snapshot cce66caa-a707-4f69-a878-732a4b2dd735 of volume f75f3ebb-cd0b-4648-91cf-09292996e39b {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 22:04:17 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-7554c96f-5054-4e0c-858e-0417ff55541a tempest-GroupSnapshotsV319Test-2094907535 None] snapshot_file for this snap is: volume-f75f3ebb-cd0b-4648-91cf-09292996e39b.cce66caa-a707-4f69-a878-732a4b2dd735 {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 22:04:17 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9afe21-e397-48d8-a861-1bfcd095dff0]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:04:17 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7554c96f-5054-4e0c-858e-0417ff55541a tempest-GroupSnapshotsV319Test-2094907535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f75f3ebb-cd0b-4648-91cf-09292996e39b.cce66caa-a707-4f69-a878-732a4b2dd735 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:04:17 devstack sudo[85026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f75f3ebb-cd0b-4648-91cf-09292996e39b.cce66caa-a707-4f69-a878-732a4b2dd735
Apr 28 22:04:17 devstack sudo[85026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:04:17 devstack sudo[85020]: pam_unix(sudo:session): session closed for user root
Apr 28 22:04:17 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-2c41b1cd-544d-4016-89cf-1fb3845a2a18 tempest-GroupsTest-1275307344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-dd01b527-dc5e-466b-bfa8-602db9b2d135 1073741824" returned: 0 in 1.076s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:04:17 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-2c41b1cd-544d-4016-89cf-1fb3845a2a18 tempest-GroupsTest-1275307344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-dd01b527-dc5e-466b-bfa8-602db9b2d135 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:04:17 devstack sudo[85028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-dd01b527-dc5e-466b-bfa8-602db9b2d135
Apr 28 22:04:17 devstack sudo[85028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:04:18 devstack sudo[85026]: pam_unix(sudo:session): session closed for user root
Apr 28 22:04:18 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7554c96f-5054-4e0c-858e-0417ff55541a tempest-GroupSnapshotsV319Test-2094907535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f75f3ebb-cd0b-4648-91cf-09292996e39b.cce66caa-a707-4f69-a878-732a4b2dd735" returned: 0 in 0.787s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:04:18 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-7554c96f-5054-4e0c-858e-0417ff55541a tempest-GroupSnapshotsV319Test-2094907535 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f75f3ebb-cd0b-4648-91cf-09292996e39b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 22:04:18 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a865211-a946-4853-aa82-be57b9c1d38f]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:04:18 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7554c96f-5054-4e0c-858e-0417ff55541a tempest-GroupSnapshotsV319Test-2094907535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f75f3ebb-cd0b-4648-91cf-09292996e39b {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:04:18 devstack sudo[85028]: pam_unix(sudo:session): session closed for user root
Apr 28 22:04:18 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-2c41b1cd-544d-4016-89cf-1fb3845a2a18 tempest-GroupsTest-1275307344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-dd01b527-dc5e-466b-bfa8-602db9b2d135" returned: 0 in 0.659s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:04:18 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-2c41b1cd-544d-4016-89cf-1fb3845a2a18 tempest-GroupsTest-1275307344 None] <== create_volume: return (1785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:04:18 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-2c41b1cd-544d-4016-89cf-1fb3845a2a18 tempest-GroupsTest-1275307344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.788s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:04:18 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [req-d90ecfc6-0753-438f-a95f-994e6ff9d7ee req-539a9e59-9ebb-4143-a0cb-d933f3386d34 tempest-DeleteServersTestJSON-1890352589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.695s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:04:18 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-2c41b1cd-544d-4016-89cf-1fb3845a2a18 tempest-GroupsTest-1275307344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ce608a3-aedc-48c0-9f9e-77d5f8c21bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd01b527-dc5e-466b-bfa8-602db9b2d135', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:04:18 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-2c41b1cd-544d-4016-89cf-1fb3845a2a18 tempest-GroupsTest-1275307344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (839a9b82-9abc-49cb-8f66-a4ddc6a5d767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:04:18 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[3293fdc1-88df-4709-a959-e16a779b3811]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:04:18 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-d90ecfc6-0753-438f-a95f-994e6ff9d7ee req-539a9e59-9ebb-4143-a0cb-d933f3386d34 tempest-DeleteServersTestJSON-1890352589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-e011d270-7828-4df0-9f95-01344b9a4aa5 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:04:18 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-2c41b1cd-544d-4016-89cf-1fb3845a2a18 tempest-GroupsTest-1275307344 None] Volume volume-dd01b527-dc5e-466b-bfa8-602db9b2d135 (dd01b527-dc5e-466b-bfa8-602db9b2d135): created successfully
Apr 28 22:04:18 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-2c41b1cd-544d-4016-89cf-1fb3845a2a18 tempest-GroupsTest-1275307344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (839a9b82-9abc-49cb-8f66-a4ddc6a5d767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:04:18 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-2c41b1cd-544d-4016-89cf-1fb3845a2a18 tempest-GroupsTest-1275307344 None] Flow 'volume_create_manager' (e9a42f42-201e-4d29-ae7a-80abda4fb819) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:04:18 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-2c41b1cd-544d-4016-89cf-1fb3845a2a18 tempest-GroupsTest-1275307344 None] Created volume successfully.
Apr 28 22:04:18 devstack sudo[85034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f75f3ebb-cd0b-4648-91cf-09292996e39b
Apr 28 22:04:18 devstack sudo[85034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:04:18 devstack sudo[85035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-e011d270-7828-4df0-9f95-01344b9a4aa5
Apr 28 22:04:18 devstack sudo[85035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:04:19 devstack sudo[85034]: pam_unix(sudo:session): session closed for user root
Apr 28 22:04:19 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7554c96f-5054-4e0c-858e-0417ff55541a tempest-GroupSnapshotsV319Test-2094907535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f75f3ebb-cd0b-4648-91cf-09292996e39b" returned: 0 in 0.840s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:04:19 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7554c96f-5054-4e0c-858e-0417ff55541a tempest-GroupSnapshotsV319Test-2094907535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f75f3ebb-cd0b-4648-91cf-09292996e39b.cce66caa-a707-4f69-a878-732a4b2dd735 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:04:19 devstack sudo[85046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f75f3ebb-cd0b-4648-91cf-09292996e39b.cce66caa-a707-4f69-a878-732a4b2dd735
Apr 28 22:04:19 devstack sudo[85046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:04:19 devstack sudo[85035]: pam_unix(sudo:session): session closed for user root
Apr 28 22:04:19 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-d90ecfc6-0753-438f-a95f-994e6ff9d7ee req-539a9e59-9ebb-4143-a0cb-d933f3386d34 tempest-DeleteServersTestJSON-1890352589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-e011d270-7828-4df0-9f95-01344b9a4aa5" returned: 0 in 0.877s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:04:19 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [req-d90ecfc6-0753-438f-a95f-994e6ff9d7ee req-539a9e59-9ebb-4143-a0cb-d933f3386d34 tempest-DeleteServersTestJSON-1890352589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.916s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:04:19 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [req-d90ecfc6-0753-438f-a95f-994e6ff9d7ee req-539a9e59-9ebb-4143-a0cb-d933f3386d34 tempest-DeleteServersTestJSON-1890352589 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2', 'name': 'volume-e011d270-7828-4df0-9f95-01344b9a4aa5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3bdebd92-b250-48ff-9c7c-c0e5497d20e3', 'enforce_multipath': True} {{(pid=83924) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 28 22:04:19 devstack cinder-volume[83924]: INFO cinder.volume.manager [req-d90ecfc6-0753-438f-a95f-994e6ff9d7ee req-539a9e59-9ebb-4143-a0cb-d933f3386d34 tempest-DeleteServersTestJSON-1890352589 None] attachment_update completed successfully.
Apr 28 22:04:19 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-22b03ce0-48ef-4f98-9a44-a512a0d80cfa tempest-GroupsTest-1275307344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:04:19 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-22b03ce0-48ef-4f98-9a44-a512a0d80cfa tempest-GroupsTest-1275307344 None] Flow 'volume_create_manager' (c3bb7629-e879-4db9-b757-50f7254b168b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:04:20 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-22b03ce0-48ef-4f98-9a44-a512a0d80cfa tempest-GroupsTest-1275307344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3824827-293a-4eed-9489-d61875b5732a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:04:20 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-22b03ce0-48ef-4f98-9a44-a512a0d80cfa tempest-GroupsTest-1275307344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3824827-293a-4eed-9489-d61875b5732a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:04:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2132400835',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=72c79378-b359-4da9-bbd4-e4a1c3fc8e38,host='devstack@QuobyteHD#QuobyteHD',id=29fd8015-6420-4271-ac89-7101bbfcade8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcc4ccf6c1cf4c0d9244decb56b34fd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:04:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:04:20Z,use_quota=True,user_id='9da56184b2e348e8aa0b6991c57fb394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7862a5d2-db4e-47e9-99f4-864878c73b8e),volume_type_id=7862a5d2-db4e-47e9-99f4-864878c73b8e)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:04:20 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-22b03ce0-48ef-4f98-9a44-a512a0d80cfa tempest-GroupsTest-1275307344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93ca14f0-9bd2-467d-9f7b-f83acc55e802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:04:20 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-22b03ce0-48ef-4f98-9a44-a512a0d80cfa tempest-GroupsTest-1275307344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93ca14f0-9bd2-467d-9f7b-f83acc55e802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:04:20 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-22b03ce0-48ef-4f98-9a44-a512a0d80cfa tempest-GroupsTest-1275307344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cefad5c6-44a3-4672-a5b3-9395c46744fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:04:20 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-22b03ce0-48ef-4f98-9a44-a512a0d80cfa tempest-GroupsTest-1275307344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cefad5c6-44a3-4672-a5b3-9395c46744fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29fd8015-6420-4271-ac89-7101bbfcade8', 'volume_name': 'volume-29fd8015-6420-4271-ac89-7101bbfcade8', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:04:20 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-22b03ce0-48ef-4f98-9a44-a512a0d80cfa tempest-GroupsTest-1275307344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53b446a4-f51c-4cf3-9d97-4ae5c19feab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:04:20 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-22b03ce0-48ef-4f98-9a44-a512a0d80cfa tempest-GroupsTest-1275307344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53b446a4-f51c-4cf3-9d97-4ae5c19feab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:04:20 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-22b03ce0-48ef-4f98-9a44-a512a0d80cfa tempest-GroupsTest-1275307344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c17126f8-ff38-4ac1-8c70-b3e8b22162a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:04:20 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-22b03ce0-48ef-4f98-9a44-a512a0d80cfa tempest-GroupsTest-1275307344 None] Volume 29fd8015-6420-4271-ac89-7101bbfcade8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29fd8015-6420-4271-ac89-7101bbfcade8', 'volume_size': 1}
Apr 28 22:04:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-22b03ce0-48ef-4f98-9a44-a512a0d80cfa tempest-GroupsTest-1275307344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:04:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-22b03ce0-48ef-4f98-9a44-a512a0d80cfa tempest-GroupsTest-1275307344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:04:20 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-22b03ce0-48ef-4f98-9a44-a512a0d80cfa tempest-GroupsTest-1275307344 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=72c79378-b359-4da9-bbd4-e4a1c3fc8e38,created_at=2026-04-28T20:04:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2132400835',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=72c79378-b359-4da9-bbd4-e4a1c3fc8e38,host='devstack@QuobyteHD#QuobyteHD',id=29fd8015-6420-4271-ac89-7101bbfcade8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcc4ccf6c1cf4c0d9244decb56b34fd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:04:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:04:20Z,use_quota=True,user_id='9da56184b2e348e8aa0b6991c57fb394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7862a5d2-db4e-47e9-99f4-864878c73b8e),volume_type_id=7862a5d2-db4e-47e9-99f4-864878c73b8e)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:04:20 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-22b03ce0-48ef-4f98-9a44-a512a0d80cfa tempest-GroupsTest-1275307344 None] Creating volume 29fd8015-6420-4271-ac89-7101bbfcade8 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:04:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-22b03ce0-48ef-4f98-9a44-a512a0d80cfa tempest-GroupsTest-1275307344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:04:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-22b03ce0-48ef-4f98-9a44-a512a0d80cfa tempest-GroupsTest-1275307344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:04:20 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-22b03ce0-48ef-4f98-9a44-a512a0d80cfa tempest-GroupsTest-1275307344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:04:20 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-22b03ce0-48ef-4f98-9a44-a512a0d80cfa tempest-GroupsTest-1275307344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:04:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-22b03ce0-48ef-4f98-9a44-a512a0d80cfa tempest-GroupsTest-1275307344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:04:20 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-22b03ce0-48ef-4f98-9a44-a512a0d80cfa tempest-GroupsTest-1275307344 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:04:20 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-22b03ce0-48ef-4f98-9a44-a512a0d80cfa tempest-GroupsTest-1275307344 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:04:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-22b03ce0-48ef-4f98-9a44-a512a0d80cfa tempest-GroupsTest-1275307344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-29fd8015-6420-4271-ac89-7101bbfcade8 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:04:20 devstack sudo[85049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-29fd8015-6420-4271-ac89-7101bbfcade8 1073741824
Apr 28 22:04:20 devstack sudo[85049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:04:20 devstack sudo[85046]: pam_unix(sudo:session): session closed for user root
Apr 28 22:04:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7554c96f-5054-4e0c-858e-0417ff55541a tempest-GroupSnapshotsV319Test-2094907535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f75f3ebb-cd0b-4648-91cf-09292996e39b.cce66caa-a707-4f69-a878-732a4b2dd735" returned: 0 in 1.146s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:04:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7554c96f-5054-4e0c-858e-0417ff55541a tempest-GroupSnapshotsV319Test-2094907535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f75f3ebb-cd0b-4648-91cf-09292996e39b.cce66caa-a707-4f69-a878-732a4b2dd735 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:04:20 devstack sudo[85122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f75f3ebb-cd0b-4648-91cf-09292996e39b.cce66caa-a707-4f69-a878-732a4b2dd735
Apr 28 22:04:20 devstack sudo[85122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:04:21 devstack sudo[85049]: pam_unix(sudo:session): session closed for user root
Apr 28 22:04:21 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-22b03ce0-48ef-4f98-9a44-a512a0d80cfa tempest-GroupsTest-1275307344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-29fd8015-6420-4271-ac89-7101bbfcade8 1073741824" returned: 0 in 1.317s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:04:21 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-22b03ce0-48ef-4f98-9a44-a512a0d80cfa tempest-GroupsTest-1275307344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-29fd8015-6420-4271-ac89-7101bbfcade8 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:04:21 devstack sudo[85122]: pam_unix(sudo:session): session closed for user root
Apr 28 22:04:21 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7554c96f-5054-4e0c-858e-0417ff55541a tempest-GroupSnapshotsV319Test-2094907535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f75f3ebb-cd0b-4648-91cf-09292996e39b.cce66caa-a707-4f69-a878-732a4b2dd735" returned: 0 in 0.943s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:04:21 devstack sudo[85445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-29fd8015-6420-4271-ac89-7101bbfcade8
Apr 28 22:04:21 devstack sudo[85445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:04:21 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-7554c96f-5054-4e0c-858e-0417ff55541a tempest-GroupSnapshotsV319Test-2094907535 None] Lock "cinder-quobyte-cce66caa-a707-4f69-a878-732a4b2dd735" released by "_delete_snapshot" :: held 3.864s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:04:21 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-7554c96f-5054-4e0c-858e-0417ff55541a tempest-GroupSnapshotsV319Test-2094907535 None] Lock "cinder-quobyte-f75f3ebb-cd0b-4648-91cf-09292996e39b" released by "delete_snapshot" :: held 3.896s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:04:21 devstack cinder-volume[83924]: WARNING cinder.quota [None req-7554c96f-5054-4e0c-858e-0417ff55541a tempest-GroupSnapshotsV319Test-2094907535 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-447416465 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-447416465, it is now deprecated. Please use the default quota class for default quota.
Apr 28 22:04:21 devstack cinder-volume[83924]: WARNING cinder.quota [None req-7554c96f-5054-4e0c-858e-0417ff55541a tempest-GroupSnapshotsV319Test-2094907535 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-447416465 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-447416465, it is now deprecated. Please use the default quota class for default quota.
Apr 28 22:04:21 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-7554c96f-5054-4e0c-858e-0417ff55541a tempest-GroupSnapshotsV319Test-2094907535 None] Created reservations ['b56aaad9-e125-4eb5-a1d2-8d88d4014195', '360e2b26-e8bf-4699-acde-013c1e3d11b5', 'e8f219b1-bf38-4b2c-a0dc-dd0a9c4f5f47', '8c97e574-15c3-4408-9b5a-b64c7acb7870'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:04:21 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-7554c96f-5054-4e0c-858e-0417ff55541a tempest-GroupSnapshotsV319Test-2094907535 None] group_snapshot ae41f17a-0432-471c-b424-05705fe1929c: deleted successfully
Apr 28 22:04:22 devstack sudo[85445]: pam_unix(sudo:session): session closed for user root
Apr 28 22:04:22 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-22b03ce0-48ef-4f98-9a44-a512a0d80cfa tempest-GroupsTest-1275307344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-29fd8015-6420-4271-ac89-7101bbfcade8" returned: 0 in 1.154s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:04:22 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-22b03ce0-48ef-4f98-9a44-a512a0d80cfa tempest-GroupsTest-1275307344 None] <== create_volume: return (2531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:04:22 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-22b03ce0-48ef-4f98-9a44-a512a0d80cfa tempest-GroupsTest-1275307344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.538s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:04:22 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-22b03ce0-48ef-4f98-9a44-a512a0d80cfa tempest-GroupsTest-1275307344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c17126f8-ff38-4ac1-8c70-b3e8b22162a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29fd8015-6420-4271-ac89-7101bbfcade8', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:04:22 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-22b03ce0-48ef-4f98-9a44-a512a0d80cfa tempest-GroupsTest-1275307344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a825ae0-b198-43a8-9975-f96581e10997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:04:22 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-ac7cd601-062b-406f-94df-9d91b72c3bb3 tempest-GroupSnapshotsV319Test-2094907535 None] Acquiring lock "cinder-quobyte-f75f3ebb-cd0b-4648-91cf-09292996e39b" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:04:22 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-22b03ce0-48ef-4f98-9a44-a512a0d80cfa tempest-GroupsTest-1275307344 None] Volume volume-29fd8015-6420-4271-ac89-7101bbfcade8 (29fd8015-6420-4271-ac89-7101bbfcade8): created successfully
Apr 28 22:04:22 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-22b03ce0-48ef-4f98-9a44-a512a0d80cfa tempest-GroupsTest-1275307344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a825ae0-b198-43a8-9975-f96581e10997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:04:22 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-22b03ce0-48ef-4f98-9a44-a512a0d80cfa tempest-GroupsTest-1275307344 None] Flow 'volume_create_manager' (c3bb7629-e879-4db9-b757-50f7254b168b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:04:22 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-ac7cd601-062b-406f-94df-9d91b72c3bb3 tempest-GroupSnapshotsV319Test-2094907535 None] Lock "cinder-quobyte-f75f3ebb-cd0b-4648-91cf-09292996e39b" acquired by "delete_volume" :: waited 0.086s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:04:22 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-22b03ce0-48ef-4f98-9a44-a512a0d80cfa tempest-GroupsTest-1275307344 None] Created volume successfully.
Apr 28 22:04:22 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d01966f-5f38-4deb-9cb9-7e47f968caf4]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:04:22 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-ac7cd601-062b-406f-94df-9d91b72c3bb3 tempest-GroupSnapshotsV319Test-2094907535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f75f3ebb-cd0b-4648-91cf-09292996e39b {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:04:23 devstack sudo[85455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f75f3ebb-cd0b-4648-91cf-09292996e39b
Apr 28 22:04:23 devstack sudo[85455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:04:23 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-5cda9fa6-ae83-4374-afc6-3777c1ee9571 tempest-GroupsTest-1275307344 None] Update group completed successfully.
Apr 28 22:04:23 devstack sudo[85455]: pam_unix(sudo:session): session closed for user root
Apr 28 22:04:23 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-ac7cd601-062b-406f-94df-9d91b72c3bb3 tempest-GroupSnapshotsV319Test-2094907535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f75f3ebb-cd0b-4648-91cf-09292996e39b" returned: 0 in 1.039s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:04:23 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-ac7cd601-062b-406f-94df-9d91b72c3bb3 tempest-GroupSnapshotsV319Test-2094907535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f75f3ebb-cd0b-4648-91cf-09292996e39b {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:04:23 devstack sudo[85469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f75f3ebb-cd0b-4648-91cf-09292996e39b
Apr 28 22:04:23 devstack sudo[85469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:04:24 devstack sudo[85469]: pam_unix(sudo:session): session closed for user root
Apr 28 22:04:24 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-ac7cd601-062b-406f-94df-9d91b72c3bb3 tempest-GroupSnapshotsV319Test-2094907535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f75f3ebb-cd0b-4648-91cf-09292996e39b" returned: 0 in 0.734s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:04:24 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-ac7cd601-062b-406f-94df-9d91b72c3bb3 tempest-GroupSnapshotsV319Test-2094907535 None] Lock "cinder-quobyte-f75f3ebb-cd0b-4648-91cf-09292996e39b" released by "delete_volume" :: held 1.896s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:04:24 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-ac7cd601-062b-406f-94df-9d91b72c3bb3 tempest-GroupSnapshotsV319Test-2094907535 None] Created reservations ['1cd8a77a-b842-48e2-bd7c-a8588217ba74'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:04:24 devstack cinder-volume[83924]: WARNING cinder.quota [None req-ac7cd601-062b-406f-94df-9d91b72c3bb3 tempest-GroupSnapshotsV319Test-2094907535 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-447416465 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-447416465, it is now deprecated. Please use the default quota class for default quota.
Apr 28 22:04:24 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-ac7cd601-062b-406f-94df-9d91b72c3bb3 tempest-GroupSnapshotsV319Test-2094907535 None] Created reservations ['e20d698d-5157-4649-b510-7f8505d47347', '6ee4180f-9b42-48e2-936a-723f24a06a8e', '324e98bc-8d85-4b2b-885f-48893ae788e2', 'ba5312fd-fbf4-4d37-a0bd-3dd81f8e4b65'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:04:25 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-ac7cd601-062b-406f-94df-9d91b72c3bb3 tempest-GroupSnapshotsV319Test-2094907535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:04:25 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-ac7cd601-062b-406f-94df-9d91b72c3bb3 tempest-GroupSnapshotsV319Test-2094907535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:04:25 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-ac7cd601-062b-406f-94df-9d91b72c3bb3 tempest-GroupSnapshotsV319Test-2094907535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:04:25 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-ac7cd601-062b-406f-94df-9d91b72c3bb3 tempest-GroupSnapshotsV319Test-2094907535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:04:25 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-ac7cd601-062b-406f-94df-9d91b72c3bb3 tempest-GroupSnapshotsV319Test-2094907535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:04:25 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-ac7cd601-062b-406f-94df-9d91b72c3bb3 tempest-GroupSnapshotsV319Test-2094907535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:04:25 devstack sudo[85476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:04:25 devstack sudo[85476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:04:25 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-50033ac6-b24a-463b-a6c3-e8a0d701ba46 tempest-GroupsTest-1275307344 None] Update group completed successfully.
Apr 28 22:04:26 devstack sudo[85476]: pam_unix(sudo:session): session closed for user root
Apr 28 22:04:26 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-ac7cd601-062b-406f-94df-9d91b72c3bb3 tempest-GroupSnapshotsV319Test-2094907535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 1.074s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:04:26 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-ac7cd601-062b-406f-94df-9d91b72c3bb3 tempest-GroupSnapshotsV319Test-2094907535 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:04:26 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-ac7cd601-062b-406f-94df-9d91b72c3bb3 tempest-GroupSnapshotsV319Test-2094907535 None] Delete group completed successfully.
Apr 28 22:04:26 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-f5a0eb31-f231-49a5-b845-1143afe3cfef tempest-GroupsTest-1275307344 None] Acquiring lock "cinder-quobyte-29fd8015-6420-4271-ac89-7101bbfcade8" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:04:26 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-f5a0eb31-f231-49a5-b845-1143afe3cfef tempest-GroupsTest-1275307344 None] Lock "cinder-quobyte-29fd8015-6420-4271-ac89-7101bbfcade8" acquired by "delete_volume" :: waited 0.042s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:04:26 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[4661c09b-2e2c-4529-9eaa-75e484533308]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:04:26 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f5a0eb31-f231-49a5-b845-1143afe3cfef tempest-GroupsTest-1275307344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-29fd8015-6420-4271-ac89-7101bbfcade8 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:04:27 devstack sudo[85541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-29fd8015-6420-4271-ac89-7101bbfcade8
Apr 28 22:04:27 devstack sudo[85541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:04:27 devstack sudo[85541]: pam_unix(sudo:session): session closed for user root
Apr 28 22:04:27 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f5a0eb31-f231-49a5-b845-1143afe3cfef tempest-GroupsTest-1275307344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-29fd8015-6420-4271-ac89-7101bbfcade8" returned: 0 in 0.924s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:04:27 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f5a0eb31-f231-49a5-b845-1143afe3cfef tempest-GroupsTest-1275307344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-29fd8015-6420-4271-ac89-7101bbfcade8 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:04:27 devstack sudo[85546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-29fd8015-6420-4271-ac89-7101bbfcade8
Apr 28 22:04:27 devstack sudo[85546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:04:28 devstack sudo[85546]: pam_unix(sudo:session): session closed for user root
Apr 28 22:04:28 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f5a0eb31-f231-49a5-b845-1143afe3cfef tempest-GroupsTest-1275307344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-29fd8015-6420-4271-ac89-7101bbfcade8" returned: 0 in 0.891s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:04:28 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-f5a0eb31-f231-49a5-b845-1143afe3cfef tempest-GroupsTest-1275307344 None] Lock "cinder-quobyte-29fd8015-6420-4271-ac89-7101bbfcade8" released by "delete_volume" :: held 1.883s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:04:28 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-f5a0eb31-f231-49a5-b845-1143afe3cfef tempest-GroupsTest-1275307344 None] Acquiring lock "cinder-quobyte-dd01b527-dc5e-466b-bfa8-602db9b2d135" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:04:28 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-f5a0eb31-f231-49a5-b845-1143afe3cfef tempest-GroupsTest-1275307344 None] Lock "cinder-quobyte-dd01b527-dc5e-466b-bfa8-602db9b2d135" acquired by "delete_volume" :: waited 0.020s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:04:28 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6be8bc-1b1f-4b32-a333-629b56c4157e]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:04:28 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f5a0eb31-f231-49a5-b845-1143afe3cfef tempest-GroupsTest-1275307344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-dd01b527-dc5e-466b-bfa8-602db9b2d135 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:04:29 devstack sudo[85551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-dd01b527-dc5e-466b-bfa8-602db9b2d135
Apr 28 22:04:29 devstack sudo[85551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:04:29 devstack cinder-volume[83924]: INFO cinder.volume.manager [req-b623ed7c-8e39-43f0-baf8-f276748afd9d req-4311ce8c-9889-4267-b2b7-f100ef52bfc6 tempest-DeleteServersTestJSON-1890352589 None] Terminate volume connection completed successfully.
Apr 28 22:04:29 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [req-b623ed7c-8e39-43f0-baf8-f276748afd9d req-4311ce8c-9889-4267-b2b7-f100ef52bfc6 tempest-DeleteServersTestJSON-1890352589 None] Deleting attachment 3bdebd92-b250-48ff-9c7c-c0e5497d20e3. {{(pid=83924) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 28 22:04:29 devstack sudo[85551]: pam_unix(sudo:session): session closed for user root
Apr 28 22:04:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f5a0eb31-f231-49a5-b845-1143afe3cfef tempest-GroupsTest-1275307344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-dd01b527-dc5e-466b-bfa8-602db9b2d135" returned: 0 in 1.010s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:04:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f5a0eb31-f231-49a5-b845-1143afe3cfef tempest-GroupsTest-1275307344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-dd01b527-dc5e-466b-bfa8-602db9b2d135 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:04:29 devstack sudo[85556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-dd01b527-dc5e-466b-bfa8-602db9b2d135
Apr 28 22:04:29 devstack sudo[85556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:04:30 devstack sudo[85556]: pam_unix(sudo:session): session closed for user root
Apr 28 22:04:30 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f5a0eb31-f231-49a5-b845-1143afe3cfef tempest-GroupsTest-1275307344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-dd01b527-dc5e-466b-bfa8-602db9b2d135" returned: 0 in 0.841s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:04:30 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-f5a0eb31-f231-49a5-b845-1143afe3cfef tempest-GroupsTest-1275307344 None] Lock "cinder-quobyte-dd01b527-dc5e-466b-bfa8-602db9b2d135" released by "delete_volume" :: held 1.908s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:04:30 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-f5a0eb31-f231-49a5-b845-1143afe3cfef tempest-GroupsTest-1275307344 None] Created reservations ['53a7bf2c-6e65-494d-a375-8e3124ae5c41'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:04:30 devstack cinder-volume[83924]: WARNING cinder.quota [None req-f5a0eb31-f231-49a5-b845-1143afe3cfef tempest-GroupsTest-1275307344 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1318955718 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1318955718, it is now deprecated. Please use the default quota class for default quota.
Apr 28 22:04:30 devstack cinder-volume[83924]: WARNING cinder.quota [None req-f5a0eb31-f231-49a5-b845-1143afe3cfef tempest-GroupsTest-1275307344 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1318955718 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1318955718, it is now deprecated. Please use the default quota class for default quota.
Apr 28 22:04:30 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-f5a0eb31-f231-49a5-b845-1143afe3cfef tempest-GroupsTest-1275307344 None] Created reservations ['48fd31a9-9c71-4100-9eac-747f821a6ff1', '9a6e504a-26df-4991-9602-5b817c829b29', 'aa023893-57d5-4052-9bd9-26b5932c83eb', '82fd978a-478d-4597-a094-ece04022a115'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:04:31 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-f5a0eb31-f231-49a5-b845-1143afe3cfef tempest-GroupsTest-1275307344 None] Created reservations ['c920a63f-2213-4f12-94f0-e49f6796c417', 'a9905909-6deb-4561-883e-dcd409553642', '15d1f597-72e3-4734-8d85-6e83833fac1f', 'e86c8b65-21b7-4e25-b0fb-c435e3cda043'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:04:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f5a0eb31-f231-49a5-b845-1143afe3cfef tempest-GroupsTest-1275307344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:04:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f5a0eb31-f231-49a5-b845-1143afe3cfef tempest-GroupsTest-1275307344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:04:31 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-f5a0eb31-f231-49a5-b845-1143afe3cfef tempest-GroupsTest-1275307344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:04:31 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-f5a0eb31-f231-49a5-b845-1143afe3cfef tempest-GroupsTest-1275307344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:04:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f5a0eb31-f231-49a5-b845-1143afe3cfef tempest-GroupsTest-1275307344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:04:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f5a0eb31-f231-49a5-b845-1143afe3cfef tempest-GroupsTest-1275307344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:04:31 devstack sudo[85559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:04:31 devstack sudo[85559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:04:32 devstack sudo[85559]: pam_unix(sudo:session): session closed for user root
Apr 28 22:04:32 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f5a0eb31-f231-49a5-b845-1143afe3cfef tempest-GroupsTest-1275307344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.826s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:04:32 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-f5a0eb31-f231-49a5-b845-1143afe3cfef tempest-GroupsTest-1275307344 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:04:32 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-f5a0eb31-f231-49a5-b845-1143afe3cfef tempest-GroupsTest-1275307344 None] Delete group completed successfully.
Apr 28 22:04:33 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-6ff044e5-24f8-41f5-92ff-7f685999b19c tempest-DeleteServersTestJSON-1890352589 None] Acquiring lock "cinder-e011d270-7828-4df0-9f95-01344b9a4aa5-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:04:33 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-6ff044e5-24f8-41f5-92ff-7f685999b19c tempest-DeleteServersTestJSON-1890352589 None] Lock "cinder-e011d270-7828-4df0-9f95-01344b9a4aa5-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:04:33 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-6ff044e5-24f8-41f5-92ff-7f685999b19c tempest-DeleteServersTestJSON-1890352589 None] Acquiring lock "cinder-quobyte-e011d270-7828-4df0-9f95-01344b9a4aa5" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:04:33 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-6ff044e5-24f8-41f5-92ff-7f685999b19c tempest-DeleteServersTestJSON-1890352589 None] Lock "cinder-quobyte-e011d270-7828-4df0-9f95-01344b9a4aa5" acquired by "delete_volume" :: waited 0.016s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:04:33 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2107bb9f-bead-4e5f-84d2-cb64f7952fc1]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:04:33 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-6ff044e5-24f8-41f5-92ff-7f685999b19c tempest-DeleteServersTestJSON-1890352589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-e011d270-7828-4df0-9f95-01344b9a4aa5 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:04:33 devstack sudo[85568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-e011d270-7828-4df0-9f95-01344b9a4aa5
Apr 28 22:04:33 devstack sudo[85568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:04:34 devstack sudo[85568]: pam_unix(sudo:session): session closed for user root
Apr 28 22:04:34 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-6ff044e5-24f8-41f5-92ff-7f685999b19c tempest-DeleteServersTestJSON-1890352589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-e011d270-7828-4df0-9f95-01344b9a4aa5" returned: 0 in 1.135s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:04:34 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-6ff044e5-24f8-41f5-92ff-7f685999b19c tempest-DeleteServersTestJSON-1890352589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-e011d270-7828-4df0-9f95-01344b9a4aa5 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:04:34 devstack sudo[85575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-e011d270-7828-4df0-9f95-01344b9a4aa5
Apr 28 22:04:34 devstack sudo[85575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:04:35 devstack sudo[85575]: pam_unix(sudo:session): session closed for user root
Apr 28 22:04:35 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-6ff044e5-24f8-41f5-92ff-7f685999b19c tempest-DeleteServersTestJSON-1890352589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-e011d270-7828-4df0-9f95-01344b9a4aa5" returned: 0 in 0.900s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:04:35 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-6ff044e5-24f8-41f5-92ff-7f685999b19c tempest-DeleteServersTestJSON-1890352589 None] Lock "cinder-quobyte-e011d270-7828-4df0-9f95-01344b9a4aa5" released by "delete_volume" :: held 2.095s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:04:35 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-6ff044e5-24f8-41f5-92ff-7f685999b19c tempest-DeleteServersTestJSON-1890352589 None] Created reservations ['8316bbf2-dc41-4a4b-a168-0a2151fb67be', '03355217-c156-453e-b4d4-c7f5e7b0f1af', '81f08379-14ee-46ed-a524-4e7b49607cbe', '53107f3a-e40c-4430-a2b9-aaa5ab14745e'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:04:35 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-6ff044e5-24f8-41f5-92ff-7f685999b19c tempest-DeleteServersTestJSON-1890352589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:04:35 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-6ff044e5-24f8-41f5-92ff-7f685999b19c tempest-DeleteServersTestJSON-1890352589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:04:35 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-6ff044e5-24f8-41f5-92ff-7f685999b19c tempest-DeleteServersTestJSON-1890352589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:04:35 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-6ff044e5-24f8-41f5-92ff-7f685999b19c tempest-DeleteServersTestJSON-1890352589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:04:35 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-6ff044e5-24f8-41f5-92ff-7f685999b19c tempest-DeleteServersTestJSON-1890352589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:04:35 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-6ff044e5-24f8-41f5-92ff-7f685999b19c tempest-DeleteServersTestJSON-1890352589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:04:35 devstack sudo[85581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:04:35 devstack sudo[85581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:04:36 devstack sudo[85581]: pam_unix(sudo:session): session closed for user root
Apr 28 22:04:36 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-6ff044e5-24f8-41f5-92ff-7f685999b19c tempest-DeleteServersTestJSON-1890352589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.817s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:04:36 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-6ff044e5-24f8-41f5-92ff-7f685999b19c tempest-DeleteServersTestJSON-1890352589 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:04:36 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-6ff044e5-24f8-41f5-92ff-7f685999b19c tempest-DeleteServersTestJSON-1890352589 None] Deleted volume successfully.
Apr 28 22:04:36 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-6ff044e5-24f8-41f5-92ff-7f685999b19c tempest-DeleteServersTestJSON-1890352589 None] Lock "cinder-e011d270-7828-4df0-9f95-01344b9a4aa5-delete_volume" released by "delete_volume" :: held 3.286s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:04:39 devstack cinder-volume[83924]: DEBUG oslo_service.periodic_task [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83924) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 28 22:04:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:04:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:04:39 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:04:39 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:04:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:04:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:04:39 devstack sudo[85585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:04:39 devstack sudo[85585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:04:39 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-fd5cd9d1-b734-44fd-b004-fbe9e10d51d2 tempest-GroupsV320Test-444651036 None] Group tempest-GroupsV320Test-Group-176379820: creating
Apr 28 22:04:40 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-fd5cd9d1-b734-44fd-b004-fbe9e10d51d2 tempest-GroupsV320Test-444651036 None] Group tempest-GroupsV320Test-Group-176379820: created successfully
Apr 28 22:04:40 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-fd5cd9d1-b734-44fd-b004-fbe9e10d51d2 tempest-GroupsV320Test-444651036 None] Create group completed successfully.
Apr 28 22:04:40 devstack sudo[85585]: pam_unix(sudo:session): session closed for user root
Apr 28 22:04:40 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 1.063s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:04:40 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:04:42 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-d11e9b11-743e-4cca-ae43-261aeb9d23b8 tempest-GroupsV320Test-444651036 None] Created reservations ['b5ab379b-b8dd-41a0-9895-a30860c7ef14'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:04:42 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-d11e9b11-743e-4cca-ae43-261aeb9d23b8 tempest-GroupsV320Test-444651036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:04:42 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-d11e9b11-743e-4cca-ae43-261aeb9d23b8 tempest-GroupsV320Test-444651036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:04:42 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-d11e9b11-743e-4cca-ae43-261aeb9d23b8 tempest-GroupsV320Test-444651036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:04:42 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-d11e9b11-743e-4cca-ae43-261aeb9d23b8 tempest-GroupsV320Test-444651036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:04:42 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-d11e9b11-743e-4cca-ae43-261aeb9d23b8 tempest-GroupsV320Test-444651036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:04:42 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-d11e9b11-743e-4cca-ae43-261aeb9d23b8 tempest-GroupsV320Test-444651036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:04:42 devstack sudo[85604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:04:42 devstack sudo[85604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:04:43 devstack sudo[85604]: pam_unix(sudo:session): session closed for user root
Apr 28 22:04:43 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-d11e9b11-743e-4cca-ae43-261aeb9d23b8 tempest-GroupsV320Test-444651036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 1.031s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:04:43 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-d11e9b11-743e-4cca-ae43-261aeb9d23b8 tempest-GroupsV320Test-444651036 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:04:43 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-d11e9b11-743e-4cca-ae43-261aeb9d23b8 tempest-GroupsV320Test-444651036 None] Delete group completed successfully.
Apr 28 22:04:52 devstack cinder-volume[83924]: DEBUG dbcounter [-] [83924] Writing DB stats cinder:SELECT=64,cinder:UPDATE=65,cinder:INSERT=10,cinder:DELETE=2 {{(pid=83924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 28 22:04:52 devstack cinder-volume[83924]: DEBUG dbcounter [-] [83924] Writing DB stats cinder:SELECT=57,cinder:INSERT=16,cinder:UPDATE=52,cinder:DELETE=1 {{(pid=83924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 28 22:04:52 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-0555b4cc-d221-4a45-a191-ec4b54b0f273 tempest-VolumeQuotasNegativeTestJSON-1459298743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:04:52 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-0555b4cc-d221-4a45-a191-ec4b54b0f273 tempest-VolumeQuotasNegativeTestJSON-1459298743 None] Flow 'volume_create_manager' (5a050129-dfe4-4676-9bee-eff2c3efe3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:04:52 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-0555b4cc-d221-4a45-a191-ec4b54b0f273 tempest-VolumeQuotasNegativeTestJSON-1459298743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec06f7a3-d43a-4322-ba71-fe7b2477b477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:04:52 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-0555b4cc-d221-4a45-a191-ec4b54b0f273 tempest-VolumeQuotasNegativeTestJSON-1459298743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec06f7a3-d43a-4322-ba71-fe7b2477b477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:04:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2015005222',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cc331af-0ecf-4e55-a8ed-73d5e537fa1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69ecf4b8024946e9a4d06aff8983e79b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:04:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:04:53Z,use_quota=True,user_id='588152ab869d469da9b8c2fd0a603598',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:04:52 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-0555b4cc-d221-4a45-a191-ec4b54b0f273 tempest-VolumeQuotasNegativeTestJSON-1459298743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fea1ebe2-b2d4-44d2-9f19-371b758b0f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:04:52 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-0555b4cc-d221-4a45-a191-ec4b54b0f273 tempest-VolumeQuotasNegativeTestJSON-1459298743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fea1ebe2-b2d4-44d2-9f19-371b758b0f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:04:52 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-0555b4cc-d221-4a45-a191-ec4b54b0f273 tempest-VolumeQuotasNegativeTestJSON-1459298743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe575f4f-de61-4493-a70e-200483983675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:04:52 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-0555b4cc-d221-4a45-a191-ec4b54b0f273 tempest-VolumeQuotasNegativeTestJSON-1459298743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe575f4f-de61-4493-a70e-200483983675) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cc331af-0ecf-4e55-a8ed-73d5e537fa1b', 'volume_name': 'volume-7cc331af-0ecf-4e55-a8ed-73d5e537fa1b', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:04:52 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-0555b4cc-d221-4a45-a191-ec4b54b0f273 tempest-VolumeQuotasNegativeTestJSON-1459298743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05a09970-7ba2-478a-b519-9846e4b59994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:04:52 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-0555b4cc-d221-4a45-a191-ec4b54b0f273 tempest-VolumeQuotasNegativeTestJSON-1459298743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05a09970-7ba2-478a-b519-9846e4b59994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:04:52 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-0555b4cc-d221-4a45-a191-ec4b54b0f273 tempest-VolumeQuotasNegativeTestJSON-1459298743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18b5f3c5-d651-434e-9f03-8e5ec83e50c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:04:52 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-0555b4cc-d221-4a45-a191-ec4b54b0f273 tempest-VolumeQuotasNegativeTestJSON-1459298743 None] Volume 7cc331af-0ecf-4e55-a8ed-73d5e537fa1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cc331af-0ecf-4e55-a8ed-73d5e537fa1b', 'volume_size': 1}
Apr 28 22:04:52 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-0555b4cc-d221-4a45-a191-ec4b54b0f273 tempest-VolumeQuotasNegativeTestJSON-1459298743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:04:52 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-0555b4cc-d221-4a45-a191-ec4b54b0f273 tempest-VolumeQuotasNegativeTestJSON-1459298743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:04:52 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-0555b4cc-d221-4a45-a191-ec4b54b0f273 tempest-VolumeQuotasNegativeTestJSON-1459298743 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:04:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2015005222',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cc331af-0ecf-4e55-a8ed-73d5e537fa1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69ecf4b8024946e9a4d06aff8983e79b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:04:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:04:53Z,use_quota=True,user_id='588152ab869d469da9b8c2fd0a603598',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:04:52 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-0555b4cc-d221-4a45-a191-ec4b54b0f273 tempest-VolumeQuotasNegativeTestJSON-1459298743 None] Creating volume 7cc331af-0ecf-4e55-a8ed-73d5e537fa1b {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:04:52 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-0555b4cc-d221-4a45-a191-ec4b54b0f273 tempest-VolumeQuotasNegativeTestJSON-1459298743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:04:52 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-0555b4cc-d221-4a45-a191-ec4b54b0f273 tempest-VolumeQuotasNegativeTestJSON-1459298743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:04:52 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-0555b4cc-d221-4a45-a191-ec4b54b0f273 tempest-VolumeQuotasNegativeTestJSON-1459298743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:04:52 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-0555b4cc-d221-4a45-a191-ec4b54b0f273 tempest-VolumeQuotasNegativeTestJSON-1459298743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:04:52 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-0555b4cc-d221-4a45-a191-ec4b54b0f273 tempest-VolumeQuotasNegativeTestJSON-1459298743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:04:52 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-0555b4cc-d221-4a45-a191-ec4b54b0f273 tempest-VolumeQuotasNegativeTestJSON-1459298743 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:04:52 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-0555b4cc-d221-4a45-a191-ec4b54b0f273 tempest-VolumeQuotasNegativeTestJSON-1459298743 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:04:52 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-0555b4cc-d221-4a45-a191-ec4b54b0f273 tempest-VolumeQuotasNegativeTestJSON-1459298743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7cc331af-0ecf-4e55-a8ed-73d5e537fa1b 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:04:52 devstack sudo[85752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7cc331af-0ecf-4e55-a8ed-73d5e537fa1b 1073741824
Apr 28 22:04:52 devstack sudo[85752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:04:54 devstack sudo[85752]: pam_unix(sudo:session): session closed for user root
Apr 28 22:04:54 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-0555b4cc-d221-4a45-a191-ec4b54b0f273 tempest-VolumeQuotasNegativeTestJSON-1459298743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7cc331af-0ecf-4e55-a8ed-73d5e537fa1b 1073741824" returned: 0 in 2.115s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:04:54 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-0555b4cc-d221-4a45-a191-ec4b54b0f273 tempest-VolumeQuotasNegativeTestJSON-1459298743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7cc331af-0ecf-4e55-a8ed-73d5e537fa1b {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:04:55 devstack sudo[85763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7cc331af-0ecf-4e55-a8ed-73d5e537fa1b
Apr 28 22:04:55 devstack sudo[85763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:04:55 devstack sudo[85763]: pam_unix(sudo:session): session closed for user root
Apr 28 22:04:55 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-0555b4cc-d221-4a45-a191-ec4b54b0f273 tempest-VolumeQuotasNegativeTestJSON-1459298743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7cc331af-0ecf-4e55-a8ed-73d5e537fa1b" returned: 0 in 1.017s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:04:55 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-0555b4cc-d221-4a45-a191-ec4b54b0f273 tempest-VolumeQuotasNegativeTestJSON-1459298743 None] <== create_volume: return (3224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:04:55 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-0555b4cc-d221-4a45-a191-ec4b54b0f273 tempest-VolumeQuotasNegativeTestJSON-1459298743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.234s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:04:56 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-0555b4cc-d221-4a45-a191-ec4b54b0f273 tempest-VolumeQuotasNegativeTestJSON-1459298743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18b5f3c5-d651-434e-9f03-8e5ec83e50c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cc331af-0ecf-4e55-a8ed-73d5e537fa1b', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:04:56 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-0555b4cc-d221-4a45-a191-ec4b54b0f273 tempest-VolumeQuotasNegativeTestJSON-1459298743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (557a7db8-e970-4968-add0-a6d4175ace18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:04:56 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-0555b4cc-d221-4a45-a191-ec4b54b0f273 tempest-VolumeQuotasNegativeTestJSON-1459298743 None] Volume volume-7cc331af-0ecf-4e55-a8ed-73d5e537fa1b (7cc331af-0ecf-4e55-a8ed-73d5e537fa1b): created successfully
Apr 28 22:04:56 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-0555b4cc-d221-4a45-a191-ec4b54b0f273 tempest-VolumeQuotasNegativeTestJSON-1459298743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (557a7db8-e970-4968-add0-a6d4175ace18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:04:56 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-0555b4cc-d221-4a45-a191-ec4b54b0f273 tempest-VolumeQuotasNegativeTestJSON-1459298743 None] Flow 'volume_create_manager' (5a050129-dfe4-4676-9bee-eff2c3efe3cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:04:56 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-0555b4cc-d221-4a45-a191-ec4b54b0f273 tempest-VolumeQuotasNegativeTestJSON-1459298743 None] Created volume successfully.
Apr 28 22:04:59 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-f6970d92-527e-43e4-98e4-892b15a754ed tempest-VolumeQuotasNegativeTestJSON-1459298743 None] Acquiring lock "cinder-7cc331af-0ecf-4e55-a8ed-73d5e537fa1b-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:04:59 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-f6970d92-527e-43e4-98e4-892b15a754ed tempest-VolumeQuotasNegativeTestJSON-1459298743 None] Lock "cinder-7cc331af-0ecf-4e55-a8ed-73d5e537fa1b-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:04:59 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-f6970d92-527e-43e4-98e4-892b15a754ed tempest-VolumeQuotasNegativeTestJSON-1459298743 None] Acquiring lock "cinder-quobyte-7cc331af-0ecf-4e55-a8ed-73d5e537fa1b" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:04:59 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-f6970d92-527e-43e4-98e4-892b15a754ed tempest-VolumeQuotasNegativeTestJSON-1459298743 None] Lock "cinder-quobyte-7cc331af-0ecf-4e55-a8ed-73d5e537fa1b" acquired by "delete_volume" :: waited 0.053s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:04:59 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d045b4e-d6f3-4235-85f2-386315df0b4c]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:04:59 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f6970d92-527e-43e4-98e4-892b15a754ed tempest-VolumeQuotasNegativeTestJSON-1459298743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7cc331af-0ecf-4e55-a8ed-73d5e537fa1b {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:04:59 devstack sudo[85766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7cc331af-0ecf-4e55-a8ed-73d5e537fa1b
Apr 28 22:04:59 devstack sudo[85766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:05:00 devstack sudo[85766]: pam_unix(sudo:session): session closed for user root
Apr 28 22:05:00 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f6970d92-527e-43e4-98e4-892b15a754ed tempest-VolumeQuotasNegativeTestJSON-1459298743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7cc331af-0ecf-4e55-a8ed-73d5e537fa1b" returned: 0 in 1.262s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:05:00 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f6970d92-527e-43e4-98e4-892b15a754ed tempest-VolumeQuotasNegativeTestJSON-1459298743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7cc331af-0ecf-4e55-a8ed-73d5e537fa1b {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:05:01 devstack sudo[85771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7cc331af-0ecf-4e55-a8ed-73d5e537fa1b
Apr 28 22:05:01 devstack sudo[85771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:05:02 devstack sudo[85771]: pam_unix(sudo:session): session closed for user root
Apr 28 22:05:02 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f6970d92-527e-43e4-98e4-892b15a754ed tempest-VolumeQuotasNegativeTestJSON-1459298743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7cc331af-0ecf-4e55-a8ed-73d5e537fa1b" returned: 0 in 1.750s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:05:02 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-f6970d92-527e-43e4-98e4-892b15a754ed tempest-VolumeQuotasNegativeTestJSON-1459298743 None] Lock "cinder-quobyte-7cc331af-0ecf-4e55-a8ed-73d5e537fa1b" released by "delete_volume" :: held 3.152s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:05:02 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-f6970d92-527e-43e4-98e4-892b15a754ed tempest-VolumeQuotasNegativeTestJSON-1459298743 None] Created reservations ['87583dbd-c17c-437f-9df0-fb0605b0b342', '9deb5b32-9367-4258-a026-d58a03904161', 'c973686e-0c69-4081-8a93-2fe5d64930d9', 'f23a9b75-3729-4df6-8e06-962eb3797847'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:05:03 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f6970d92-527e-43e4-98e4-892b15a754ed tempest-VolumeQuotasNegativeTestJSON-1459298743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:05:03 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f6970d92-527e-43e4-98e4-892b15a754ed tempest-VolumeQuotasNegativeTestJSON-1459298743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:05:03 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-f6970d92-527e-43e4-98e4-892b15a754ed tempest-VolumeQuotasNegativeTestJSON-1459298743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:05:03 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-f6970d92-527e-43e4-98e4-892b15a754ed tempest-VolumeQuotasNegativeTestJSON-1459298743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:05:03 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f6970d92-527e-43e4-98e4-892b15a754ed tempest-VolumeQuotasNegativeTestJSON-1459298743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:05:03 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f6970d92-527e-43e4-98e4-892b15a754ed tempest-VolumeQuotasNegativeTestJSON-1459298743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:05:03 devstack sudo[85778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:05:03 devstack sudo[85778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:05:05 devstack sudo[85778]: pam_unix(sudo:session): session closed for user root
Apr 28 22:05:05 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f6970d92-527e-43e4-98e4-892b15a754ed tempest-VolumeQuotasNegativeTestJSON-1459298743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 2.368s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:05:05 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-f6970d92-527e-43e4-98e4-892b15a754ed tempest-VolumeQuotasNegativeTestJSON-1459298743 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:05:05 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-f6970d92-527e-43e4-98e4-892b15a754ed tempest-VolumeQuotasNegativeTestJSON-1459298743 None] Deleted volume successfully.
Apr 28 22:05:05 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-f6970d92-527e-43e4-98e4-892b15a754ed tempest-VolumeQuotasNegativeTestJSON-1459298743 None] Lock "cinder-7cc331af-0ecf-4e55-a8ed-73d5e537fa1b-delete_volume" released by "delete_volume" :: held 6.200s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:05:11 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-df24a5a0-11ad-411f-be16-e9f5d104a256 tempest-VolumeQuotasAdminTestJSON-793974590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:05:11 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-df24a5a0-11ad-411f-be16-e9f5d104a256 tempest-VolumeQuotasAdminTestJSON-793974590 None] Flow 'volume_create_manager' (588ee33c-bc5c-45f1-8da2-104766daca27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:05:11 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-df24a5a0-11ad-411f-be16-e9f5d104a256 tempest-VolumeQuotasAdminTestJSON-793974590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d101ed4a-1d99-49b4-bcf9-da33a3de75e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:05:11 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-df24a5a0-11ad-411f-be16-e9f5d104a256 tempest-VolumeQuotasAdminTestJSON-793974590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d101ed4a-1d99-49b4-bcf9-da33a3de75e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1724202207',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24b79555-6815-4d63-9c09-24be3424b6a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56f28471ee9b4f9ea6be52a7e1f38997',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:05:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:05:11Z,use_quota=True,user_id='1d0d9d20a1d24798ae36d74e116fe6aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:05:11 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-df24a5a0-11ad-411f-be16-e9f5d104a256 tempest-VolumeQuotasAdminTestJSON-793974590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0376484f-c53a-4157-9108-2a30b523919a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:05:11 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-df24a5a0-11ad-411f-be16-e9f5d104a256 tempest-VolumeQuotasAdminTestJSON-793974590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0376484f-c53a-4157-9108-2a30b523919a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:05:11 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-df24a5a0-11ad-411f-be16-e9f5d104a256 tempest-VolumeQuotasAdminTestJSON-793974590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d01255d1-d930-4d1b-beeb-d0562a99aea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:05:11 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-df24a5a0-11ad-411f-be16-e9f5d104a256 tempest-VolumeQuotasAdminTestJSON-793974590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d01255d1-d930-4d1b-beeb-d0562a99aea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24b79555-6815-4d63-9c09-24be3424b6a0', 'volume_name': 'volume-24b79555-6815-4d63-9c09-24be3424b6a0', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:05:11 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-df24a5a0-11ad-411f-be16-e9f5d104a256 tempest-VolumeQuotasAdminTestJSON-793974590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caab0d1f-eef2-466e-8c1c-29898d463ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:05:11 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-df24a5a0-11ad-411f-be16-e9f5d104a256 tempest-VolumeQuotasAdminTestJSON-793974590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caab0d1f-eef2-466e-8c1c-29898d463ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:05:11 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-df24a5a0-11ad-411f-be16-e9f5d104a256 tempest-VolumeQuotasAdminTestJSON-793974590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfa3e9b1-ca75-4376-b329-ba14414bb1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:05:11 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-df24a5a0-11ad-411f-be16-e9f5d104a256 tempest-VolumeQuotasAdminTestJSON-793974590 None] Volume 24b79555-6815-4d63-9c09-24be3424b6a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24b79555-6815-4d63-9c09-24be3424b6a0', 'volume_size': 1}
Apr 28 22:05:11 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-df24a5a0-11ad-411f-be16-e9f5d104a256 tempest-VolumeQuotasAdminTestJSON-793974590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:05:11 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-df24a5a0-11ad-411f-be16-e9f5d104a256 tempest-VolumeQuotasAdminTestJSON-793974590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:05:11 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-df24a5a0-11ad-411f-be16-e9f5d104a256 tempest-VolumeQuotasAdminTestJSON-793974590 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1724202207',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24b79555-6815-4d63-9c09-24be3424b6a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56f28471ee9b4f9ea6be52a7e1f38997',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:05:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:05:11Z,use_quota=True,user_id='1d0d9d20a1d24798ae36d74e116fe6aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:05:11 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-df24a5a0-11ad-411f-be16-e9f5d104a256 tempest-VolumeQuotasAdminTestJSON-793974590 None] Creating volume 24b79555-6815-4d63-9c09-24be3424b6a0 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:05:11 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-df24a5a0-11ad-411f-be16-e9f5d104a256 tempest-VolumeQuotasAdminTestJSON-793974590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:05:11 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-df24a5a0-11ad-411f-be16-e9f5d104a256 tempest-VolumeQuotasAdminTestJSON-793974590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:05:11 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-df24a5a0-11ad-411f-be16-e9f5d104a256 tempest-VolumeQuotasAdminTestJSON-793974590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:05:11 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-df24a5a0-11ad-411f-be16-e9f5d104a256 tempest-VolumeQuotasAdminTestJSON-793974590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:05:11 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-df24a5a0-11ad-411f-be16-e9f5d104a256 tempest-VolumeQuotasAdminTestJSON-793974590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:05:11 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-df24a5a0-11ad-411f-be16-e9f5d104a256 tempest-VolumeQuotasAdminTestJSON-793974590 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:05:11 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-df24a5a0-11ad-411f-be16-e9f5d104a256 tempest-VolumeQuotasAdminTestJSON-793974590 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:05:11 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-df24a5a0-11ad-411f-be16-e9f5d104a256 tempest-VolumeQuotasAdminTestJSON-793974590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-24b79555-6815-4d63-9c09-24be3424b6a0 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:05:11 devstack sudo[85863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-24b79555-6815-4d63-9c09-24be3424b6a0 1073741824
Apr 28 22:05:11 devstack sudo[85863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:05:12 devstack sudo[85863]: pam_unix(sudo:session): session closed for user root
Apr 28 22:05:12 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-df24a5a0-11ad-411f-be16-e9f5d104a256 tempest-VolumeQuotasAdminTestJSON-793974590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-24b79555-6815-4d63-9c09-24be3424b6a0 1073741824" returned: 0 in 0.887s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:05:12 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-df24a5a0-11ad-411f-be16-e9f5d104a256 tempest-VolumeQuotasAdminTestJSON-793974590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-24b79555-6815-4d63-9c09-24be3424b6a0 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:05:12 devstack sudo[85906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-24b79555-6815-4d63-9c09-24be3424b6a0
Apr 28 22:05:12 devstack sudo[85906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:05:13 devstack sudo[85906]: pam_unix(sudo:session): session closed for user root
Apr 28 22:05:13 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-df24a5a0-11ad-411f-be16-e9f5d104a256 tempest-VolumeQuotasAdminTestJSON-793974590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-24b79555-6815-4d63-9c09-24be3424b6a0" returned: 0 in 1.121s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:05:13 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-df24a5a0-11ad-411f-be16-e9f5d104a256 tempest-VolumeQuotasAdminTestJSON-793974590 None] <== create_volume: return (2068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:05:13 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-df24a5a0-11ad-411f-be16-e9f5d104a256 tempest-VolumeQuotasAdminTestJSON-793974590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.076s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:05:13 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-df24a5a0-11ad-411f-be16-e9f5d104a256 tempest-VolumeQuotasAdminTestJSON-793974590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfa3e9b1-ca75-4376-b329-ba14414bb1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24b79555-6815-4d63-9c09-24be3424b6a0', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:05:13 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-df24a5a0-11ad-411f-be16-e9f5d104a256 tempest-VolumeQuotasAdminTestJSON-793974590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc683769-f7fa-473f-9352-1a6e38e2a69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:05:13 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-df24a5a0-11ad-411f-be16-e9f5d104a256 tempest-VolumeQuotasAdminTestJSON-793974590 None] Volume volume-24b79555-6815-4d63-9c09-24be3424b6a0 (24b79555-6815-4d63-9c09-24be3424b6a0): created successfully
Apr 28 22:05:13 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-df24a5a0-11ad-411f-be16-e9f5d104a256 tempest-VolumeQuotasAdminTestJSON-793974590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc683769-f7fa-473f-9352-1a6e38e2a69a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:05:13 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-df24a5a0-11ad-411f-be16-e9f5d104a256 tempest-VolumeQuotasAdminTestJSON-793974590 None] Flow 'volume_create_manager' (588ee33c-bc5c-45f1-8da2-104766daca27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:05:13 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-df24a5a0-11ad-411f-be16-e9f5d104a256 tempest-VolumeQuotasAdminTestJSON-793974590 None] Created volume successfully.
Apr 28 22:05:13 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-631aa955-4a7e-4080-b0b0-c8d257ce0f6a tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:05:13 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-631aa955-4a7e-4080-b0b0-c8d257ce0f6a tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Flow 'volume_create_manager' (5b2b2045-5bc6-4cee-875f-bf9f333eaf77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:05:13 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-631aa955-4a7e-4080-b0b0-c8d257ce0f6a tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd3b824d-97d3-4aad-a777-46fd7226a8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:05:13 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-631aa955-4a7e-4080-b0b0-c8d257ce0f6a tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd3b824d-97d3-4aad-a777-46fd7226a8f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:05:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1902615482',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c239306-b515-49d3-b9c3-35898dbe06f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83104251e5fd4510a7da735b02a38906',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:05:14Z,use_quota=True,user_id='de77e53d541d4f169d8829e28c0ccb56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:05:13 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-631aa955-4a7e-4080-b0b0-c8d257ce0f6a tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb43c083-625b-4f8e-be0c-ef4aba7e8a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:05:13 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-631aa955-4a7e-4080-b0b0-c8d257ce0f6a tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb43c083-625b-4f8e-be0c-ef4aba7e8a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:05:13 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-631aa955-4a7e-4080-b0b0-c8d257ce0f6a tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24578635-bde9-48ad-b18a-b2eb9e9d87fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:05:13 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-631aa955-4a7e-4080-b0b0-c8d257ce0f6a tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24578635-bde9-48ad-b18a-b2eb9e9d87fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c239306-b515-49d3-b9c3-35898dbe06f6', 'volume_name': 'volume-9c239306-b515-49d3-b9c3-35898dbe06f6', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:05:13 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-631aa955-4a7e-4080-b0b0-c8d257ce0f6a tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f6ef84f-a2c6-4706-ac7a-a5592b57187e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:05:13 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-631aa955-4a7e-4080-b0b0-c8d257ce0f6a tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f6ef84f-a2c6-4706-ac7a-a5592b57187e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:05:13 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-631aa955-4a7e-4080-b0b0-c8d257ce0f6a tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (345f4b30-54e0-4c83-9c70-d1271847ecb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:05:13 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-631aa955-4a7e-4080-b0b0-c8d257ce0f6a tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Volume 9c239306-b515-49d3-b9c3-35898dbe06f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c239306-b515-49d3-b9c3-35898dbe06f6', 'volume_size': 1}
Apr 28 22:05:13 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-631aa955-4a7e-4080-b0b0-c8d257ce0f6a tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:05:13 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-631aa955-4a7e-4080-b0b0-c8d257ce0f6a tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:05:13 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-631aa955-4a7e-4080-b0b0-c8d257ce0f6a tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:05:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1902615482',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c239306-b515-49d3-b9c3-35898dbe06f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83104251e5fd4510a7da735b02a38906',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:05:14Z,use_quota=True,user_id='de77e53d541d4f169d8829e28c0ccb56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:05:13 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-631aa955-4a7e-4080-b0b0-c8d257ce0f6a tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Creating volume 9c239306-b515-49d3-b9c3-35898dbe06f6 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:05:13 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-631aa955-4a7e-4080-b0b0-c8d257ce0f6a tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:05:13 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-631aa955-4a7e-4080-b0b0-c8d257ce0f6a tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:05:13 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-631aa955-4a7e-4080-b0b0-c8d257ce0f6a tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:05:13 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-631aa955-4a7e-4080-b0b0-c8d257ce0f6a tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:05:13 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-631aa955-4a7e-4080-b0b0-c8d257ce0f6a tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:05:13 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-631aa955-4a7e-4080-b0b0-c8d257ce0f6a tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:05:13 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-631aa955-4a7e-4080-b0b0-c8d257ce0f6a tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:05:13 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-631aa955-4a7e-4080-b0b0-c8d257ce0f6a tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9c239306-b515-49d3-b9c3-35898dbe06f6 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:05:13 devstack sudo[85951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9c239306-b515-49d3-b9c3-35898dbe06f6 1073741824
Apr 28 22:05:13 devstack sudo[85951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:05:14 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-5eb521be-8162-42d8-9100-ff997d8913b9 tempest-VolumeQuotasAdminTestJSON-793974590 None] Acquiring lock "cinder-24b79555-6815-4d63-9c09-24be3424b6a0-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:05:14 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-5eb521be-8162-42d8-9100-ff997d8913b9 tempest-VolumeQuotasAdminTestJSON-793974590 None] Lock "cinder-24b79555-6815-4d63-9c09-24be3424b6a0-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:05:15 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-5eb521be-8162-42d8-9100-ff997d8913b9 tempest-VolumeQuotasAdminTestJSON-793974590 None] Acquiring lock "cinder-quobyte-24b79555-6815-4d63-9c09-24be3424b6a0" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:05:15 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-5eb521be-8162-42d8-9100-ff997d8913b9 tempest-VolumeQuotasAdminTestJSON-793974590 None] Lock "cinder-quobyte-24b79555-6815-4d63-9c09-24be3424b6a0" acquired by "delete_volume" :: waited 0.023s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:05:15 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e701e55-bff7-4b95-bb0d-446b46493598]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:05:15 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5eb521be-8162-42d8-9100-ff997d8913b9 tempest-VolumeQuotasAdminTestJSON-793974590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-24b79555-6815-4d63-9c09-24be3424b6a0 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:05:15 devstack sudo[85960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-24b79555-6815-4d63-9c09-24be3424b6a0
Apr 28 22:05:15 devstack sudo[85960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:05:15 devstack sudo[85951]: pam_unix(sudo:session): session closed for user root
Apr 28 22:05:15 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-631aa955-4a7e-4080-b0b0-c8d257ce0f6a tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9c239306-b515-49d3-b9c3-35898dbe06f6 1073741824" returned: 0 in 1.741s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:05:15 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-631aa955-4a7e-4080-b0b0-c8d257ce0f6a tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9c239306-b515-49d3-b9c3-35898dbe06f6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:05:15 devstack sudo[85963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9c239306-b515-49d3-b9c3-35898dbe06f6
Apr 28 22:05:15 devstack sudo[85963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:05:16 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-06dfe6e0-d1b5-4a3d-a984-70d2f2662694 tempest-ServerRescueNegativeTestJSON-559848821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:05:16 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-06dfe6e0-d1b5-4a3d-a984-70d2f2662694 tempest-ServerRescueNegativeTestJSON-559848821 None] Flow 'volume_create_manager' (8ce3cdbc-6b31-4e7b-950c-08052445eee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:05:16 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-06dfe6e0-d1b5-4a3d-a984-70d2f2662694 tempest-ServerRescueNegativeTestJSON-559848821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc4a6caf-bf34-4d8b-99b6-3c5b77c74316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:05:16 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-06dfe6e0-d1b5-4a3d-a984-70d2f2662694 tempest-ServerRescueNegativeTestJSON-559848821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc4a6caf-bf34-4d8b-99b6-3c5b77c74316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:05:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-56199503',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e72bcb8a-27ca-4f95-b50a-abcaec43971b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86391250236a48b2a44c6c23132e2b6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:05:16Z,use_quota=True,user_id='1d5685d5f907403eb3948d2e722060d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:05:16 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-06dfe6e0-d1b5-4a3d-a984-70d2f2662694 tempest-ServerRescueNegativeTestJSON-559848821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e06a28f-2c7c-4f69-b2aa-43e6651092e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:05:16 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-06dfe6e0-d1b5-4a3d-a984-70d2f2662694 tempest-ServerRescueNegativeTestJSON-559848821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e06a28f-2c7c-4f69-b2aa-43e6651092e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:05:16 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-06dfe6e0-d1b5-4a3d-a984-70d2f2662694 tempest-ServerRescueNegativeTestJSON-559848821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a556d55e-f4df-4eed-a8bc-ae4588c350f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:05:16 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-06dfe6e0-d1b5-4a3d-a984-70d2f2662694 tempest-ServerRescueNegativeTestJSON-559848821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a556d55e-f4df-4eed-a8bc-ae4588c350f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e72bcb8a-27ca-4f95-b50a-abcaec43971b', 'volume_name': 'volume-e72bcb8a-27ca-4f95-b50a-abcaec43971b', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:05:16 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-06dfe6e0-d1b5-4a3d-a984-70d2f2662694 tempest-ServerRescueNegativeTestJSON-559848821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (157de95a-1774-4142-91c7-7215895af3e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:05:16 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-06dfe6e0-d1b5-4a3d-a984-70d2f2662694 tempest-ServerRescueNegativeTestJSON-559848821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (157de95a-1774-4142-91c7-7215895af3e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:05:16 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-06dfe6e0-d1b5-4a3d-a984-70d2f2662694 tempest-ServerRescueNegativeTestJSON-559848821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5598a1b5-3e31-4114-b7ad-d63e90531145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:05:16 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-06dfe6e0-d1b5-4a3d-a984-70d2f2662694 tempest-ServerRescueNegativeTestJSON-559848821 None] Volume e72bcb8a-27ca-4f95-b50a-abcaec43971b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e72bcb8a-27ca-4f95-b50a-abcaec43971b', 'volume_size': 1}
Apr 28 22:05:16 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-06dfe6e0-d1b5-4a3d-a984-70d2f2662694 tempest-ServerRescueNegativeTestJSON-559848821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:05:16 devstack sudo[85963]: pam_unix(sudo:session): session closed for user root
Apr 28 22:05:16 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-631aa955-4a7e-4080-b0b0-c8d257ce0f6a tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9c239306-b515-49d3-b9c3-35898dbe06f6" returned: 0 in 1.257s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:05:16 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-631aa955-4a7e-4080-b0b0-c8d257ce0f6a tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] <== create_volume: return (3115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:05:16 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-631aa955-4a7e-4080-b0b0-c8d257ce0f6a tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.117s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:05:16 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-06dfe6e0-d1b5-4a3d-a984-70d2f2662694 tempest-ServerRescueNegativeTestJSON-559848821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.373s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:05:16 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-06dfe6e0-d1b5-4a3d-a984-70d2f2662694 tempest-ServerRescueNegativeTestJSON-559848821 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:05:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-56199503',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e72bcb8a-27ca-4f95-b50a-abcaec43971b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86391250236a48b2a44c6c23132e2b6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:05:16Z,use_quota=True,user_id='1d5685d5f907403eb3948d2e722060d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:05:16 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-06dfe6e0-d1b5-4a3d-a984-70d2f2662694 tempest-ServerRescueNegativeTestJSON-559848821 None] Creating volume e72bcb8a-27ca-4f95-b50a-abcaec43971b {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:05:16 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-06dfe6e0-d1b5-4a3d-a984-70d2f2662694 tempest-ServerRescueNegativeTestJSON-559848821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:05:16 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-06dfe6e0-d1b5-4a3d-a984-70d2f2662694 tempest-ServerRescueNegativeTestJSON-559848821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:05:16 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-06dfe6e0-d1b5-4a3d-a984-70d2f2662694 tempest-ServerRescueNegativeTestJSON-559848821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:05:17 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-06dfe6e0-d1b5-4a3d-a984-70d2f2662694 tempest-ServerRescueNegativeTestJSON-559848821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:05:17 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-06dfe6e0-d1b5-4a3d-a984-70d2f2662694 tempest-ServerRescueNegativeTestJSON-559848821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:05:17 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-06dfe6e0-d1b5-4a3d-a984-70d2f2662694 tempest-ServerRescueNegativeTestJSON-559848821 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:05:17 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-06dfe6e0-d1b5-4a3d-a984-70d2f2662694 tempest-ServerRescueNegativeTestJSON-559848821 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:05:17 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-06dfe6e0-d1b5-4a3d-a984-70d2f2662694 tempest-ServerRescueNegativeTestJSON-559848821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-e72bcb8a-27ca-4f95-b50a-abcaec43971b 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:05:17 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-631aa955-4a7e-4080-b0b0-c8d257ce0f6a tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (345f4b30-54e0-4c83-9c70-d1271847ecb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c239306-b515-49d3-b9c3-35898dbe06f6', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:05:17 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-631aa955-4a7e-4080-b0b0-c8d257ce0f6a tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ce90318-8efa-449d-b93c-60fad8769c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:05:17 devstack sudo[85970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-e72bcb8a-27ca-4f95-b50a-abcaec43971b 1073741824
Apr 28 22:05:17 devstack sudo[85970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:05:17 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-631aa955-4a7e-4080-b0b0-c8d257ce0f6a tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Volume volume-9c239306-b515-49d3-b9c3-35898dbe06f6 (9c239306-b515-49d3-b9c3-35898dbe06f6): created successfully
Apr 28 22:05:17 devstack sudo[85960]: pam_unix(sudo:session): session closed for user root
Apr 28 22:05:17 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-631aa955-4a7e-4080-b0b0-c8d257ce0f6a tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ce90318-8efa-449d-b93c-60fad8769c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:05:17 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-631aa955-4a7e-4080-b0b0-c8d257ce0f6a tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Flow 'volume_create_manager' (5b2b2045-5bc6-4cee-875f-bf9f333eaf77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:05:17 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5eb521be-8162-42d8-9100-ff997d8913b9 tempest-VolumeQuotasAdminTestJSON-793974590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-24b79555-6815-4d63-9c09-24be3424b6a0" returned: 0 in 2.075s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:05:17 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5eb521be-8162-42d8-9100-ff997d8913b9 tempest-VolumeQuotasAdminTestJSON-793974590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-24b79555-6815-4d63-9c09-24be3424b6a0 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:05:17 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-631aa955-4a7e-4080-b0b0-c8d257ce0f6a tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Created volume successfully.
Apr 28 22:05:17 devstack sudo[85972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-24b79555-6815-4d63-9c09-24be3424b6a0
Apr 28 22:05:17 devstack sudo[85972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:05:18 devstack sudo[85972]: pam_unix(sudo:session): session closed for user root
Apr 28 22:05:18 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5eb521be-8162-42d8-9100-ff997d8913b9 tempest-VolumeQuotasAdminTestJSON-793974590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-24b79555-6815-4d63-9c09-24be3424b6a0" returned: 0 in 1.406s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:05:18 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-5eb521be-8162-42d8-9100-ff997d8913b9 tempest-VolumeQuotasAdminTestJSON-793974590 None] Lock "cinder-quobyte-24b79555-6815-4d63-9c09-24be3424b6a0" released by "delete_volume" :: held 3.591s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:05:18 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-5eb521be-8162-42d8-9100-ff997d8913b9 tempest-VolumeQuotasAdminTestJSON-793974590 None] Created reservations ['bc34afb3-ffd8-4c03-8242-01f440faf2f4', '907dffc6-01b2-46ce-8e98-0050c0b262a0', 'dffa2bd1-b531-4ed3-97d6-16f14a860e74', '648a940a-9a1a-4416-8374-0be9939102e9'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:05:19 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-5eb521be-8162-42d8-9100-ff997d8913b9 tempest-VolumeQuotasAdminTestJSON-793974590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:05:19 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-5eb521be-8162-42d8-9100-ff997d8913b9 tempest-VolumeQuotasAdminTestJSON-793974590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.014s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:05:19 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-5eb521be-8162-42d8-9100-ff997d8913b9 tempest-VolumeQuotasAdminTestJSON-793974590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:05:19 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-5eb521be-8162-42d8-9100-ff997d8913b9 tempest-VolumeQuotasAdminTestJSON-793974590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:05:19 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-5eb521be-8162-42d8-9100-ff997d8913b9 tempest-VolumeQuotasAdminTestJSON-793974590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:05:19 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5eb521be-8162-42d8-9100-ff997d8913b9 tempest-VolumeQuotasAdminTestJSON-793974590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:05:19 devstack sudo[85996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:05:19 devstack sudo[85996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:05:19 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f94bc574-304c-45b5-ad61-55372bc5ab13 tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:05:19 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-06dfe6e0-d1b5-4a3d-a984-70d2f2662694 tempest-ServerRescueNegativeTestJSON-559848821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-e72bcb8a-27ca-4f95-b50a-abcaec43971b 1073741824" returned: 0 in 2.285s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:05:19 devstack sudo[85970]: pam_unix(sudo:session): session closed for user root
Apr 28 22:05:19 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-06dfe6e0-d1b5-4a3d-a984-70d2f2662694 tempest-ServerRescueNegativeTestJSON-559848821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-e72bcb8a-27ca-4f95-b50a-abcaec43971b {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:05:19 devstack sudo[85999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-e72bcb8a-27ca-4f95-b50a-abcaec43971b
Apr 28 22:05:19 devstack sudo[85999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:05:19 devstack sudo[85996]: pam_unix(sudo:session): session closed for user root
Apr 28 22:05:19 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5eb521be-8162-42d8-9100-ff997d8913b9 tempest-VolumeQuotasAdminTestJSON-793974590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.685s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:05:19 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-5eb521be-8162-42d8-9100-ff997d8913b9 tempest-VolumeQuotasAdminTestJSON-793974590 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:05:19 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-5eb521be-8162-42d8-9100-ff997d8913b9 tempest-VolumeQuotasAdminTestJSON-793974590 None] Deleted volume successfully.
Apr 28 22:05:19 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-5eb521be-8162-42d8-9100-ff997d8913b9 tempest-VolumeQuotasAdminTestJSON-793974590 None] Lock "cinder-24b79555-6815-4d63-9c09-24be3424b6a0-delete_volume" released by "delete_volume" :: held 4.841s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:05:20 devstack sudo[85999]: pam_unix(sudo:session): session closed for user root
Apr 28 22:05:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-06dfe6e0-d1b5-4a3d-a984-70d2f2662694 tempest-ServerRescueNegativeTestJSON-559848821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-e72bcb8a-27ca-4f95-b50a-abcaec43971b" returned: 0 in 0.689s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:05:20 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-06dfe6e0-d1b5-4a3d-a984-70d2f2662694 tempest-ServerRescueNegativeTestJSON-559848821 None] <== create_volume: return (3039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:05:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-06dfe6e0-d1b5-4a3d-a984-70d2f2662694 tempest-ServerRescueNegativeTestJSON-559848821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.044s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:05:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f94bc574-304c-45b5-ad61-55372bc5ab13 tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.848s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:05:20 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-f94bc574-304c-45b5-ad61-55372bc5ab13 tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Creating offline snapshot 2302b874-2f0d-4e81-a40d-b3d09073daad of volume 9c239306-b515-49d3-b9c3-35898dbe06f6 {{(pid=83924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 22:05:20 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-06dfe6e0-d1b5-4a3d-a984-70d2f2662694 tempest-ServerRescueNegativeTestJSON-559848821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5598a1b5-3e31-4114-b7ad-d63e90531145) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e72bcb8a-27ca-4f95-b50a-abcaec43971b', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:05:20 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-06dfe6e0-d1b5-4a3d-a984-70d2f2662694 tempest-ServerRescueNegativeTestJSON-559848821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c9a1bbb-d340-427b-8b41-58f454e05ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:05:20 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[61725de2-7690-493a-8bb6-9da63ec41667]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:05:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f94bc574-304c-45b5-ad61-55372bc5ab13 tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9c239306-b515-49d3-b9c3-35898dbe06f6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:05:20 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-06dfe6e0-d1b5-4a3d-a984-70d2f2662694 tempest-ServerRescueNegativeTestJSON-559848821 None] Volume volume-e72bcb8a-27ca-4f95-b50a-abcaec43971b (e72bcb8a-27ca-4f95-b50a-abcaec43971b): created successfully
Apr 28 22:05:20 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-06dfe6e0-d1b5-4a3d-a984-70d2f2662694 tempest-ServerRescueNegativeTestJSON-559848821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c9a1bbb-d340-427b-8b41-58f454e05ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:05:20 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-06dfe6e0-d1b5-4a3d-a984-70d2f2662694 tempest-ServerRescueNegativeTestJSON-559848821 None] Flow 'volume_create_manager' (8ce3cdbc-6b31-4e7b-950c-08052445eee0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:05:20 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-06dfe6e0-d1b5-4a3d-a984-70d2f2662694 tempest-ServerRescueNegativeTestJSON-559848821 None] Created volume successfully.
Apr 28 22:05:20 devstack sudo[86003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9c239306-b515-49d3-b9c3-35898dbe06f6
Apr 28 22:05:20 devstack sudo[86003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:05:20 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ac2267e-b07f-4ec0-8d1e-bee1900c64e6 tempest-VolumeQuotasAdminTestJSON-793974590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:05:20 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5ac2267e-b07f-4ec0-8d1e-bee1900c64e6 tempest-VolumeQuotasAdminTestJSON-793974590 None] Flow 'volume_create_manager' (d5b43564-0e55-472d-9016-d6fde67d684d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:05:20 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5ac2267e-b07f-4ec0-8d1e-bee1900c64e6 tempest-VolumeQuotasAdminTestJSON-793974590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c26f574a-4b56-4874-ab6f-dba6cb7223a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:05:20 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5ac2267e-b07f-4ec0-8d1e-bee1900c64e6 tempest-VolumeQuotasAdminTestJSON-793974590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c26f574a-4b56-4874-ab6f-dba6cb7223a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:05:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-356572451',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc1b0205-19dd-400b-9f43-32f05cbbe937,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56f28471ee9b4f9ea6be52a7e1f38997',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:05:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:05:20Z,use_quota=True,user_id='1d0d9d20a1d24798ae36d74e116fe6aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:05:20 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5ac2267e-b07f-4ec0-8d1e-bee1900c64e6 tempest-VolumeQuotasAdminTestJSON-793974590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f1941b5-d9b4-4de3-a624-b2a486bd66af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:05:20 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5ac2267e-b07f-4ec0-8d1e-bee1900c64e6 tempest-VolumeQuotasAdminTestJSON-793974590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f1941b5-d9b4-4de3-a624-b2a486bd66af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:05:20 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5ac2267e-b07f-4ec0-8d1e-bee1900c64e6 tempest-VolumeQuotasAdminTestJSON-793974590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cfa3797-5b40-4e4f-a1d0-ae635cbef674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:05:20 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5ac2267e-b07f-4ec0-8d1e-bee1900c64e6 tempest-VolumeQuotasAdminTestJSON-793974590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cfa3797-5b40-4e4f-a1d0-ae635cbef674) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc1b0205-19dd-400b-9f43-32f05cbbe937', 'volume_name': 'volume-cc1b0205-19dd-400b-9f43-32f05cbbe937', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:05:20 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5ac2267e-b07f-4ec0-8d1e-bee1900c64e6 tempest-VolumeQuotasAdminTestJSON-793974590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82ad6869-5118-4098-bc99-e63db5f4a447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:05:20 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5ac2267e-b07f-4ec0-8d1e-bee1900c64e6 tempest-VolumeQuotasAdminTestJSON-793974590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82ad6869-5118-4098-bc99-e63db5f4a447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:05:20 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5ac2267e-b07f-4ec0-8d1e-bee1900c64e6 tempest-VolumeQuotasAdminTestJSON-793974590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e881d29-572d-4d97-a7b8-bceb3ac99bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:05:20 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-5ac2267e-b07f-4ec0-8d1e-bee1900c64e6 tempest-VolumeQuotasAdminTestJSON-793974590 None] Volume cc1b0205-19dd-400b-9f43-32f05cbbe937: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc1b0205-19dd-400b-9f43-32f05cbbe937', 'volume_size': 1}
Apr 28 22:05:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-5ac2267e-b07f-4ec0-8d1e-bee1900c64e6 tempest-VolumeQuotasAdminTestJSON-793974590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:05:21 devstack sudo[86003]: pam_unix(sudo:session): session closed for user root
Apr 28 22:05:21 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f94bc574-304c-45b5-ad61-55372bc5ab13 tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9c239306-b515-49d3-b9c3-35898dbe06f6" returned: 0 in 1.265s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:05:21 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f94bc574-304c-45b5-ad61-55372bc5ab13 tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9c239306-b515-49d3-b9c3-35898dbe06f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9c239306-b515-49d3-b9c3-35898dbe06f6.2302b874-2f0d-4e81-a40d-b3d09073daad 1G {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:05:21 devstack sudo[86010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9c239306-b515-49d3-b9c3-35898dbe06f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9c239306-b515-49d3-b9c3-35898dbe06f6.2302b874-2f0d-4e81-a40d-b3d09073daad 1G
Apr 28 22:05:21 devstack sudo[86010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:05:22 devstack sudo[86010]: pam_unix(sudo:session): session closed for user root
Apr 28 22:05:22 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f94bc574-304c-45b5-ad61-55372bc5ab13 tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9c239306-b515-49d3-b9c3-35898dbe06f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9c239306-b515-49d3-b9c3-35898dbe06f6.2302b874-2f0d-4e81-a40d-b3d09073daad 1G" returned: 0 in 0.842s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:05:22 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f94bc574-304c-45b5-ad61-55372bc5ab13 tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c239306-b515-49d3-b9c3-35898dbe06f6 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9c239306-b515-49d3-b9c3-35898dbe06f6.2302b874-2f0d-4e81-a40d-b3d09073daad {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:05:22 devstack sudo[86016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c239306-b515-49d3-b9c3-35898dbe06f6 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9c239306-b515-49d3-b9c3-35898dbe06f6.2302b874-2f0d-4e81-a40d-b3d09073daad
Apr 28 22:05:22 devstack sudo[86016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:05:23 devstack sudo[86016]: pam_unix(sudo:session): session closed for user root
Apr 28 22:05:23 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f94bc574-304c-45b5-ad61-55372bc5ab13 tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c239306-b515-49d3-b9c3-35898dbe06f6 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9c239306-b515-49d3-b9c3-35898dbe06f6.2302b874-2f0d-4e81-a40d-b3d09073daad" returned: 0 in 0.899s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:05:23 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-f94bc574-304c-45b5-ad61-55372bc5ab13 tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9c239306-b515-49d3-b9c3-35898dbe06f6.2302b874-2f0d-4e81-a40d-b3d09073daad is being set with open permissions: ugo+rw
Apr 28 22:05:23 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f94bc574-304c-45b5-ad61-55372bc5ab13 tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9c239306-b515-49d3-b9c3-35898dbe06f6.2302b874-2f0d-4e81-a40d-b3d09073daad {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:05:23 devstack sudo[86022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9c239306-b515-49d3-b9c3-35898dbe06f6.2302b874-2f0d-4e81-a40d-b3d09073daad
Apr 28 22:05:23 devstack sudo[86022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:05:23 devstack sudo[86022]: pam_unix(sudo:session): session closed for user root
Apr 28 22:05:23 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f94bc574-304c-45b5-ad61-55372bc5ab13 tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9c239306-b515-49d3-b9c3-35898dbe06f6.2302b874-2f0d-4e81-a40d-b3d09073daad" returned: 0 in 0.692s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:05:23 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f94bc574-304c-45b5-ad61-55372bc5ab13 tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9c239306-b515-49d3-b9c3-35898dbe06f6.info {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:05:23 devstack sudo[86025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9c239306-b515-49d3-b9c3-35898dbe06f6.info
Apr 28 22:05:23 devstack sudo[86025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:05:24 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f94bc574-304c-45b5-ad61-55372bc5ab13 tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9c239306-b515-49d3-b9c3-35898dbe06f6.info" returned: 0 in 0.639s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:05:24 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-f94bc574-304c-45b5-ad61-55372bc5ab13 tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9c239306-b515-49d3-b9c3-35898dbe06f6.info is being set with open permissions: ugo+rw
Apr 28 22:05:24 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f94bc574-304c-45b5-ad61-55372bc5ab13 tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9c239306-b515-49d3-b9c3-35898dbe06f6.info {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:05:24 devstack sudo[86025]: pam_unix(sudo:session): session closed for user root
Apr 28 22:05:24 devstack sudo[86034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9c239306-b515-49d3-b9c3-35898dbe06f6.info
Apr 28 22:05:24 devstack sudo[86034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:05:25 devstack sudo[86034]: pam_unix(sudo:session): session closed for user root
Apr 28 22:05:25 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f94bc574-304c-45b5-ad61-55372bc5ab13 tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9c239306-b515-49d3-b9c3-35898dbe06f6.info" returned: 0 in 0.987s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:05:25 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f94bc574-304c-45b5-ad61-55372bc5ab13 tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.469s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:05:25 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-5ac2267e-b07f-4ec0-8d1e-bee1900c64e6 tempest-VolumeQuotasAdminTestJSON-793974590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.811s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:05:25 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-5ac2267e-b07f-4ec0-8d1e-bee1900c64e6 tempest-VolumeQuotasAdminTestJSON-793974590 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:05:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-356572451',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc1b0205-19dd-400b-9f43-32f05cbbe937,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56f28471ee9b4f9ea6be52a7e1f38997',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:05:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:05:20Z,use_quota=True,user_id='1d0d9d20a1d24798ae36d74e116fe6aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:05:25 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-5ac2267e-b07f-4ec0-8d1e-bee1900c64e6 tempest-VolumeQuotasAdminTestJSON-793974590 None] Creating volume cc1b0205-19dd-400b-9f43-32f05cbbe937 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:05:25 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-5ac2267e-b07f-4ec0-8d1e-bee1900c64e6 tempest-VolumeQuotasAdminTestJSON-793974590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:05:25 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-5ac2267e-b07f-4ec0-8d1e-bee1900c64e6 tempest-VolumeQuotasAdminTestJSON-793974590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:05:25 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-5ac2267e-b07f-4ec0-8d1e-bee1900c64e6 tempest-VolumeQuotasAdminTestJSON-793974590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:05:25 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-5ac2267e-b07f-4ec0-8d1e-bee1900c64e6 tempest-VolumeQuotasAdminTestJSON-793974590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:05:25 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-5ac2267e-b07f-4ec0-8d1e-bee1900c64e6 tempest-VolumeQuotasAdminTestJSON-793974590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:05:25 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-5ac2267e-b07f-4ec0-8d1e-bee1900c64e6 tempest-VolumeQuotasAdminTestJSON-793974590 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:05:25 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-5ac2267e-b07f-4ec0-8d1e-bee1900c64e6 tempest-VolumeQuotasAdminTestJSON-793974590 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:05:25 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5ac2267e-b07f-4ec0-8d1e-bee1900c64e6 tempest-VolumeQuotasAdminTestJSON-793974590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cc1b0205-19dd-400b-9f43-32f05cbbe937 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:05:25 devstack sudo[86083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cc1b0205-19dd-400b-9f43-32f05cbbe937 1073741824
Apr 28 22:05:25 devstack sudo[86083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:05:25 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-f94bc574-304c-45b5-ad61-55372bc5ab13 tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Create snapshot completed successfully
Apr 28 22:05:27 devstack sudo[86083]: pam_unix(sudo:session): session closed for user root
Apr 28 22:05:27 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5ac2267e-b07f-4ec0-8d1e-bee1900c64e6 tempest-VolumeQuotasAdminTestJSON-793974590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cc1b0205-19dd-400b-9f43-32f05cbbe937 1073741824" returned: 0 in 1.498s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:05:27 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5ac2267e-b07f-4ec0-8d1e-bee1900c64e6 tempest-VolumeQuotasAdminTestJSON-793974590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cc1b0205-19dd-400b-9f43-32f05cbbe937 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:05:27 devstack sudo[86169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cc1b0205-19dd-400b-9f43-32f05cbbe937
Apr 28 22:05:27 devstack sudo[86169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:05:27 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-fa0f11be-29d0-43f1-bd63-2680a867ae4e tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Acquiring lock "cinder-2302b874-2f0d-4e81-a40d-b3d09073daad-delete_snapshot" by "delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:05:27 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-fa0f11be-29d0-43f1-bd63-2680a867ae4e tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Lock "cinder-2302b874-2f0d-4e81-a40d-b3d09073daad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.092s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:05:27 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-fa0f11be-29d0-43f1-bd63-2680a867ae4e tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Acquiring lock "cinder-quobyte-9c239306-b515-49d3-b9c3-35898dbe06f6" by "delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:05:27 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-fa0f11be-29d0-43f1-bd63-2680a867ae4e tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Lock "cinder-quobyte-9c239306-b515-49d3-b9c3-35898dbe06f6" acquired by "delete_snapshot" :: waited 0.036s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:05:27 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-fa0f11be-29d0-43f1-bd63-2680a867ae4e tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Acquiring lock "cinder-quobyte-2302b874-2f0d-4e81-a40d-b3d09073daad" by "_delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:05:27 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-fa0f11be-29d0-43f1-bd63-2680a867ae4e tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Lock "cinder-quobyte-2302b874-2f0d-4e81-a40d-b3d09073daad" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:05:27 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-fa0f11be-29d0-43f1-bd63-2680a867ae4e tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Deleting offline snapshot 2302b874-2f0d-4e81-a40d-b3d09073daad of volume 9c239306-b515-49d3-b9c3-35898dbe06f6 {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 22:05:28 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-fa0f11be-29d0-43f1-bd63-2680a867ae4e tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] snapshot_file for this snap is: volume-9c239306-b515-49d3-b9c3-35898dbe06f6.2302b874-2f0d-4e81-a40d-b3d09073daad {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 22:05:28 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c42818d-b46b-4950-8e96-f7fb3fa128c8]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:05:28 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-fa0f11be-29d0-43f1-bd63-2680a867ae4e tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9c239306-b515-49d3-b9c3-35898dbe06f6.2302b874-2f0d-4e81-a40d-b3d09073daad {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:05:28 devstack sudo[86191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9c239306-b515-49d3-b9c3-35898dbe06f6.2302b874-2f0d-4e81-a40d-b3d09073daad
Apr 28 22:05:28 devstack sudo[86191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:05:28 devstack sudo[86169]: pam_unix(sudo:session): session closed for user root
Apr 28 22:05:28 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5ac2267e-b07f-4ec0-8d1e-bee1900c64e6 tempest-VolumeQuotasAdminTestJSON-793974590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cc1b0205-19dd-400b-9f43-32f05cbbe937" returned: 0 in 1.543s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:05:28 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-5ac2267e-b07f-4ec0-8d1e-bee1900c64e6 tempest-VolumeQuotasAdminTestJSON-793974590 None] <== create_volume: return (3128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:05:28 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-5ac2267e-b07f-4ec0-8d1e-bee1900c64e6 tempest-VolumeQuotasAdminTestJSON-793974590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.135s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:05:28 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5ac2267e-b07f-4ec0-8d1e-bee1900c64e6 tempest-VolumeQuotasAdminTestJSON-793974590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e881d29-572d-4d97-a7b8-bceb3ac99bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc1b0205-19dd-400b-9f43-32f05cbbe937', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:05:28 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5ac2267e-b07f-4ec0-8d1e-bee1900c64e6 tempest-VolumeQuotasAdminTestJSON-793974590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10c9be29-4bc2-440d-99ff-2bea6b89dc5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:05:28 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-5ac2267e-b07f-4ec0-8d1e-bee1900c64e6 tempest-VolumeQuotasAdminTestJSON-793974590 None] Volume volume-cc1b0205-19dd-400b-9f43-32f05cbbe937 (cc1b0205-19dd-400b-9f43-32f05cbbe937): created successfully
Apr 28 22:05:28 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5ac2267e-b07f-4ec0-8d1e-bee1900c64e6 tempest-VolumeQuotasAdminTestJSON-793974590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10c9be29-4bc2-440d-99ff-2bea6b89dc5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:05:28 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5ac2267e-b07f-4ec0-8d1e-bee1900c64e6 tempest-VolumeQuotasAdminTestJSON-793974590 None] Flow 'volume_create_manager' (d5b43564-0e55-472d-9016-d6fde67d684d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:05:28 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-5ac2267e-b07f-4ec0-8d1e-bee1900c64e6 tempest-VolumeQuotasAdminTestJSON-793974590 None] Created volume successfully.
Apr 28 22:05:29 devstack sudo[86191]: pam_unix(sudo:session): session closed for user root
Apr 28 22:05:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-fa0f11be-29d0-43f1-bd63-2680a867ae4e tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9c239306-b515-49d3-b9c3-35898dbe06f6.2302b874-2f0d-4e81-a40d-b3d09073daad" returned: 0 in 1.606s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:05:29 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-fa0f11be-29d0-43f1-bd63-2680a867ae4e tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c239306-b515-49d3-b9c3-35898dbe06f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 22:05:29 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a4ea69-ba5f-4fd9-ba72-aea73ec6700a]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:05:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-fa0f11be-29d0-43f1-bd63-2680a867ae4e tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9c239306-b515-49d3-b9c3-35898dbe06f6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:05:30 devstack sudo[86236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9c239306-b515-49d3-b9c3-35898dbe06f6
Apr 28 22:05:30 devstack sudo[86236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:05:31 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-fbfe0609-0997-4a39-8513-f69218f5e8cd tempest-VolumeQuotasAdminTestJSON-720040285 None] Transfer volume completed successfully.
Apr 28 22:05:31 devstack sudo[86236]: pam_unix(sudo:session): session closed for user root
Apr 28 22:05:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-fa0f11be-29d0-43f1-bd63-2680a867ae4e tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9c239306-b515-49d3-b9c3-35898dbe06f6" returned: 0 in 1.576s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:05:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-fa0f11be-29d0-43f1-bd63-2680a867ae4e tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9c239306-b515-49d3-b9c3-35898dbe06f6.2302b874-2f0d-4e81-a40d-b3d09073daad {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:05:31 devstack sudo[86304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9c239306-b515-49d3-b9c3-35898dbe06f6.2302b874-2f0d-4e81-a40d-b3d09073daad
Apr 28 22:05:31 devstack sudo[86304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:05:32 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-adb6536a-13ed-4612-b652-266461202d50 tempest-VolumeQuotasAdminTestJSON-1783746676 None] Acquiring lock "cinder-cc1b0205-19dd-400b-9f43-32f05cbbe937-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:05:32 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-adb6536a-13ed-4612-b652-266461202d50 tempest-VolumeQuotasAdminTestJSON-1783746676 None] Lock "cinder-cc1b0205-19dd-400b-9f43-32f05cbbe937-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:05:32 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-adb6536a-13ed-4612-b652-266461202d50 tempest-VolumeQuotasAdminTestJSON-1783746676 None] Acquiring lock "cinder-quobyte-cc1b0205-19dd-400b-9f43-32f05cbbe937" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:05:32 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-adb6536a-13ed-4612-b652-266461202d50 tempest-VolumeQuotasAdminTestJSON-1783746676 None] Lock "cinder-quobyte-cc1b0205-19dd-400b-9f43-32f05cbbe937" acquired by "delete_volume" :: waited 0.032s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:05:32 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b13ca28-59d8-4501-a0b5-f36772c53ec1]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:05:32 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-adb6536a-13ed-4612-b652-266461202d50 tempest-VolumeQuotasAdminTestJSON-1783746676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cc1b0205-19dd-400b-9f43-32f05cbbe937 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:05:33 devstack sudo[86316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cc1b0205-19dd-400b-9f43-32f05cbbe937
Apr 28 22:05:33 devstack sudo[86316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:05:33 devstack sudo[86304]: pam_unix(sudo:session): session closed for user root
Apr 28 22:05:33 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-fa0f11be-29d0-43f1-bd63-2680a867ae4e tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9c239306-b515-49d3-b9c3-35898dbe06f6.2302b874-2f0d-4e81-a40d-b3d09073daad" returned: 0 in 1.809s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:05:33 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-fa0f11be-29d0-43f1-bd63-2680a867ae4e tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9c239306-b515-49d3-b9c3-35898dbe06f6.2302b874-2f0d-4e81-a40d-b3d09073daad {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:05:33 devstack sudo[86318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9c239306-b515-49d3-b9c3-35898dbe06f6.2302b874-2f0d-4e81-a40d-b3d09073daad
Apr 28 22:05:33 devstack sudo[86318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:05:34 devstack sudo[86316]: pam_unix(sudo:session): session closed for user root
Apr 28 22:05:34 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-adb6536a-13ed-4612-b652-266461202d50 tempest-VolumeQuotasAdminTestJSON-1783746676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cc1b0205-19dd-400b-9f43-32f05cbbe937" returned: 0 in 1.482s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:05:34 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-adb6536a-13ed-4612-b652-266461202d50 tempest-VolumeQuotasAdminTestJSON-1783746676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cc1b0205-19dd-400b-9f43-32f05cbbe937 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:05:34 devstack sudo[86324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cc1b0205-19dd-400b-9f43-32f05cbbe937
Apr 28 22:05:34 devstack sudo[86324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:05:34 devstack sudo[86318]: pam_unix(sudo:session): session closed for user root
Apr 28 22:05:34 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-fa0f11be-29d0-43f1-bd63-2680a867ae4e tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9c239306-b515-49d3-b9c3-35898dbe06f6.2302b874-2f0d-4e81-a40d-b3d09073daad" returned: 0 in 1.442s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:05:34 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-fa0f11be-29d0-43f1-bd63-2680a867ae4e tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Lock "cinder-quobyte-2302b874-2f0d-4e81-a40d-b3d09073daad" released by "_delete_snapshot" :: held 6.730s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:05:34 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-fa0f11be-29d0-43f1-bd63-2680a867ae4e tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Lock "cinder-quobyte-9c239306-b515-49d3-b9c3-35898dbe06f6" released by "delete_snapshot" :: held 6.789s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:05:34 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-fa0f11be-29d0-43f1-bd63-2680a867ae4e tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Created reservations ['8b8211bd-4942-46c1-bec2-fb0e4692a7c1', '985f0443-61fc-4ce1-b006-cfbd7b0763a6', '7362fd25-abc2-4ae8-a9e1-9a7cb590a1df', '9e8d85ab-75ae-4552-bdca-d9c0b66a647e'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:05:35 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-fa0f11be-29d0-43f1-bd63-2680a867ae4e tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Delete snapshot completed successfully.
Apr 28 22:05:35 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-fa0f11be-29d0-43f1-bd63-2680a867ae4e tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Lock "cinder-2302b874-2f0d-4e81-a40d-b3d09073daad-delete_snapshot" released by "delete_snapshot" :: held 7.262s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:05:35 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-3f94b68b-f242-482b-b43b-1e7014d04163 tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Acquiring lock "cinder-9c239306-b515-49d3-b9c3-35898dbe06f6-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:05:35 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-3f94b68b-f242-482b-b43b-1e7014d04163 tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Lock "cinder-9c239306-b515-49d3-b9c3-35898dbe06f6-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:05:35 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-3f94b68b-f242-482b-b43b-1e7014d04163 tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Acquiring lock "cinder-quobyte-9c239306-b515-49d3-b9c3-35898dbe06f6" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:05:35 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-3f94b68b-f242-482b-b43b-1e7014d04163 tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Lock "cinder-quobyte-9c239306-b515-49d3-b9c3-35898dbe06f6" acquired by "delete_volume" :: waited 0.039s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:05:36 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[70150c1c-63e0-40c5-95bb-efa2a7862c3f]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:05:36 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-3f94b68b-f242-482b-b43b-1e7014d04163 tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9c239306-b515-49d3-b9c3-35898dbe06f6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:05:36 devstack sudo[86324]: pam_unix(sudo:session): session closed for user root
Apr 28 22:05:36 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-adb6536a-13ed-4612-b652-266461202d50 tempest-VolumeQuotasAdminTestJSON-1783746676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cc1b0205-19dd-400b-9f43-32f05cbbe937" returned: 0 in 1.763s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:05:36 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-adb6536a-13ed-4612-b652-266461202d50 tempest-VolumeQuotasAdminTestJSON-1783746676 None] Lock "cinder-quobyte-cc1b0205-19dd-400b-9f43-32f05cbbe937" released by "delete_volume" :: held 3.339s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:05:36 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-adb6536a-13ed-4612-b652-266461202d50 tempest-VolumeQuotasAdminTestJSON-1783746676 None] Created reservations ['4ec5b33e-50cb-4528-989f-ef6629be0eaf', '55f96470-01f1-492d-8741-cd23ffec6d5b', '42624afc-c480-44bf-b314-b08a564fb408', '28f7c147-0612-4d85-9368-d75e377384d8'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:05:36 devstack sudo[86334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9c239306-b515-49d3-b9c3-35898dbe06f6
Apr 28 22:05:36 devstack sudo[86334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:05:36 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-adb6536a-13ed-4612-b652-266461202d50 tempest-VolumeQuotasAdminTestJSON-1783746676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:05:36 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-adb6536a-13ed-4612-b652-266461202d50 tempest-VolumeQuotasAdminTestJSON-1783746676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:05:36 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-adb6536a-13ed-4612-b652-266461202d50 tempest-VolumeQuotasAdminTestJSON-1783746676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:05:36 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-adb6536a-13ed-4612-b652-266461202d50 tempest-VolumeQuotasAdminTestJSON-1783746676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:05:36 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-adb6536a-13ed-4612-b652-266461202d50 tempest-VolumeQuotasAdminTestJSON-1783746676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:05:36 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-adb6536a-13ed-4612-b652-266461202d50 tempest-VolumeQuotasAdminTestJSON-1783746676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:05:36 devstack sudo[86341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:05:36 devstack sudo[86341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:05:38 devstack sudo[86341]: pam_unix(sudo:session): session closed for user root
Apr 28 22:05:38 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-adb6536a-13ed-4612-b652-266461202d50 tempest-VolumeQuotasAdminTestJSON-1783746676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 2.114s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:05:38 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-adb6536a-13ed-4612-b652-266461202d50 tempest-VolumeQuotasAdminTestJSON-1783746676 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:05:38 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-adb6536a-13ed-4612-b652-266461202d50 tempest-VolumeQuotasAdminTestJSON-1783746676 None] Deleted volume successfully.
Apr 28 22:05:38 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-adb6536a-13ed-4612-b652-266461202d50 tempest-VolumeQuotasAdminTestJSON-1783746676 None] Lock "cinder-cc1b0205-19dd-400b-9f43-32f05cbbe937-delete_volume" released by "delete_volume" :: held 6.068s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:05:38 devstack sudo[86334]: pam_unix(sudo:session): session closed for user root
Apr 28 22:05:38 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-3f94b68b-f242-482b-b43b-1e7014d04163 tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9c239306-b515-49d3-b9c3-35898dbe06f6" returned: 0 in 2.777s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:05:38 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-3f94b68b-f242-482b-b43b-1e7014d04163 tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9c239306-b515-49d3-b9c3-35898dbe06f6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:05:38 devstack sudo[86364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9c239306-b515-49d3-b9c3-35898dbe06f6
Apr 28 22:05:38 devstack sudo[86364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:05:39 devstack cinder-volume[83924]: DEBUG oslo_service.periodic_task [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83924) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 28 22:05:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:05:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:05:39 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:05:39 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:05:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:05:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:05:39 devstack sudo[86398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:05:39 devstack sudo[86398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:05:40 devstack sudo[86364]: pam_unix(sudo:session): session closed for user root
Apr 28 22:05:40 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-3f94b68b-f242-482b-b43b-1e7014d04163 tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9c239306-b515-49d3-b9c3-35898dbe06f6" returned: 0 in 1.962s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:05:40 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-3f94b68b-f242-482b-b43b-1e7014d04163 tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Lock "cinder-quobyte-9c239306-b515-49d3-b9c3-35898dbe06f6" released by "delete_volume" :: held 4.910s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:05:40 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-3f94b68b-f242-482b-b43b-1e7014d04163 tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Created reservations ['fff6ce35-6ff8-481e-be51-488dc926eaf6', '89768874-dd10-44aa-b86f-be0111738928', 'e724395f-0efd-4673-81ec-0d890525775d', '9e713779-71dc-42ae-a5d5-92b7e8048b15'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:05:41 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-3f94b68b-f242-482b-b43b-1e7014d04163 tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:05:41 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-3f94b68b-f242-482b-b43b-1e7014d04163 tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:05:41 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-3f94b68b-f242-482b-b43b-1e7014d04163 tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:05:41 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-3f94b68b-f242-482b-b43b-1e7014d04163 tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:05:41 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-3f94b68b-f242-482b-b43b-1e7014d04163 tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:05:41 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-3f94b68b-f242-482b-b43b-1e7014d04163 tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:05:41 devstack sudo[86436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:05:41 devstack sudo[86436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:05:41 devstack sudo[86398]: pam_unix(sudo:session): session closed for user root
Apr 28 22:05:41 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 2.208s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:05:41 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:05:42 devstack sudo[86436]: pam_unix(sudo:session): session closed for user root
Apr 28 22:05:42 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-3f94b68b-f242-482b-b43b-1e7014d04163 tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 1.541s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:05:42 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-3f94b68b-f242-482b-b43b-1e7014d04163 tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:05:42 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-3f94b68b-f242-482b-b43b-1e7014d04163 tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Deleted volume successfully.
Apr 28 22:05:42 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-3f94b68b-f242-482b-b43b-1e7014d04163 tempest-VolumeSnapshotQuotasNegativeTestJSON-2063468729 None] Lock "cinder-9c239306-b515-49d3-b9c3-35898dbe06f6-delete_volume" released by "delete_volume" :: held 7.134s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:05:45 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-e92820ce-9123-4e86-a53f-0731288439fe tempest-ServerRescueNegativeTestJSON-559848821 None] Acquiring lock "cinder-e72bcb8a-27ca-4f95-b50a-abcaec43971b-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:05:45 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-e92820ce-9123-4e86-a53f-0731288439fe tempest-ServerRescueNegativeTestJSON-559848821 None] Lock "cinder-e72bcb8a-27ca-4f95-b50a-abcaec43971b-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:05:45 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-e92820ce-9123-4e86-a53f-0731288439fe tempest-ServerRescueNegativeTestJSON-559848821 None] Acquiring lock "cinder-quobyte-e72bcb8a-27ca-4f95-b50a-abcaec43971b" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:05:45 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-e92820ce-9123-4e86-a53f-0731288439fe tempest-ServerRescueNegativeTestJSON-559848821 None] Lock "cinder-quobyte-e72bcb8a-27ca-4f95-b50a-abcaec43971b" acquired by "delete_volume" :: waited 0.026s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:05:45 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a23da20-f4a2-4e19-a338-6328df449c20]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:05:45 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e92820ce-9123-4e86-a53f-0731288439fe tempest-ServerRescueNegativeTestJSON-559848821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-e72bcb8a-27ca-4f95-b50a-abcaec43971b {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:05:45 devstack sudo[86471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-e72bcb8a-27ca-4f95-b50a-abcaec43971b
Apr 28 22:05:45 devstack sudo[86471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:05:46 devstack sudo[86471]: pam_unix(sudo:session): session closed for user root
Apr 28 22:05:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e92820ce-9123-4e86-a53f-0731288439fe tempest-ServerRescueNegativeTestJSON-559848821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-e72bcb8a-27ca-4f95-b50a-abcaec43971b" returned: 0 in 1.500s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:05:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e92820ce-9123-4e86-a53f-0731288439fe tempest-ServerRescueNegativeTestJSON-559848821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-e72bcb8a-27ca-4f95-b50a-abcaec43971b {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:05:46 devstack sudo[86476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-e72bcb8a-27ca-4f95-b50a-abcaec43971b
Apr 28 22:05:46 devstack sudo[86476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:05:47 devstack sudo[86476]: pam_unix(sudo:session): session closed for user root
Apr 28 22:05:47 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e92820ce-9123-4e86-a53f-0731288439fe tempest-ServerRescueNegativeTestJSON-559848821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-e72bcb8a-27ca-4f95-b50a-abcaec43971b" returned: 0 in 1.168s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:05:47 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-e92820ce-9123-4e86-a53f-0731288439fe tempest-ServerRescueNegativeTestJSON-559848821 None] Lock "cinder-quobyte-e72bcb8a-27ca-4f95-b50a-abcaec43971b" released by "delete_volume" :: held 2.744s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:05:48 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-e92820ce-9123-4e86-a53f-0731288439fe tempest-ServerRescueNegativeTestJSON-559848821 None] Created reservations ['9768a611-93e0-46da-8d34-587e5cdbd6a5', '39989267-d2d2-4125-a044-d3e684bd5c65', 'e2cacbc9-9ed9-48f0-980a-3c91e245322b', '6ebfe155-9ad8-4782-8d57-04fdde6c995a'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:05:48 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-e92820ce-9123-4e86-a53f-0731288439fe tempest-ServerRescueNegativeTestJSON-559848821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:05:48 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-e92820ce-9123-4e86-a53f-0731288439fe tempest-ServerRescueNegativeTestJSON-559848821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:05:48 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-e92820ce-9123-4e86-a53f-0731288439fe tempest-ServerRescueNegativeTestJSON-559848821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:05:48 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-e92820ce-9123-4e86-a53f-0731288439fe tempest-ServerRescueNegativeTestJSON-559848821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:05:48 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-e92820ce-9123-4e86-a53f-0731288439fe tempest-ServerRescueNegativeTestJSON-559848821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:05:48 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e92820ce-9123-4e86-a53f-0731288439fe tempest-ServerRescueNegativeTestJSON-559848821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:05:48 devstack sudo[86480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:05:48 devstack sudo[86480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:05:49 devstack sudo[86480]: pam_unix(sudo:session): session closed for user root
Apr 28 22:05:49 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e92820ce-9123-4e86-a53f-0731288439fe tempest-ServerRescueNegativeTestJSON-559848821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 1.571s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:05:49 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-e92820ce-9123-4e86-a53f-0731288439fe tempest-ServerRescueNegativeTestJSON-559848821 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:05:49 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-e92820ce-9123-4e86-a53f-0731288439fe tempest-ServerRescueNegativeTestJSON-559848821 None] Deleted volume successfully.
Apr 28 22:05:49 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-e92820ce-9123-4e86-a53f-0731288439fe tempest-ServerRescueNegativeTestJSON-559848821 None] Lock "cinder-e72bcb8a-27ca-4f95-b50a-abcaec43971b-delete_volume" released by "delete_volume" :: held 4.734s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:05:54 devstack cinder-volume[83924]: DEBUG dbcounter [-] [83924] Writing DB stats cinder:UPDATE=64,cinder:SELECT=52,cinder:INSERT=15,cinder:DELETE=7 {{(pid=83924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 28 22:05:54 devstack cinder-volume[83924]: DEBUG dbcounter [-] [83924] Writing DB stats cinder:SELECT=38,cinder:UPDATE=61,cinder:INSERT=15,cinder:DELETE=4 {{(pid=83924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 28 22:05:54 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec4875b6-f391-4cc6-a397-d0c15e6c17c6 tempest-VolumeTypesAccessTest-438155005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:05:54 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-ec4875b6-f391-4cc6-a397-d0c15e6c17c6 tempest-VolumeTypesAccessTest-438155005 None] Flow 'volume_create_manager' (b2270f64-7945-4273-a5a9-bafce80e7a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:05:54 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-ec4875b6-f391-4cc6-a397-d0c15e6c17c6 tempest-VolumeTypesAccessTest-438155005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b053ab9-3cc1-4df9-a169-0fa1ed0f74e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:05:54 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-ec4875b6-f391-4cc6-a397-d0c15e6c17c6 tempest-VolumeTypesAccessTest-438155005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b053ab9-3cc1-4df9-a169-0fa1ed0f74e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:05:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-20758187',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23af1ad6-b0c0-4353-b088-7992b717c84a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c62dca5d64041a49ae24a73c03a445d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:05:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:05:54Z,use_quota=True,user_id='fa8d3752982f40b5a6078fc0d7f3bb19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42c773d2-565c-492c-9a0b-b811c373c916),volume_type_id=42c773d2-565c-492c-9a0b-b811c373c916)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:05:54 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-ec4875b6-f391-4cc6-a397-d0c15e6c17c6 tempest-VolumeTypesAccessTest-438155005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2901b259-e15b-4342-8984-1f652f181c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:05:54 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-ec4875b6-f391-4cc6-a397-d0c15e6c17c6 tempest-VolumeTypesAccessTest-438155005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2901b259-e15b-4342-8984-1f652f181c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:05:54 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-ec4875b6-f391-4cc6-a397-d0c15e6c17c6 tempest-VolumeTypesAccessTest-438155005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b4e65e2-c882-49c5-82f4-244e1f85c1e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:05:54 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-ec4875b6-f391-4cc6-a397-d0c15e6c17c6 tempest-VolumeTypesAccessTest-438155005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b4e65e2-c882-49c5-82f4-244e1f85c1e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23af1ad6-b0c0-4353-b088-7992b717c84a', 'volume_name': 'volume-23af1ad6-b0c0-4353-b088-7992b717c84a', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:05:54 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-ec4875b6-f391-4cc6-a397-d0c15e6c17c6 tempest-VolumeTypesAccessTest-438155005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa3cb3f3-74b2-4eb0-855f-e9bdf413a3ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:05:54 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-ec4875b6-f391-4cc6-a397-d0c15e6c17c6 tempest-VolumeTypesAccessTest-438155005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa3cb3f3-74b2-4eb0-855f-e9bdf413a3ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:05:54 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-ec4875b6-f391-4cc6-a397-d0c15e6c17c6 tempest-VolumeTypesAccessTest-438155005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37f3be6b-8927-4517-9cf1-406e09837977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:05:54 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-ec4875b6-f391-4cc6-a397-d0c15e6c17c6 tempest-VolumeTypesAccessTest-438155005 None] Volume 23af1ad6-b0c0-4353-b088-7992b717c84a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23af1ad6-b0c0-4353-b088-7992b717c84a', 'volume_size': 1}
Apr 28 22:05:54 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-ec4875b6-f391-4cc6-a397-d0c15e6c17c6 tempest-VolumeTypesAccessTest-438155005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:05:54 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-ec4875b6-f391-4cc6-a397-d0c15e6c17c6 tempest-VolumeTypesAccessTest-438155005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:05:54 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-ec4875b6-f391-4cc6-a397-d0c15e6c17c6 tempest-VolumeTypesAccessTest-438155005 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:05:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-20758187',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23af1ad6-b0c0-4353-b088-7992b717c84a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c62dca5d64041a49ae24a73c03a445d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:05:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:05:54Z,use_quota=True,user_id='fa8d3752982f40b5a6078fc0d7f3bb19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42c773d2-565c-492c-9a0b-b811c373c916),volume_type_id=42c773d2-565c-492c-9a0b-b811c373c916)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:05:54 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-ec4875b6-f391-4cc6-a397-d0c15e6c17c6 tempest-VolumeTypesAccessTest-438155005 None] Creating volume 23af1ad6-b0c0-4353-b088-7992b717c84a {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:05:54 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-ec4875b6-f391-4cc6-a397-d0c15e6c17c6 tempest-VolumeTypesAccessTest-438155005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:05:54 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-ec4875b6-f391-4cc6-a397-d0c15e6c17c6 tempest-VolumeTypesAccessTest-438155005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:05:54 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-ec4875b6-f391-4cc6-a397-d0c15e6c17c6 tempest-VolumeTypesAccessTest-438155005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:05:54 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-ec4875b6-f391-4cc6-a397-d0c15e6c17c6 tempest-VolumeTypesAccessTest-438155005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:05:54 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-ec4875b6-f391-4cc6-a397-d0c15e6c17c6 tempest-VolumeTypesAccessTest-438155005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:05:54 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-ec4875b6-f391-4cc6-a397-d0c15e6c17c6 tempest-VolumeTypesAccessTest-438155005 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:05:54 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-ec4875b6-f391-4cc6-a397-d0c15e6c17c6 tempest-VolumeTypesAccessTest-438155005 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:05:54 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-ec4875b6-f391-4cc6-a397-d0c15e6c17c6 tempest-VolumeTypesAccessTest-438155005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-23af1ad6-b0c0-4353-b088-7992b717c84a 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:05:54 devstack sudo[86522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-23af1ad6-b0c0-4353-b088-7992b717c84a 1073741824
Apr 28 22:05:54 devstack sudo[86522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:05:55 devstack sudo[86522]: pam_unix(sudo:session): session closed for user root
Apr 28 22:05:55 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-ec4875b6-f391-4cc6-a397-d0c15e6c17c6 tempest-VolumeTypesAccessTest-438155005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-23af1ad6-b0c0-4353-b088-7992b717c84a 1073741824" returned: 0 in 1.173s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:05:55 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-ec4875b6-f391-4cc6-a397-d0c15e6c17c6 tempest-VolumeTypesAccessTest-438155005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-23af1ad6-b0c0-4353-b088-7992b717c84a {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:05:55 devstack sudo[86528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-23af1ad6-b0c0-4353-b088-7992b717c84a
Apr 28 22:05:55 devstack sudo[86528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:05:56 devstack sudo[86528]: pam_unix(sudo:session): session closed for user root
Apr 28 22:05:56 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-ec4875b6-f391-4cc6-a397-d0c15e6c17c6 tempest-VolumeTypesAccessTest-438155005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-23af1ad6-b0c0-4353-b088-7992b717c84a" returned: 0 in 0.886s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:05:56 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-ec4875b6-f391-4cc6-a397-d0c15e6c17c6 tempest-VolumeTypesAccessTest-438155005 None] <== create_volume: return (2111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:05:56 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-ec4875b6-f391-4cc6-a397-d0c15e6c17c6 tempest-VolumeTypesAccessTest-438155005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.117s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:05:56 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-ec4875b6-f391-4cc6-a397-d0c15e6c17c6 tempest-VolumeTypesAccessTest-438155005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37f3be6b-8927-4517-9cf1-406e09837977) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23af1ad6-b0c0-4353-b088-7992b717c84a', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:05:56 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-ec4875b6-f391-4cc6-a397-d0c15e6c17c6 tempest-VolumeTypesAccessTest-438155005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d8411cf-df5b-4a72-91f5-5a0ceff3992c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:05:56 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-ec4875b6-f391-4cc6-a397-d0c15e6c17c6 tempest-VolumeTypesAccessTest-438155005 None] Volume volume-23af1ad6-b0c0-4353-b088-7992b717c84a (23af1ad6-b0c0-4353-b088-7992b717c84a): created successfully
Apr 28 22:05:56 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-ec4875b6-f391-4cc6-a397-d0c15e6c17c6 tempest-VolumeTypesAccessTest-438155005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d8411cf-df5b-4a72-91f5-5a0ceff3992c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:05:56 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-ec4875b6-f391-4cc6-a397-d0c15e6c17c6 tempest-VolumeTypesAccessTest-438155005 None] Flow 'volume_create_manager' (b2270f64-7945-4273-a5a9-bafce80e7a53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:05:56 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-ec4875b6-f391-4cc6-a397-d0c15e6c17c6 tempest-VolumeTypesAccessTest-438155005 None] Created volume successfully.
Apr 28 22:05:57 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [req-f7efa341-6844-46bb-91db-e880b8d0d8dc req-18c88c27-5a9f-4bc8-ae75-321e18211fcd tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:05:57 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [req-f7efa341-6844-46bb-91db-e880b8d0d8dc req-18c88c27-5a9f-4bc8-ae75-321e18211fcd tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Flow 'volume_create_manager' (6f789c7a-50d3-4007-8009-ed7b5c67284e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:05:57 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [req-f7efa341-6844-46bb-91db-e880b8d0d8dc req-18c88c27-5a9f-4bc8-ae75-321e18211fcd tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16d0e836-9a49-48c6-88b7-c9ce89222582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:05:57 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [req-f7efa341-6844-46bb-91db-e880b8d0d8dc req-18c88c27-5a9f-4bc8-ae75-321e18211fcd tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16d0e836-9a49-48c6-88b7-c9ce89222582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:05:57Z,deleted=False,deleted_at=None,display_description='',display_name='4b7dc800-a5f1-43d5-8ec0-d291717f8b91-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a122e8c-02e6-47d9-9335-2d8152235f47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ba6df43df164b399be36dcf6b7e9b24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:05:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:05:57Z,use_quota=True,user_id='24b64e2dfae54a799b1d01a1b58253a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:05:57 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [req-f7efa341-6844-46bb-91db-e880b8d0d8dc req-18c88c27-5a9f-4bc8-ae75-321e18211fcd tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77319bb2-4e8c-4334-a452-e1f2471b748f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:05:57 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [req-f7efa341-6844-46bb-91db-e880b8d0d8dc req-18c88c27-5a9f-4bc8-ae75-321e18211fcd tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77319bb2-4e8c-4334-a452-e1f2471b748f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:05:57 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [req-f7efa341-6844-46bb-91db-e880b8d0d8dc req-18c88c27-5a9f-4bc8-ae75-321e18211fcd tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4016aa84-6480-4092-9087-20b205fe2ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:05:57 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [req-f7efa341-6844-46bb-91db-e880b8d0d8dc req-18c88c27-5a9f-4bc8-ae75-321e18211fcd tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4016aa84-6480-4092-9087-20b205fe2ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a122e8c-02e6-47d9-9335-2d8152235f47', 'volume_name': 'volume-0a122e8c-02e6-47d9-9335-2d8152235f47', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:05:57 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [req-f7efa341-6844-46bb-91db-e880b8d0d8dc req-18c88c27-5a9f-4bc8-ae75-321e18211fcd tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65e255c5-930a-49e8-8e4d-1734475050f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:05:57 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [req-f7efa341-6844-46bb-91db-e880b8d0d8dc req-18c88c27-5a9f-4bc8-ae75-321e18211fcd tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65e255c5-930a-49e8-8e4d-1734475050f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:05:57 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [req-f7efa341-6844-46bb-91db-e880b8d0d8dc req-18c88c27-5a9f-4bc8-ae75-321e18211fcd tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb9a64b4-129f-427c-93cb-4855ec015369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:05:57 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [req-f7efa341-6844-46bb-91db-e880b8d0d8dc req-18c88c27-5a9f-4bc8-ae75-321e18211fcd tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Volume 0a122e8c-02e6-47d9-9335-2d8152235f47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a122e8c-02e6-47d9-9335-2d8152235f47', 'volume_size': 1}
Apr 28 22:05:57 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [req-f7efa341-6844-46bb-91db-e880b8d0d8dc req-18c88c27-5a9f-4bc8-ae75-321e18211fcd tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:05:57 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [req-f7efa341-6844-46bb-91db-e880b8d0d8dc req-18c88c27-5a9f-4bc8-ae75-321e18211fcd tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:05:57 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [req-f7efa341-6844-46bb-91db-e880b8d0d8dc req-18c88c27-5a9f-4bc8-ae75-321e18211fcd tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:05:57Z,deleted=False,deleted_at=None,display_description='',display_name='4b7dc800-a5f1-43d5-8ec0-d291717f8b91-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a122e8c-02e6-47d9-9335-2d8152235f47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ba6df43df164b399be36dcf6b7e9b24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:05:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:05:57Z,use_quota=True,user_id='24b64e2dfae54a799b1d01a1b58253a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:05:57 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [req-f7efa341-6844-46bb-91db-e880b8d0d8dc req-18c88c27-5a9f-4bc8-ae75-321e18211fcd tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Creating volume 0a122e8c-02e6-47d9-9335-2d8152235f47 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:05:57 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [req-f7efa341-6844-46bb-91db-e880b8d0d8dc req-18c88c27-5a9f-4bc8-ae75-321e18211fcd tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:05:57 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [req-f7efa341-6844-46bb-91db-e880b8d0d8dc req-18c88c27-5a9f-4bc8-ae75-321e18211fcd tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:05:57 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [req-f7efa341-6844-46bb-91db-e880b8d0d8dc req-18c88c27-5a9f-4bc8-ae75-321e18211fcd tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:05:57 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [req-f7efa341-6844-46bb-91db-e880b8d0d8dc req-18c88c27-5a9f-4bc8-ae75-321e18211fcd tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:05:57 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [req-f7efa341-6844-46bb-91db-e880b8d0d8dc req-18c88c27-5a9f-4bc8-ae75-321e18211fcd tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:05:57 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [req-f7efa341-6844-46bb-91db-e880b8d0d8dc req-18c88c27-5a9f-4bc8-ae75-321e18211fcd tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:05:57 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [req-f7efa341-6844-46bb-91db-e880b8d0d8dc req-18c88c27-5a9f-4bc8-ae75-321e18211fcd tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:05:57 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-f7efa341-6844-46bb-91db-e880b8d0d8dc req-18c88c27-5a9f-4bc8-ae75-321e18211fcd tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-0a122e8c-02e6-47d9-9335-2d8152235f47 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:05:57 devstack sudo[86531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-0a122e8c-02e6-47d9-9335-2d8152235f47 1073741824
Apr 28 22:05:57 devstack sudo[86531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:05:57 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-84359892-2e57-4650-a0e2-2132955b10c7 tempest-VolumeTypesAccessTest-438155005 None] Acquiring lock "cinder-23af1ad6-b0c0-4353-b088-7992b717c84a-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:05:57 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-84359892-2e57-4650-a0e2-2132955b10c7 tempest-VolumeTypesAccessTest-438155005 None] Lock "cinder-23af1ad6-b0c0-4353-b088-7992b717c84a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:05:57 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-84359892-2e57-4650-a0e2-2132955b10c7 tempest-VolumeTypesAccessTest-438155005 None] Acquiring lock "cinder-quobyte-23af1ad6-b0c0-4353-b088-7992b717c84a" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:05:58 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-84359892-2e57-4650-a0e2-2132955b10c7 tempest-VolumeTypesAccessTest-438155005 None] Lock "cinder-quobyte-23af1ad6-b0c0-4353-b088-7992b717c84a" acquired by "delete_volume" :: waited 0.021s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:05:58 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e06a6c-2559-41bb-b986-59a9a47a3963]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:05:58 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-84359892-2e57-4650-a0e2-2132955b10c7 tempest-VolumeTypesAccessTest-438155005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-23af1ad6-b0c0-4353-b088-7992b717c84a {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:05:58 devstack sudo[86537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-23af1ad6-b0c0-4353-b088-7992b717c84a
Apr 28 22:05:58 devstack sudo[86537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:05:58 devstack sudo[86531]: pam_unix(sudo:session): session closed for user root
Apr 28 22:05:58 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-f7efa341-6844-46bb-91db-e880b8d0d8dc req-18c88c27-5a9f-4bc8-ae75-321e18211fcd tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-0a122e8c-02e6-47d9-9335-2d8152235f47 1073741824" returned: 0 in 1.240s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:05:58 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-f7efa341-6844-46bb-91db-e880b8d0d8dc req-18c88c27-5a9f-4bc8-ae75-321e18211fcd tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-0a122e8c-02e6-47d9-9335-2d8152235f47 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:05:58 devstack sudo[86570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-0a122e8c-02e6-47d9-9335-2d8152235f47
Apr 28 22:05:58 devstack sudo[86570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:05:59 devstack sudo[86537]: pam_unix(sudo:session): session closed for user root
Apr 28 22:05:59 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-84359892-2e57-4650-a0e2-2132955b10c7 tempest-VolumeTypesAccessTest-438155005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-23af1ad6-b0c0-4353-b088-7992b717c84a" returned: 0 in 1.229s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:05:59 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-84359892-2e57-4650-a0e2-2132955b10c7 tempest-VolumeTypesAccessTest-438155005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-23af1ad6-b0c0-4353-b088-7992b717c84a {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:05:59 devstack sudo[86580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-23af1ad6-b0c0-4353-b088-7992b717c84a
Apr 28 22:05:59 devstack sudo[86580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:05:59 devstack sudo[86570]: pam_unix(sudo:session): session closed for user root
Apr 28 22:05:59 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-f7efa341-6844-46bb-91db-e880b8d0d8dc req-18c88c27-5a9f-4bc8-ae75-321e18211fcd tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-0a122e8c-02e6-47d9-9335-2d8152235f47" returned: 0 in 0.908s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:05:59 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [req-f7efa341-6844-46bb-91db-e880b8d0d8dc req-18c88c27-5a9f-4bc8-ae75-321e18211fcd tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] <== create_volume: return (2242ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:05:59 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [req-f7efa341-6844-46bb-91db-e880b8d0d8dc req-18c88c27-5a9f-4bc8-ae75-321e18211fcd tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.252s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:05:59 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [req-f7efa341-6844-46bb-91db-e880b8d0d8dc req-18c88c27-5a9f-4bc8-ae75-321e18211fcd tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb9a64b4-129f-427c-93cb-4855ec015369) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a122e8c-02e6-47d9-9335-2d8152235f47', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:05:59 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [req-f7efa341-6844-46bb-91db-e880b8d0d8dc req-18c88c27-5a9f-4bc8-ae75-321e18211fcd tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67ab9d5f-695a-48a5-b3d2-a29fbb00de5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:05:59 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [req-f7efa341-6844-46bb-91db-e880b8d0d8dc req-18c88c27-5a9f-4bc8-ae75-321e18211fcd tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Volume volume-0a122e8c-02e6-47d9-9335-2d8152235f47 (0a122e8c-02e6-47d9-9335-2d8152235f47): created successfully
Apr 28 22:05:59 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [req-f7efa341-6844-46bb-91db-e880b8d0d8dc req-18c88c27-5a9f-4bc8-ae75-321e18211fcd tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67ab9d5f-695a-48a5-b3d2-a29fbb00de5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:05:59 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [req-f7efa341-6844-46bb-91db-e880b8d0d8dc req-18c88c27-5a9f-4bc8-ae75-321e18211fcd tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Flow 'volume_create_manager' (6f789c7a-50d3-4007-8009-ed7b5c67284e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:05:59 devstack cinder-volume[83924]: INFO cinder.volume.manager [req-f7efa341-6844-46bb-91db-e880b8d0d8dc req-18c88c27-5a9f-4bc8-ae75-321e18211fcd tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Created volume successfully.
Apr 28 22:06:00 devstack sudo[86580]: pam_unix(sudo:session): session closed for user root
Apr 28 22:06:00 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-84359892-2e57-4650-a0e2-2132955b10c7 tempest-VolumeTypesAccessTest-438155005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-23af1ad6-b0c0-4353-b088-7992b717c84a" returned: 0 in 0.811s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:06:00 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-84359892-2e57-4650-a0e2-2132955b10c7 tempest-VolumeTypesAccessTest-438155005 None] Lock "cinder-quobyte-23af1ad6-b0c0-4353-b088-7992b717c84a" released by "delete_volume" :: held 2.106s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:06:00 devstack cinder-volume[83924]: WARNING cinder.quota [None req-84359892-2e57-4650-a0e2-2132955b10c7 tempest-VolumeTypesAccessTest-438155005 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-885704303 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-885704303, it is now deprecated. Please use the default quota class for default quota.
Apr 28 22:06:00 devstack cinder-volume[83924]: WARNING cinder.quota [None req-84359892-2e57-4650-a0e2-2132955b10c7 tempest-VolumeTypesAccessTest-438155005 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-885704303 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-885704303, it is now deprecated. Please use the default quota class for default quota.
Apr 28 22:06:00 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-84359892-2e57-4650-a0e2-2132955b10c7 tempest-VolumeTypesAccessTest-438155005 None] Created reservations ['377b9f77-af60-4583-9285-df3fa779879c', '2c0f9ccd-134d-4677-9717-ecc4e92bfb71', 'e42cd5ef-7f93-4769-a7c4-a67982a39b02', 'f9f560a4-f246-4c68-8919-ad7739faba9c'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:06:00 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-84359892-2e57-4650-a0e2-2132955b10c7 tempest-VolumeTypesAccessTest-438155005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:06:00 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-84359892-2e57-4650-a0e2-2132955b10c7 tempest-VolumeTypesAccessTest-438155005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:06:00 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-84359892-2e57-4650-a0e2-2132955b10c7 tempest-VolumeTypesAccessTest-438155005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:06:00 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-84359892-2e57-4650-a0e2-2132955b10c7 tempest-VolumeTypesAccessTest-438155005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:06:00 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-84359892-2e57-4650-a0e2-2132955b10c7 tempest-VolumeTypesAccessTest-438155005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:06:00 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-84359892-2e57-4650-a0e2-2132955b10c7 tempest-VolumeTypesAccessTest-438155005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:06:00 devstack sudo[86585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:06:00 devstack sudo[86585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:06:00 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [req-f7efa341-6844-46bb-91db-e880b8d0d8dc req-91dba35a-6d6c-4e74-bac6-f74da4b81c59 tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:06:00 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [req-f7efa341-6844-46bb-91db-e880b8d0d8dc req-91dba35a-6d6c-4e74-bac6-f74da4b81c59 tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:06:00 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[443a0eaa-168c-429a-84b2-478136a721d5]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:06:00 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-f7efa341-6844-46bb-91db-e880b8d0d8dc req-91dba35a-6d6c-4e74-bac6-f74da4b81c59 tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-0a122e8c-02e6-47d9-9335-2d8152235f47 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:06:01 devstack sudo[86595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-0a122e8c-02e6-47d9-9335-2d8152235f47
Apr 28 22:06:01 devstack sudo[86595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:06:01 devstack sudo[86585]: pam_unix(sudo:session): session closed for user root
Apr 28 22:06:01 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-84359892-2e57-4650-a0e2-2132955b10c7 tempest-VolumeTypesAccessTest-438155005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.909s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:06:01 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-84359892-2e57-4650-a0e2-2132955b10c7 tempest-VolumeTypesAccessTest-438155005 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:06:01 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-84359892-2e57-4650-a0e2-2132955b10c7 tempest-VolumeTypesAccessTest-438155005 None] Deleted volume successfully.
Apr 28 22:06:01 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-84359892-2e57-4650-a0e2-2132955b10c7 tempest-VolumeTypesAccessTest-438155005 None] Lock "cinder-23af1ad6-b0c0-4353-b088-7992b717c84a-delete_volume" released by "delete_volume" :: held 3.395s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:06:01 devstack sudo[86595]: pam_unix(sudo:session): session closed for user root
Apr 28 22:06:01 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-f7efa341-6844-46bb-91db-e880b8d0d8dc req-91dba35a-6d6c-4e74-bac6-f74da4b81c59 tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-0a122e8c-02e6-47d9-9335-2d8152235f47" returned: 0 in 0.866s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:06:01 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [req-f7efa341-6844-46bb-91db-e880b8d0d8dc req-91dba35a-6d6c-4e74-bac6-f74da4b81c59 tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.900s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:06:01 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [req-f7efa341-6844-46bb-91db-e880b8d0d8dc req-91dba35a-6d6c-4e74-bac6-f74da4b81c59 tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2', 'name': 'volume-0a122e8c-02e6-47d9-9335-2d8152235f47', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4dabfda4-2b34-4daa-b8aa-bbcf94620ef7', 'enforce_multipath': True} {{(pid=83924) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 28 22:06:01 devstack cinder-volume[83924]: INFO cinder.volume.manager [req-f7efa341-6844-46bb-91db-e880b8d0d8dc req-91dba35a-6d6c-4e74-bac6-f74da4b81c59 tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] attachment_update completed successfully.
Apr 28 22:06:03 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-80bd3322-2313-4986-8bba-b6295fd99598 tempest-VolumesMetadataTest-973382404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:06:03 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-80bd3322-2313-4986-8bba-b6295fd99598 tempest-VolumesMetadataTest-973382404 None] Flow 'volume_create_manager' (d2d8e8ef-8c5a-43b6-9656-a24d9dc153a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:06:03 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-80bd3322-2313-4986-8bba-b6295fd99598 tempest-VolumesMetadataTest-973382404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f2ffc3b-75d6-4444-8b7b-e64b72370804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:06:03 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-80bd3322-2313-4986-8bba-b6295fd99598 tempest-VolumesMetadataTest-973382404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f2ffc3b-75d6-4444-8b7b-e64b72370804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:06:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-791339464',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2542c43-bb14-4594-83f7-d647703575e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57e59ccb254645eba527e8631fa83233',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:06:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:06:04Z,use_quota=True,user_id='0d6313acf38e45d6985f635c7a7796f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:06:03 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-80bd3322-2313-4986-8bba-b6295fd99598 tempest-VolumesMetadataTest-973382404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9da45346-27af-49a4-9bfd-88c811023d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:06:03 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-80bd3322-2313-4986-8bba-b6295fd99598 tempest-VolumesMetadataTest-973382404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9da45346-27af-49a4-9bfd-88c811023d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:06:03 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-80bd3322-2313-4986-8bba-b6295fd99598 tempest-VolumesMetadataTest-973382404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a58cf5a4-79da-4c00-8528-9f89512d48c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:06:03 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-80bd3322-2313-4986-8bba-b6295fd99598 tempest-VolumesMetadataTest-973382404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a58cf5a4-79da-4c00-8528-9f89512d48c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2542c43-bb14-4594-83f7-d647703575e4', 'volume_name': 'volume-d2542c43-bb14-4594-83f7-d647703575e4', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:06:03 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-80bd3322-2313-4986-8bba-b6295fd99598 tempest-VolumesMetadataTest-973382404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87f53bac-8638-4631-837d-e70883d6f15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:06:03 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-80bd3322-2313-4986-8bba-b6295fd99598 tempest-VolumesMetadataTest-973382404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87f53bac-8638-4631-837d-e70883d6f15f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:06:03 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-80bd3322-2313-4986-8bba-b6295fd99598 tempest-VolumesMetadataTest-973382404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a738dc76-4f38-4a6f-97d2-ad462064aa61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:06:03 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-80bd3322-2313-4986-8bba-b6295fd99598 tempest-VolumesMetadataTest-973382404 None] Volume d2542c43-bb14-4594-83f7-d647703575e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2542c43-bb14-4594-83f7-d647703575e4', 'volume_size': 1}
Apr 28 22:06:03 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-80bd3322-2313-4986-8bba-b6295fd99598 tempest-VolumesMetadataTest-973382404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:06:03 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-80bd3322-2313-4986-8bba-b6295fd99598 tempest-VolumesMetadataTest-973382404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:06:03 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-80bd3322-2313-4986-8bba-b6295fd99598 tempest-VolumesMetadataTest-973382404 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:06:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-791339464',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2542c43-bb14-4594-83f7-d647703575e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57e59ccb254645eba527e8631fa83233',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:06:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:06:04Z,use_quota=True,user_id='0d6313acf38e45d6985f635c7a7796f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:06:03 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-80bd3322-2313-4986-8bba-b6295fd99598 tempest-VolumesMetadataTest-973382404 None] Creating volume d2542c43-bb14-4594-83f7-d647703575e4 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:06:03 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-80bd3322-2313-4986-8bba-b6295fd99598 tempest-VolumesMetadataTest-973382404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:06:03 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-80bd3322-2313-4986-8bba-b6295fd99598 tempest-VolumesMetadataTest-973382404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:06:03 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-80bd3322-2313-4986-8bba-b6295fd99598 tempest-VolumesMetadataTest-973382404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:06:03 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-80bd3322-2313-4986-8bba-b6295fd99598 tempest-VolumesMetadataTest-973382404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:06:03 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-80bd3322-2313-4986-8bba-b6295fd99598 tempest-VolumesMetadataTest-973382404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:06:03 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-80bd3322-2313-4986-8bba-b6295fd99598 tempest-VolumesMetadataTest-973382404 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:06:03 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-80bd3322-2313-4986-8bba-b6295fd99598 tempest-VolumesMetadataTest-973382404 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:06:03 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-80bd3322-2313-4986-8bba-b6295fd99598 tempest-VolumesMetadataTest-973382404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-d2542c43-bb14-4594-83f7-d647703575e4 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:06:03 devstack sudo[86603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-d2542c43-bb14-4594-83f7-d647703575e4 1073741824
Apr 28 22:06:03 devstack sudo[86603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:06:04 devstack sudo[86603]: pam_unix(sudo:session): session closed for user root
Apr 28 22:06:04 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-80bd3322-2313-4986-8bba-b6295fd99598 tempest-VolumesMetadataTest-973382404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-d2542c43-bb14-4594-83f7-d647703575e4 1073741824" returned: 0 in 1.110s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:06:05 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-80bd3322-2313-4986-8bba-b6295fd99598 tempest-VolumesMetadataTest-973382404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-d2542c43-bb14-4594-83f7-d647703575e4 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:06:05 devstack sudo[86676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-d2542c43-bb14-4594-83f7-d647703575e4
Apr 28 22:06:05 devstack sudo[86676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:06:05 devstack sudo[86676]: pam_unix(sudo:session): session closed for user root
Apr 28 22:06:05 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-80bd3322-2313-4986-8bba-b6295fd99598 tempest-VolumesMetadataTest-973382404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-d2542c43-bb14-4594-83f7-d647703575e4" returned: 0 in 0.960s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:06:05 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-80bd3322-2313-4986-8bba-b6295fd99598 tempest-VolumesMetadataTest-973382404 None] <== create_volume: return (2141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:06:05 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-80bd3322-2313-4986-8bba-b6295fd99598 tempest-VolumesMetadataTest-973382404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.148s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:06:06 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-80bd3322-2313-4986-8bba-b6295fd99598 tempest-VolumesMetadataTest-973382404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a738dc76-4f38-4a6f-97d2-ad462064aa61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2542c43-bb14-4594-83f7-d647703575e4', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:06:06 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-80bd3322-2313-4986-8bba-b6295fd99598 tempest-VolumesMetadataTest-973382404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (415c5701-e966-4f3e-a125-5dc26de951e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:06:06 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-80bd3322-2313-4986-8bba-b6295fd99598 tempest-VolumesMetadataTest-973382404 None] Volume volume-d2542c43-bb14-4594-83f7-d647703575e4 (d2542c43-bb14-4594-83f7-d647703575e4): created successfully
Apr 28 22:06:06 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-80bd3322-2313-4986-8bba-b6295fd99598 tempest-VolumesMetadataTest-973382404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (415c5701-e966-4f3e-a125-5dc26de951e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:06:06 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-80bd3322-2313-4986-8bba-b6295fd99598 tempest-VolumesMetadataTest-973382404 None] Flow 'volume_create_manager' (d2d8e8ef-8c5a-43b6-9656-a24d9dc153a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:06:06 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-80bd3322-2313-4986-8bba-b6295fd99598 tempest-VolumesMetadataTest-973382404 None] Created volume successfully.
Apr 28 22:06:08 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-159fdfcd-e072-4b91-a3a6-d7686fb0e0c3 tempest-VolumesMetadataTest-973382404 None] Acquiring lock "cinder-d2542c43-bb14-4594-83f7-d647703575e4-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:06:08 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-159fdfcd-e072-4b91-a3a6-d7686fb0e0c3 tempest-VolumesMetadataTest-973382404 None] Lock "cinder-d2542c43-bb14-4594-83f7-d647703575e4-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:06:08 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-159fdfcd-e072-4b91-a3a6-d7686fb0e0c3 tempest-VolumesMetadataTest-973382404 None] Acquiring lock "cinder-quobyte-d2542c43-bb14-4594-83f7-d647703575e4" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:06:08 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-159fdfcd-e072-4b91-a3a6-d7686fb0e0c3 tempest-VolumesMetadataTest-973382404 None] Lock "cinder-quobyte-d2542c43-bb14-4594-83f7-d647703575e4" acquired by "delete_volume" :: waited 0.026s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:06:08 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f208fbb-c0ee-4ab1-b65b-958845e00ef5]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:06:08 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-159fdfcd-e072-4b91-a3a6-d7686fb0e0c3 tempest-VolumesMetadataTest-973382404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-d2542c43-bb14-4594-83f7-d647703575e4 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:06:08 devstack sudo[87032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-d2542c43-bb14-4594-83f7-d647703575e4
Apr 28 22:06:08 devstack sudo[87032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:06:09 devstack sudo[87032]: pam_unix(sudo:session): session closed for user root
Apr 28 22:06:09 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-159fdfcd-e072-4b91-a3a6-d7686fb0e0c3 tempest-VolumesMetadataTest-973382404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-d2542c43-bb14-4594-83f7-d647703575e4" returned: 0 in 1.011s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:06:09 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-159fdfcd-e072-4b91-a3a6-d7686fb0e0c3 tempest-VolumesMetadataTest-973382404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-d2542c43-bb14-4594-83f7-d647703575e4 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:06:09 devstack sudo[87038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-d2542c43-bb14-4594-83f7-d647703575e4
Apr 28 22:06:09 devstack sudo[87038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:06:10 devstack sudo[87038]: pam_unix(sudo:session): session closed for user root
Apr 28 22:06:10 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-159fdfcd-e072-4b91-a3a6-d7686fb0e0c3 tempest-VolumesMetadataTest-973382404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-d2542c43-bb14-4594-83f7-d647703575e4" returned: 0 in 0.939s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:06:10 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-159fdfcd-e072-4b91-a3a6-d7686fb0e0c3 tempest-VolumesMetadataTest-973382404 None] Lock "cinder-quobyte-d2542c43-bb14-4594-83f7-d647703575e4" released by "delete_volume" :: held 2.037s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:06:10 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-159fdfcd-e072-4b91-a3a6-d7686fb0e0c3 tempest-VolumesMetadataTest-973382404 None] Created reservations ['543a3b18-001d-468b-b0f9-87a3ecc213d5', '4d5a4ab9-83b4-4280-b9e8-8fe1c40fc98b', '1d6e4eea-1e61-42b2-8511-34019162b569', 'd123e22b-5c1d-4ba7-8921-967af507893c'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:06:10 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-159fdfcd-e072-4b91-a3a6-d7686fb0e0c3 tempest-VolumesMetadataTest-973382404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:06:10 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-159fdfcd-e072-4b91-a3a6-d7686fb0e0c3 tempest-VolumesMetadataTest-973382404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:06:10 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-159fdfcd-e072-4b91-a3a6-d7686fb0e0c3 tempest-VolumesMetadataTest-973382404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:06:10 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-159fdfcd-e072-4b91-a3a6-d7686fb0e0c3 tempest-VolumesMetadataTest-973382404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:06:10 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-159fdfcd-e072-4b91-a3a6-d7686fb0e0c3 tempest-VolumesMetadataTest-973382404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:06:10 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-159fdfcd-e072-4b91-a3a6-d7686fb0e0c3 tempest-VolumesMetadataTest-973382404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:06:10 devstack sudo[87042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:06:10 devstack sudo[87042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:06:11 devstack sudo[87042]: pam_unix(sudo:session): session closed for user root
Apr 28 22:06:11 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-159fdfcd-e072-4b91-a3a6-d7686fb0e0c3 tempest-VolumesMetadataTest-973382404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.829s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:06:11 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-159fdfcd-e072-4b91-a3a6-d7686fb0e0c3 tempest-VolumesMetadataTest-973382404 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:06:11 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-159fdfcd-e072-4b91-a3a6-d7686fb0e0c3 tempest-VolumesMetadataTest-973382404 None] Deleted volume successfully.
Apr 28 22:06:11 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-159fdfcd-e072-4b91-a3a6-d7686fb0e0c3 tempest-VolumesMetadataTest-973382404 None] Lock "cinder-d2542c43-bb14-4594-83f7-d647703575e4-delete_volume" released by "delete_volume" :: held 3.247s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:06:18 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c14d488-b630-47ef-814e-e170f0b2b74e tempest-VolumesTransfersV355Test-95145218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:06:18 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3c14d488-b630-47ef-814e-e170f0b2b74e tempest-VolumesTransfersV355Test-95145218 None] Flow 'volume_create_manager' (fec595f8-4227-485d-812a-e2dd56f70449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:06:18 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3c14d488-b630-47ef-814e-e170f0b2b74e tempest-VolumesTransfersV355Test-95145218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bde21dd-a72b-4126-be40-b432db1d7747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:06:18 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3c14d488-b630-47ef-814e-e170f0b2b74e tempest-VolumesTransfersV355Test-95145218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bde21dd-a72b-4126-be40-b432db1d7747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:06:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1514050540',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdc50fb7-5e0e-4fd1-b97a-7b0e52fe8879,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45cd4872abdb4b4d868ed0c195db967e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:06:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:06:18Z,use_quota=True,user_id='112a9725de454bd4a2109a483e8ac302',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:06:18 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3c14d488-b630-47ef-814e-e170f0b2b74e tempest-VolumesTransfersV355Test-95145218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a492f2e-7560-47f4-845b-57bc1fdf6bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:06:18 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3c14d488-b630-47ef-814e-e170f0b2b74e tempest-VolumesTransfersV355Test-95145218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a492f2e-7560-47f4-845b-57bc1fdf6bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:06:18 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3c14d488-b630-47ef-814e-e170f0b2b74e tempest-VolumesTransfersV355Test-95145218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9474e71-e9cc-47c2-8853-ea13d60a0a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:06:18 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3c14d488-b630-47ef-814e-e170f0b2b74e tempest-VolumesTransfersV355Test-95145218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9474e71-e9cc-47c2-8853-ea13d60a0a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdc50fb7-5e0e-4fd1-b97a-7b0e52fe8879', 'volume_name': 'volume-cdc50fb7-5e0e-4fd1-b97a-7b0e52fe8879', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:06:18 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3c14d488-b630-47ef-814e-e170f0b2b74e tempest-VolumesTransfersV355Test-95145218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9e71887-93f9-49ce-ba98-f94517dce9b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:06:18 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3c14d488-b630-47ef-814e-e170f0b2b74e tempest-VolumesTransfersV355Test-95145218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9e71887-93f9-49ce-ba98-f94517dce9b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:06:18 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3c14d488-b630-47ef-814e-e170f0b2b74e tempest-VolumesTransfersV355Test-95145218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c38e138e-1ce3-456f-a315-b036fd24fbd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:06:18 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-3c14d488-b630-47ef-814e-e170f0b2b74e tempest-VolumesTransfersV355Test-95145218 None] Volume cdc50fb7-5e0e-4fd1-b97a-7b0e52fe8879: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdc50fb7-5e0e-4fd1-b97a-7b0e52fe8879', 'volume_size': 1}
Apr 28 22:06:18 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-3c14d488-b630-47ef-814e-e170f0b2b74e tempest-VolumesTransfersV355Test-95145218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:06:18 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-3c14d488-b630-47ef-814e-e170f0b2b74e tempest-VolumesTransfersV355Test-95145218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:06:18 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-3c14d488-b630-47ef-814e-e170f0b2b74e tempest-VolumesTransfersV355Test-95145218 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:06:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1514050540',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdc50fb7-5e0e-4fd1-b97a-7b0e52fe8879,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45cd4872abdb4b4d868ed0c195db967e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:06:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:06:18Z,use_quota=True,user_id='112a9725de454bd4a2109a483e8ac302',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:06:18 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-3c14d488-b630-47ef-814e-e170f0b2b74e tempest-VolumesTransfersV355Test-95145218 None] Creating volume cdc50fb7-5e0e-4fd1-b97a-7b0e52fe8879 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:06:18 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-3c14d488-b630-47ef-814e-e170f0b2b74e tempest-VolumesTransfersV355Test-95145218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:06:18 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-3c14d488-b630-47ef-814e-e170f0b2b74e tempest-VolumesTransfersV355Test-95145218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:06:18 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-3c14d488-b630-47ef-814e-e170f0b2b74e tempest-VolumesTransfersV355Test-95145218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:06:18 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-3c14d488-b630-47ef-814e-e170f0b2b74e tempest-VolumesTransfersV355Test-95145218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:06:18 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-3c14d488-b630-47ef-814e-e170f0b2b74e tempest-VolumesTransfersV355Test-95145218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:06:18 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-3c14d488-b630-47ef-814e-e170f0b2b74e tempest-VolumesTransfersV355Test-95145218 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:06:18 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-3c14d488-b630-47ef-814e-e170f0b2b74e tempest-VolumesTransfersV355Test-95145218 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:06:18 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-3c14d488-b630-47ef-814e-e170f0b2b74e tempest-VolumesTransfersV355Test-95145218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cdc50fb7-5e0e-4fd1-b97a-7b0e52fe8879 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:06:18 devstack sudo[87082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cdc50fb7-5e0e-4fd1-b97a-7b0e52fe8879 1073741824
Apr 28 22:06:18 devstack sudo[87082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:06:19 devstack sudo[87082]: pam_unix(sudo:session): session closed for user root
Apr 28 22:06:19 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-3c14d488-b630-47ef-814e-e170f0b2b74e tempest-VolumesTransfersV355Test-95145218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cdc50fb7-5e0e-4fd1-b97a-7b0e52fe8879 1073741824" returned: 0 in 1.123s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:06:19 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-3c14d488-b630-47ef-814e-e170f0b2b74e tempest-VolumesTransfersV355Test-95145218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cdc50fb7-5e0e-4fd1-b97a-7b0e52fe8879 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:06:19 devstack sudo[87115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cdc50fb7-5e0e-4fd1-b97a-7b0e52fe8879
Apr 28 22:06:19 devstack sudo[87115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:06:20 devstack sudo[87115]: pam_unix(sudo:session): session closed for user root
Apr 28 22:06:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-3c14d488-b630-47ef-814e-e170f0b2b74e tempest-VolumesTransfersV355Test-95145218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cdc50fb7-5e0e-4fd1-b97a-7b0e52fe8879" returned: 0 in 0.966s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:06:20 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-3c14d488-b630-47ef-814e-e170f0b2b74e tempest-VolumesTransfersV355Test-95145218 None] <== create_volume: return (2183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:06:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-3c14d488-b630-47ef-814e-e170f0b2b74e tempest-VolumesTransfersV355Test-95145218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.185s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:06:20 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3c14d488-b630-47ef-814e-e170f0b2b74e tempest-VolumesTransfersV355Test-95145218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c38e138e-1ce3-456f-a315-b036fd24fbd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdc50fb7-5e0e-4fd1-b97a-7b0e52fe8879', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:06:20 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3c14d488-b630-47ef-814e-e170f0b2b74e tempest-VolumesTransfersV355Test-95145218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4080089-7df1-43a2-b1a0-cbab1abdc083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:06:20 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-3c14d488-b630-47ef-814e-e170f0b2b74e tempest-VolumesTransfersV355Test-95145218 None] Volume volume-cdc50fb7-5e0e-4fd1-b97a-7b0e52fe8879 (cdc50fb7-5e0e-4fd1-b97a-7b0e52fe8879): created successfully
Apr 28 22:06:20 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3c14d488-b630-47ef-814e-e170f0b2b74e tempest-VolumesTransfersV355Test-95145218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4080089-7df1-43a2-b1a0-cbab1abdc083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:06:20 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3c14d488-b630-47ef-814e-e170f0b2b74e tempest-VolumesTransfersV355Test-95145218 None] Flow 'volume_create_manager' (fec595f8-4227-485d-812a-e2dd56f70449) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:06:20 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-3c14d488-b630-47ef-814e-e170f0b2b74e tempest-VolumesTransfersV355Test-95145218 None] Created volume successfully.
Apr 28 22:06:22 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-b0bcd78a-6661-447d-a27a-356ec22439a0 tempest-VolumesTransfersV355Test-917012457 None] Transfer volume completed successfully.
Apr 28 22:06:23 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-08ca2c19-dbb5-4fae-943b-121fcf035d46 tempest-VolumesTransfersV355Test-376215053 None] Acquiring lock "cinder-cdc50fb7-5e0e-4fd1-b97a-7b0e52fe8879-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:06:23 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-08ca2c19-dbb5-4fae-943b-121fcf035d46 tempest-VolumesTransfersV355Test-376215053 None] Lock "cinder-cdc50fb7-5e0e-4fd1-b97a-7b0e52fe8879-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:06:23 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-08ca2c19-dbb5-4fae-943b-121fcf035d46 tempest-VolumesTransfersV355Test-376215053 None] Acquiring lock "cinder-quobyte-cdc50fb7-5e0e-4fd1-b97a-7b0e52fe8879" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:06:23 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-08ca2c19-dbb5-4fae-943b-121fcf035d46 tempest-VolumesTransfersV355Test-376215053 None] Lock "cinder-quobyte-cdc50fb7-5e0e-4fd1-b97a-7b0e52fe8879" acquired by "delete_volume" :: waited 0.030s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:06:23 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2eee7e4-3882-4d19-a823-c6fda7f8e55e]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:06:23 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-08ca2c19-dbb5-4fae-943b-121fcf035d46 tempest-VolumesTransfersV355Test-376215053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cdc50fb7-5e0e-4fd1-b97a-7b0e52fe8879 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:06:24 devstack sudo[87142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cdc50fb7-5e0e-4fd1-b97a-7b0e52fe8879
Apr 28 22:06:24 devstack sudo[87142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:06:24 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-08ca2c19-dbb5-4fae-943b-121fcf035d46 tempest-VolumesTransfersV355Test-376215053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cdc50fb7-5e0e-4fd1-b97a-7b0e52fe8879" returned: 0 in 1.034s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:06:24 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-08ca2c19-dbb5-4fae-943b-121fcf035d46 tempest-VolumesTransfersV355Test-376215053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cdc50fb7-5e0e-4fd1-b97a-7b0e52fe8879 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:06:24 devstack sudo[87142]: pam_unix(sudo:session): session closed for user root
Apr 28 22:06:24 devstack sudo[87178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cdc50fb7-5e0e-4fd1-b97a-7b0e52fe8879
Apr 28 22:06:24 devstack sudo[87178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:06:25 devstack sudo[87178]: pam_unix(sudo:session): session closed for user root
Apr 28 22:06:25 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-08ca2c19-dbb5-4fae-943b-121fcf035d46 tempest-VolumesTransfersV355Test-376215053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cdc50fb7-5e0e-4fd1-b97a-7b0e52fe8879" returned: 0 in 0.890s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:06:25 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-08ca2c19-dbb5-4fae-943b-121fcf035d46 tempest-VolumesTransfersV355Test-376215053 None] Lock "cinder-quobyte-cdc50fb7-5e0e-4fd1-b97a-7b0e52fe8879" released by "delete_volume" :: held 1.991s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:06:25 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-08ca2c19-dbb5-4fae-943b-121fcf035d46 tempest-VolumesTransfersV355Test-376215053 None] Created reservations ['e4e684c6-a9ea-4d0d-aeb2-71c3afcfeca4', 'ac26e86c-c73c-43a9-9d91-da6819bde40d', '2d3bdbec-6b4d-49f0-bb78-31b05b6a09dc', '99a7a497-4038-4491-bb06-a0430feea643'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:06:26 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-08ca2c19-dbb5-4fae-943b-121fcf035d46 tempest-VolumesTransfersV355Test-376215053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:06:26 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-08ca2c19-dbb5-4fae-943b-121fcf035d46 tempest-VolumesTransfersV355Test-376215053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:06:26 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-08ca2c19-dbb5-4fae-943b-121fcf035d46 tempest-VolumesTransfersV355Test-376215053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:06:26 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-08ca2c19-dbb5-4fae-943b-121fcf035d46 tempest-VolumesTransfersV355Test-376215053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:06:26 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-08ca2c19-dbb5-4fae-943b-121fcf035d46 tempest-VolumesTransfersV355Test-376215053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:06:26 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-08ca2c19-dbb5-4fae-943b-121fcf035d46 tempest-VolumesTransfersV355Test-376215053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:06:26 devstack sudo[87182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:06:26 devstack sudo[87182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:06:26 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-8efda9af-f24c-4cf0-868f-ccfc70531f44 tempest-VolumesTransfersV355Test-95145218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:06:26 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-8efda9af-f24c-4cf0-868f-ccfc70531f44 tempest-VolumesTransfersV355Test-95145218 None] Flow 'volume_create_manager' (8f024d98-2b52-44a1-91c2-9ed336f1dd9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:06:26 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-8efda9af-f24c-4cf0-868f-ccfc70531f44 tempest-VolumesTransfersV355Test-95145218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (578ac09e-7161-4b26-839e-6213660eed0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:06:26 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-8efda9af-f24c-4cf0-868f-ccfc70531f44 tempest-VolumesTransfersV355Test-95145218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (578ac09e-7161-4b26-839e-6213660eed0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:06:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-113924058',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36106fdd-5386-480c-bfbc-32ffca299d11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45cd4872abdb4b4d868ed0c195db967e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:06:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:06:27Z,use_quota=True,user_id='112a9725de454bd4a2109a483e8ac302',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:06:26 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-8efda9af-f24c-4cf0-868f-ccfc70531f44 tempest-VolumesTransfersV355Test-95145218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af5e31e1-1ca6-48bb-83f2-45a33a4279da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:06:26 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-8efda9af-f24c-4cf0-868f-ccfc70531f44 tempest-VolumesTransfersV355Test-95145218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af5e31e1-1ca6-48bb-83f2-45a33a4279da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:06:27 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-8efda9af-f24c-4cf0-868f-ccfc70531f44 tempest-VolumesTransfersV355Test-95145218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eac1baf-9294-4e31-825f-69c2b4a60fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:06:27 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-8efda9af-f24c-4cf0-868f-ccfc70531f44 tempest-VolumesTransfersV355Test-95145218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eac1baf-9294-4e31-825f-69c2b4a60fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36106fdd-5386-480c-bfbc-32ffca299d11', 'volume_name': 'volume-36106fdd-5386-480c-bfbc-32ffca299d11', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:06:27 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-8efda9af-f24c-4cf0-868f-ccfc70531f44 tempest-VolumesTransfersV355Test-95145218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd5b78d1-cf36-4635-a0b1-ad081da551f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:06:27 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-8efda9af-f24c-4cf0-868f-ccfc70531f44 tempest-VolumesTransfersV355Test-95145218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd5b78d1-cf36-4635-a0b1-ad081da551f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:06:27 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-8efda9af-f24c-4cf0-868f-ccfc70531f44 tempest-VolumesTransfersV355Test-95145218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (995c3973-503c-41fe-8879-4fdb82c6ca2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:06:27 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-8efda9af-f24c-4cf0-868f-ccfc70531f44 tempest-VolumesTransfersV355Test-95145218 None] Volume 36106fdd-5386-480c-bfbc-32ffca299d11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36106fdd-5386-480c-bfbc-32ffca299d11', 'volume_size': 1}
Apr 28 22:06:27 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-8efda9af-f24c-4cf0-868f-ccfc70531f44 tempest-VolumesTransfersV355Test-95145218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:06:27 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-8efda9af-f24c-4cf0-868f-ccfc70531f44 tempest-VolumesTransfersV355Test-95145218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.012s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:06:27 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-8efda9af-f24c-4cf0-868f-ccfc70531f44 tempest-VolumesTransfersV355Test-95145218 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:06:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-113924058',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36106fdd-5386-480c-bfbc-32ffca299d11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45cd4872abdb4b4d868ed0c195db967e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:06:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:06:27Z,use_quota=True,user_id='112a9725de454bd4a2109a483e8ac302',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:06:27 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-8efda9af-f24c-4cf0-868f-ccfc70531f44 tempest-VolumesTransfersV355Test-95145218 None] Creating volume 36106fdd-5386-480c-bfbc-32ffca299d11 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:06:27 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-8efda9af-f24c-4cf0-868f-ccfc70531f44 tempest-VolumesTransfersV355Test-95145218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:06:27 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-8efda9af-f24c-4cf0-868f-ccfc70531f44 tempest-VolumesTransfersV355Test-95145218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:06:27 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-8efda9af-f24c-4cf0-868f-ccfc70531f44 tempest-VolumesTransfersV355Test-95145218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:06:27 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-8efda9af-f24c-4cf0-868f-ccfc70531f44 tempest-VolumesTransfersV355Test-95145218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:06:27 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-8efda9af-f24c-4cf0-868f-ccfc70531f44 tempest-VolumesTransfersV355Test-95145218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:06:27 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-8efda9af-f24c-4cf0-868f-ccfc70531f44 tempest-VolumesTransfersV355Test-95145218 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:06:27 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-8efda9af-f24c-4cf0-868f-ccfc70531f44 tempest-VolumesTransfersV355Test-95145218 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:06:27 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-8efda9af-f24c-4cf0-868f-ccfc70531f44 tempest-VolumesTransfersV355Test-95145218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-36106fdd-5386-480c-bfbc-32ffca299d11 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:06:27 devstack sudo[87219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-36106fdd-5386-480c-bfbc-32ffca299d11 1073741824
Apr 28 22:06:27 devstack sudo[87219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:06:27 devstack sudo[87182]: pam_unix(sudo:session): session closed for user root
Apr 28 22:06:27 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-08ca2c19-dbb5-4fae-943b-121fcf035d46 tempest-VolumesTransfersV355Test-376215053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 1.215s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:06:27 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-08ca2c19-dbb5-4fae-943b-121fcf035d46 tempest-VolumesTransfersV355Test-376215053 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:06:27 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-08ca2c19-dbb5-4fae-943b-121fcf035d46 tempest-VolumesTransfersV355Test-376215053 None] Deleted volume successfully.
Apr 28 22:06:27 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-08ca2c19-dbb5-4fae-943b-121fcf035d46 tempest-VolumesTransfersV355Test-376215053 None] Lock "cinder-cdc50fb7-5e0e-4fd1-b97a-7b0e52fe8879-delete_volume" released by "delete_volume" :: held 3.607s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:06:28 devstack sudo[87219]: pam_unix(sudo:session): session closed for user root
Apr 28 22:06:28 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-8efda9af-f24c-4cf0-868f-ccfc70531f44 tempest-VolumesTransfersV355Test-95145218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-36106fdd-5386-480c-bfbc-32ffca299d11 1073741824" returned: 0 in 1.496s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:06:28 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-8efda9af-f24c-4cf0-868f-ccfc70531f44 tempest-VolumesTransfersV355Test-95145218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-36106fdd-5386-480c-bfbc-32ffca299d11 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:06:28 devstack sudo[87228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-36106fdd-5386-480c-bfbc-32ffca299d11
Apr 28 22:06:28 devstack sudo[87228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:06:29 devstack sudo[87228]: pam_unix(sudo:session): session closed for user root
Apr 28 22:06:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-8efda9af-f24c-4cf0-868f-ccfc70531f44 tempest-VolumesTransfersV355Test-95145218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-36106fdd-5386-480c-bfbc-32ffca299d11" returned: 0 in 1.285s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:06:29 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-8efda9af-f24c-4cf0-868f-ccfc70531f44 tempest-VolumesTransfersV355Test-95145218 None] <== create_volume: return (2850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:06:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-8efda9af-f24c-4cf0-868f-ccfc70531f44 tempest-VolumesTransfersV355Test-95145218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.855s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:06:29 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-8efda9af-f24c-4cf0-868f-ccfc70531f44 tempest-VolumesTransfersV355Test-95145218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (995c3973-503c-41fe-8879-4fdb82c6ca2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36106fdd-5386-480c-bfbc-32ffca299d11', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:06:29 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-8efda9af-f24c-4cf0-868f-ccfc70531f44 tempest-VolumesTransfersV355Test-95145218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9063b9e0-3181-4c12-b789-9ee3fb95ac4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:06:29 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-8efda9af-f24c-4cf0-868f-ccfc70531f44 tempest-VolumesTransfersV355Test-95145218 None] Volume volume-36106fdd-5386-480c-bfbc-32ffca299d11 (36106fdd-5386-480c-bfbc-32ffca299d11): created successfully
Apr 28 22:06:29 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-8efda9af-f24c-4cf0-868f-ccfc70531f44 tempest-VolumesTransfersV355Test-95145218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9063b9e0-3181-4c12-b789-9ee3fb95ac4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:06:30 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-8efda9af-f24c-4cf0-868f-ccfc70531f44 tempest-VolumesTransfersV355Test-95145218 None] Flow 'volume_create_manager' (8f024d98-2b52-44a1-91c2-9ed336f1dd9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:06:30 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-8efda9af-f24c-4cf0-868f-ccfc70531f44 tempest-VolumesTransfersV355Test-95145218 None] Created volume successfully.
Apr 28 22:06:31 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-2849a2e8-e0ee-4ae1-9787-6ca1f19334fb tempest-VolumesTransfersV355Test-376215053 None] Acquiring lock "cinder-36106fdd-5386-480c-bfbc-32ffca299d11-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:06:31 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-2849a2e8-e0ee-4ae1-9787-6ca1f19334fb tempest-VolumesTransfersV355Test-376215053 None] Lock "cinder-36106fdd-5386-480c-bfbc-32ffca299d11-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:06:32 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-2849a2e8-e0ee-4ae1-9787-6ca1f19334fb tempest-VolumesTransfersV355Test-376215053 None] Acquiring lock "cinder-quobyte-36106fdd-5386-480c-bfbc-32ffca299d11" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:06:32 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-2849a2e8-e0ee-4ae1-9787-6ca1f19334fb tempest-VolumesTransfersV355Test-376215053 None] Lock "cinder-quobyte-36106fdd-5386-480c-bfbc-32ffca299d11" acquired by "delete_volume" :: waited 0.027s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:06:32 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[118234a5-6aa6-4dc5-a572-ccd21d32ead9]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:06:32 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-2849a2e8-e0ee-4ae1-9787-6ca1f19334fb tempest-VolumesTransfersV355Test-376215053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-36106fdd-5386-480c-bfbc-32ffca299d11 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:06:32 devstack sudo[87248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-36106fdd-5386-480c-bfbc-32ffca299d11
Apr 28 22:06:32 devstack sudo[87248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:06:33 devstack sudo[87248]: pam_unix(sudo:session): session closed for user root
Apr 28 22:06:33 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-2849a2e8-e0ee-4ae1-9787-6ca1f19334fb tempest-VolumesTransfersV355Test-376215053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-36106fdd-5386-480c-bfbc-32ffca299d11" returned: 0 in 1.220s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:06:33 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-2849a2e8-e0ee-4ae1-9787-6ca1f19334fb tempest-VolumesTransfersV355Test-376215053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-36106fdd-5386-480c-bfbc-32ffca299d11 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:06:33 devstack sudo[87271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-36106fdd-5386-480c-bfbc-32ffca299d11
Apr 28 22:06:33 devstack sudo[87271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:06:34 devstack sudo[87271]: pam_unix(sudo:session): session closed for user root
Apr 28 22:06:34 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-2849a2e8-e0ee-4ae1-9787-6ca1f19334fb tempest-VolumesTransfersV355Test-376215053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-36106fdd-5386-480c-bfbc-32ffca299d11" returned: 0 in 1.025s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:06:34 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-2849a2e8-e0ee-4ae1-9787-6ca1f19334fb tempest-VolumesTransfersV355Test-376215053 None] Lock "cinder-quobyte-36106fdd-5386-480c-bfbc-32ffca299d11" released by "delete_volume" :: held 2.316s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:06:34 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-2849a2e8-e0ee-4ae1-9787-6ca1f19334fb tempest-VolumesTransfersV355Test-376215053 None] Created reservations ['c5cb6e18-3972-4d09-8f2d-9fc80fd041d4', '5b43b6bf-1a15-4ad7-b53b-627d00705807', '42f46ee0-9173-46fe-85f8-816c72a2cfe9', '1fd9379a-9f0e-42c3-bfbd-2fdf8b2fe3fa'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:06:34 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-2849a2e8-e0ee-4ae1-9787-6ca1f19334fb tempest-VolumesTransfersV355Test-376215053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:06:34 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-2849a2e8-e0ee-4ae1-9787-6ca1f19334fb tempest-VolumesTransfersV355Test-376215053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:06:34 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-2849a2e8-e0ee-4ae1-9787-6ca1f19334fb tempest-VolumesTransfersV355Test-376215053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:06:34 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-2849a2e8-e0ee-4ae1-9787-6ca1f19334fb tempest-VolumesTransfersV355Test-376215053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:06:34 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-2849a2e8-e0ee-4ae1-9787-6ca1f19334fb tempest-VolumesTransfersV355Test-376215053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:06:34 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-2849a2e8-e0ee-4ae1-9787-6ca1f19334fb tempest-VolumesTransfersV355Test-376215053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:06:34 devstack sudo[87325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:06:34 devstack sudo[87325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:06:34 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-e875610c-424d-4cbb-ae5b-22294bf0f657 tempest-VolumesImageMetadata-1880590418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:06:35 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-e875610c-424d-4cbb-ae5b-22294bf0f657 tempest-VolumesImageMetadata-1880590418 None] Flow 'volume_create_manager' (274f5ebe-c0ec-449d-93ea-f204c2c5fc5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:06:35 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-e875610c-424d-4cbb-ae5b-22294bf0f657 tempest-VolumesImageMetadata-1880590418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (177c9660-da8b-4b9f-b3f1-0c99de361fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:06:35 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-e875610c-424d-4cbb-ae5b-22294bf0f657 tempest-VolumesImageMetadata-1880590418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (177c9660-da8b-4b9f-b3f1-0c99de361fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1027118778',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bc8059c-969e-4685-adc5-6c092f68e5eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd921dcf5ed04bc997793c6d16c2d695',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:06:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:06:35Z,use_quota=True,user_id='96db8eb3603146388272f46eb71b6fc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:06:35 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-e875610c-424d-4cbb-ae5b-22294bf0f657 tempest-VolumesImageMetadata-1880590418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a354318-029c-47db-93d2-560e5371d798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:06:35 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-e875610c-424d-4cbb-ae5b-22294bf0f657 tempest-VolumesImageMetadata-1880590418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a354318-029c-47db-93d2-560e5371d798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:06:35 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-e875610c-424d-4cbb-ae5b-22294bf0f657 tempest-VolumesImageMetadata-1880590418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b3bd2fb-7fa9-46c9-b774-0f05c7d99583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:06:35 devstack cinder-volume[83924]: DEBUG cinder.image.glance [None req-e875610c-424d-4cbb-ae5b-22294bf0f657 tempest-VolumesImageMetadata-1880590418 None] Creating Keystone auth plugin from conf {{(pid=83924) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 28 22:06:35 devstack sudo[87325]: pam_unix(sudo:session): session closed for user root
Apr 28 22:06:35 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-2849a2e8-e0ee-4ae1-9787-6ca1f19334fb tempest-VolumesTransfersV355Test-376215053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 1.289s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:06:35 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-2849a2e8-e0ee-4ae1-9787-6ca1f19334fb tempest-VolumesTransfersV355Test-376215053 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:06:35 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-2849a2e8-e0ee-4ae1-9787-6ca1f19334fb tempest-VolumesTransfersV355Test-376215053 None] Deleted volume successfully.
Apr 28 22:06:35 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-e875610c-424d-4cbb-ae5b-22294bf0f657 tempest-VolumesImageMetadata-1880590418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b3bd2fb-7fa9-46c9-b774-0f05c7d99583) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7bc8059c-969e-4685-adc5-6c092f68e5eb', 'volume_name': 'volume-7bc8059c-969e-4685-adc5-6c092f68e5eb', 'volume_size': 1, 'image_id': 'eea3f98a-f64b-4ae5-950b-6d03ae89a234', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eea3f98a-f64b-4ae5-950b-6d03ae89a234', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c4919824590f4575ada7761aea13c85e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eea3f98a-f64b-4ae5-950b-6d03ae89a234', 'created_at': datetime.datetime(2026, 4, 28, 19, 59, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 19, 59, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eea3f98a-f64b-4ae5-950b-6d03ae89a234/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7844d53a2240>}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:06:36 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-e875610c-424d-4cbb-ae5b-22294bf0f657 tempest-VolumesImageMetadata-1880590418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b47acf23-522f-403f-ba04-1ef78ef101aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:06:36 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-e875610c-424d-4cbb-ae5b-22294bf0f657 tempest-VolumesImageMetadata-1880590418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b47acf23-522f-403f-ba04-1ef78ef101aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:06:36 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-e875610c-424d-4cbb-ae5b-22294bf0f657 tempest-VolumesImageMetadata-1880590418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32d7d584-9a75-42dd-9b5b-f17938b57406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:06:36 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-e875610c-424d-4cbb-ae5b-22294bf0f657 tempest-VolumesImageMetadata-1880590418 None] Volume 7bc8059c-969e-4685-adc5-6c092f68e5eb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7bc8059c-969e-4685-adc5-6c092f68e5eb', 'volume_size': 1, 'image_id': 'eea3f98a-f64b-4ae5-950b-6d03ae89a234', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eea3f98a-f64b-4ae5-950b-6d03ae89a234', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c4919824590f4575ada7761aea13c85e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eea3f98a-f64b-4ae5-950b-6d03ae89a234', 'created_at': datetime.datetime(2026, 4, 28, 19, 59, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 19, 59, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eea3f98a-f64b-4ae5-950b-6d03ae89a234/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7844d53a2240>}
Apr 28 22:06:36 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-e875610c-424d-4cbb-ae5b-22294bf0f657 tempest-VolumesImageMetadata-1880590418 None] Trying to clone 7bc8059c-969e-4685-adc5-6c092f68e5eb from image eea3f98a-f64b-4ae5-950b-6d03ae89a234 at location (None, [{'url': 'file:///opt/stack/data/glance/images/eea3f98a-f64b-4ae5-950b-6d03ae89a234', 'metadata': {}}]). {{(pid=83924) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 28 22:06:36 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-2849a2e8-e0ee-4ae1-9787-6ca1f19334fb tempest-VolumesTransfersV355Test-376215053 None] Lock "cinder-36106fdd-5386-480c-bfbc-32ffca299d11-delete_volume" released by "delete_volume" :: held 4.081s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:06:36 devstack cinder-volume[83924]: DEBUG cinder.image.image_utils [None req-e875610c-424d-4cbb-ae5b-22294bf0f657 tempest-VolumesImageMetadata-1880590418 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_eea3f98a-f64b-4ae5-950b-6d03ae89a234_f0p2_kgndevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83924) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 28 22:06:36 devstack cinder-volume[83924]: INFO cinder.image.image_utils [None req-e875610c-424d-4cbb-ae5b-22294bf0f657 tempest-VolumesImageMetadata-1880590418 None] Image download 20.69 MB at 20.69 MB/s
Apr 28 22:06:36 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[137fb297-7c91-4148-a12e-62056fa7b75c]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:06:36 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e875610c-424d-4cbb-ae5b-22294bf0f657 tempest-VolumesImageMetadata-1880590418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eea3f98a-f64b-4ae5-950b-6d03ae89a234_f0p2_kgndevstack@QuobyteHD {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:06:37 devstack sudo[87355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eea3f98a-f64b-4ae5-950b-6d03ae89a234_f0p2_kgndevstack@QuobyteHD
Apr 28 22:06:37 devstack sudo[87355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:06:37 devstack sudo[87355]: pam_unix(sudo:session): session closed for user root
Apr 28 22:06:37 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e875610c-424d-4cbb-ae5b-22294bf0f657 tempest-VolumesImageMetadata-1880590418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eea3f98a-f64b-4ae5-950b-6d03ae89a234_f0p2_kgndevstack@QuobyteHD" returned: 0 in 0.979s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:06:37 devstack cinder-volume[83924]: DEBUG cinder.image.image_utils [None req-e875610c-424d-4cbb-ae5b-22294bf0f657 tempest-VolumesImageMetadata-1880590418 None] Temporary image eea3f98a-f64b-4ae5-950b-6d03ae89a234 is fetched for user 96db8eb3603146388272f46eb71b6fc3. {{(pid=83924) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 28 22:06:37 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa1842d-ddc9-4cf5-8579-5bd45f5d0b36]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:06:37 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e875610c-424d-4cbb-ae5b-22294bf0f657 tempest-VolumesImageMetadata-1880590418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eea3f98a-f64b-4ae5-950b-6d03ae89a234_f0p2_kgndevstack@QuobyteHD {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:06:38 devstack sudo[87377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eea3f98a-f64b-4ae5-950b-6d03ae89a234_f0p2_kgndevstack@QuobyteHD
Apr 28 22:06:38 devstack sudo[87377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:06:38 devstack sudo[87377]: pam_unix(sudo:session): session closed for user root
Apr 28 22:06:38 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e875610c-424d-4cbb-ae5b-22294bf0f657 tempest-VolumesImageMetadata-1880590418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eea3f98a-f64b-4ae5-950b-6d03ae89a234_f0p2_kgndevstack@QuobyteHD" returned: 0 in 0.918s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:06:38 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-e875610c-424d-4cbb-ae5b-22294bf0f657 tempest-VolumesImageMetadata-1880590418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:06:38 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-e875610c-424d-4cbb-ae5b-22294bf0f657 tempest-VolumesImageMetadata-1880590418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:06:38 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-e875610c-424d-4cbb-ae5b-22294bf0f657 tempest-VolumesImageMetadata-1880590418 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1027118778',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bc8059c-969e-4685-adc5-6c092f68e5eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd921dcf5ed04bc997793c6d16c2d695',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:06:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:06:35Z,use_quota=True,user_id='96db8eb3603146388272f46eb71b6fc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:06:38 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-e875610c-424d-4cbb-ae5b-22294bf0f657 tempest-VolumesImageMetadata-1880590418 None] Creating volume 7bc8059c-969e-4685-adc5-6c092f68e5eb {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:06:38 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-e875610c-424d-4cbb-ae5b-22294bf0f657 tempest-VolumesImageMetadata-1880590418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:06:38 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-e875610c-424d-4cbb-ae5b-22294bf0f657 tempest-VolumesImageMetadata-1880590418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:06:38 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-e875610c-424d-4cbb-ae5b-22294bf0f657 tempest-VolumesImageMetadata-1880590418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:06:38 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-e875610c-424d-4cbb-ae5b-22294bf0f657 tempest-VolumesImageMetadata-1880590418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:06:38 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-e875610c-424d-4cbb-ae5b-22294bf0f657 tempest-VolumesImageMetadata-1880590418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:06:38 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-e875610c-424d-4cbb-ae5b-22294bf0f657 tempest-VolumesImageMetadata-1880590418 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:06:38 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-e875610c-424d-4cbb-ae5b-22294bf0f657 tempest-VolumesImageMetadata-1880590418 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:06:38 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e875610c-424d-4cbb-ae5b-22294bf0f657 tempest-VolumesImageMetadata-1880590418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7bc8059c-969e-4685-adc5-6c092f68e5eb 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:06:38 devstack sudo[87385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7bc8059c-969e-4685-adc5-6c092f68e5eb 1073741824
Apr 28 22:06:38 devstack sudo[87385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:06:39 devstack cinder-volume[83924]: DEBUG oslo_service.periodic_task [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83924) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 28 22:06:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:06:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:06:39 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:06:39 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:06:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:06:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:06:39 devstack sudo[87392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:06:39 devstack sudo[87392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:06:39 devstack sudo[87385]: pam_unix(sudo:session): session closed for user root
Apr 28 22:06:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e875610c-424d-4cbb-ae5b-22294bf0f657 tempest-VolumesImageMetadata-1880590418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7bc8059c-969e-4685-adc5-6c092f68e5eb 1073741824" returned: 0 in 1.040s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:06:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e875610c-424d-4cbb-ae5b-22294bf0f657 tempest-VolumesImageMetadata-1880590418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7bc8059c-969e-4685-adc5-6c092f68e5eb {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:06:39 devstack sudo[87394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7bc8059c-969e-4685-adc5-6c092f68e5eb
Apr 28 22:06:39 devstack sudo[87394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:06:40 devstack sudo[87392]: pam_unix(sudo:session): session closed for user root
Apr 28 22:06:40 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.789s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:06:40 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:06:40 devstack sudo[87394]: pam_unix(sudo:session): session closed for user root
Apr 28 22:06:40 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e875610c-424d-4cbb-ae5b-22294bf0f657 tempest-VolumesImageMetadata-1880590418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7bc8059c-969e-4685-adc5-6c092f68e5eb" returned: 0 in 0.799s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:06:40 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-e875610c-424d-4cbb-ae5b-22294bf0f657 tempest-VolumesImageMetadata-1880590418 None] <== create_volume: return (1904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:06:40 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-e875610c-424d-4cbb-ae5b-22294bf0f657 tempest-VolumesImageMetadata-1880590418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.910s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:06:40 devstack cinder-volume[83924]: DEBUG cinder.volume.volume_utils [None req-e875610c-424d-4cbb-ae5b-22294bf0f657 tempest-VolumesImageMetadata-1880590418 None] Attempting download of eea3f98a-f64b-4ae5-950b-6d03ae89a234 ((None, [{'url': 'file:///opt/stack/data/glance/images/eea3f98a-f64b-4ae5-950b-6d03ae89a234', 'metadata': {}}])) to volume 7bc8059c-969e-4685-adc5-6c092f68e5eb. {{(pid=83924) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 28 22:06:40 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10d60e6-53b5-49b1-9b8d-3c39a7ef8102]: (4, 'raw') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:06:40 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e875610c-424d-4cbb-ae5b-22294bf0f657 tempest-VolumesImageMetadata-1880590418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eea3f98a-f64b-4ae5-950b-6d03ae89a234_by0h0qd_ {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:06:40 devstack sudo[87398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eea3f98a-f64b-4ae5-950b-6d03ae89a234_by0h0qd_
Apr 28 22:06:40 devstack sudo[87398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:06:41 devstack sudo[87398]: pam_unix(sudo:session): session closed for user root
Apr 28 22:06:41 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e875610c-424d-4cbb-ae5b-22294bf0f657 tempest-VolumesImageMetadata-1880590418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eea3f98a-f64b-4ae5-950b-6d03ae89a234_by0h0qd_" returned: 0 in 0.741s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:06:41 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e875610c-424d-4cbb-ae5b-22294bf0f657 tempest-VolumesImageMetadata-1880590418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eea3f98a-f64b-4ae5-950b-6d03ae89a234_by0h0qd_ {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:06:41 devstack sudo[87403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eea3f98a-f64b-4ae5-950b-6d03ae89a234_by0h0qd_
Apr 28 22:06:41 devstack sudo[87403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:06:42 devstack sudo[87403]: pam_unix(sudo:session): session closed for user root
Apr 28 22:06:42 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e875610c-424d-4cbb-ae5b-22294bf0f657 tempest-VolumesImageMetadata-1880590418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eea3f98a-f64b-4ae5-950b-6d03ae89a234_by0h0qd_" returned: 1 in 0.778s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:06:42 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e875610c-424d-4cbb-ae5b-22294bf0f657 tempest-VolumesImageMetadata-1880590418 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eea3f98a-f64b-4ae5-950b-6d03ae89a234_by0h0qd_' failed. Not Retrying. {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 28 22:06:42 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e775a6e-20de-45db-a8ad-38f9baa323ca]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:06:42 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e875610c-424d-4cbb-ae5b-22294bf0f657 tempest-VolumesImageMetadata-1880590418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eea3f98a-f64b-4ae5-950b-6d03ae89a234_f0p2_kgndevstack@QuobyteHD {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:06:42 devstack sudo[87407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eea3f98a-f64b-4ae5-950b-6d03ae89a234_f0p2_kgndevstack@QuobyteHD
Apr 28 22:06:42 devstack sudo[87407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:06:43 devstack sudo[87407]: pam_unix(sudo:session): session closed for user root
Apr 28 22:06:43 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e875610c-424d-4cbb-ae5b-22294bf0f657 tempest-VolumesImageMetadata-1880590418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eea3f98a-f64b-4ae5-950b-6d03ae89a234_f0p2_kgndevstack@QuobyteHD" returned: 0 in 0.776s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:06:43 devstack cinder-volume[83924]: DEBUG cinder.image.image_utils [None req-e875610c-424d-4cbb-ae5b-22294bf0f657 tempest-VolumesImageMetadata-1880590418 None] eea3f98a-f64b-4ae5-950b-6d03ae89a234 was qcow2, converting to raw {{(pid=83924) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 28 22:06:43 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e875610c-424d-4cbb-ae5b-22294bf0f657 tempest-VolumesImageMetadata-1880590418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eea3f98a-f64b-4ae5-950b-6d03ae89a234_f0p2_kgndevstack@QuobyteHD /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7bc8059c-969e-4685-adc5-6c092f68e5eb {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:06:43 devstack sudo[87413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eea3f98a-f64b-4ae5-950b-6d03ae89a234_f0p2_kgndevstack@QuobyteHD /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7bc8059c-969e-4685-adc5-6c092f68e5eb
Apr 28 22:06:43 devstack sudo[87413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:06:46 devstack sudo[87413]: pam_unix(sudo:session): session closed for user root
Apr 28 22:06:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e875610c-424d-4cbb-ae5b-22294bf0f657 tempest-VolumesImageMetadata-1880590418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eea3f98a-f64b-4ae5-950b-6d03ae89a234_f0p2_kgndevstack@QuobyteHD /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7bc8059c-969e-4685-adc5-6c092f68e5eb" returned: 0 in 3.130s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:06:46 devstack cinder-volume[83924]: DEBUG cinder.image.image_utils [None req-e875610c-424d-4cbb-ae5b-22294bf0f657 tempest-VolumesImageMetadata-1880590418 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_eea3f98a-f64b-4ae5-950b-6d03ae89a234_f0p2_kgndevstack@QuobyteHD, size 112.00 MB, duration 3.14 sec, destination /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7bc8059c-969e-4685-adc5-6c092f68e5eb {{(pid=83924) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 28 22:06:46 devstack cinder-volume[83924]: INFO cinder.image.image_utils [None req-e875610c-424d-4cbb-ae5b-22294bf0f657 tempest-VolumesImageMetadata-1880590418 None] Converted 112.00 MB image at 35.73 MB/s
Apr 28 22:06:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e875610c-424d-4cbb-ae5b-22294bf0f657 tempest-VolumesImageMetadata-1880590418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7bc8059c-969e-4685-adc5-6c092f68e5eb 1G {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:06:46 devstack sudo[87494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7bc8059c-969e-4685-adc5-6c092f68e5eb 1G
Apr 28 22:06:46 devstack sudo[87494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:06:47 devstack sudo[87494]: pam_unix(sudo:session): session closed for user root
Apr 28 22:06:47 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e875610c-424d-4cbb-ae5b-22294bf0f657 tempest-VolumesImageMetadata-1880590418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7bc8059c-969e-4685-adc5-6c092f68e5eb 1G" returned: 0 in 1.090s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:06:47 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d07d54-4cc6-46e9-8d17-cbf0314fed46]: (4, 'raw') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:06:47 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e875610c-424d-4cbb-ae5b-22294bf0f657 tempest-VolumesImageMetadata-1880590418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7bc8059c-969e-4685-adc5-6c092f68e5eb {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:06:47 devstack sudo[87511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7bc8059c-969e-4685-adc5-6c092f68e5eb
Apr 28 22:06:47 devstack sudo[87511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:06:48 devstack sudo[87511]: pam_unix(sudo:session): session closed for user root
Apr 28 22:06:48 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e875610c-424d-4cbb-ae5b-22294bf0f657 tempest-VolumesImageMetadata-1880590418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7bc8059c-969e-4685-adc5-6c092f68e5eb" returned: 0 in 1.290s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:06:48 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e875610c-424d-4cbb-ae5b-22294bf0f657 tempest-VolumesImageMetadata-1880590418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7bc8059c-969e-4685-adc5-6c092f68e5eb {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:06:48 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-e307c382-7ab4-45aa-af9f-cd4da01b406e tempest-VolumesSnapshotListTestJSON-1176582296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:06:48 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-e307c382-7ab4-45aa-af9f-cd4da01b406e tempest-VolumesSnapshotListTestJSON-1176582296 None] Flow 'volume_create_manager' (5b64a66a-95b5-4c82-95f8-157505def21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:06:48 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-e307c382-7ab4-45aa-af9f-cd4da01b406e tempest-VolumesSnapshotListTestJSON-1176582296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d5a4f1d-665d-4e59-becf-a007f0431f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:06:48 devstack sudo[87515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7bc8059c-969e-4685-adc5-6c092f68e5eb
Apr 28 22:06:48 devstack sudo[87515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:06:49 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-e307c382-7ab4-45aa-af9f-cd4da01b406e tempest-VolumesSnapshotListTestJSON-1176582296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d5a4f1d-665d-4e59-becf-a007f0431f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:06:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-420760987',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10716abc-ac76-45f1-9761-13f7a8eccf1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb19e6886a7b45e099d4af715d2cd9c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:06:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:06:49Z,use_quota=True,user_id='63bcec86105a47ca81ea38831d4c4440',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:06:49 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-e307c382-7ab4-45aa-af9f-cd4da01b406e tempest-VolumesSnapshotListTestJSON-1176582296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2f83be5-84ff-4f9f-ac5f-bccb4f96c96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:06:49 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-e307c382-7ab4-45aa-af9f-cd4da01b406e tempest-VolumesSnapshotListTestJSON-1176582296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2f83be5-84ff-4f9f-ac5f-bccb4f96c96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:06:49 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-e307c382-7ab4-45aa-af9f-cd4da01b406e tempest-VolumesSnapshotListTestJSON-1176582296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfbb962b-c6a9-4758-9a90-e86625a3b149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:06:49 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-e307c382-7ab4-45aa-af9f-cd4da01b406e tempest-VolumesSnapshotListTestJSON-1176582296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfbb962b-c6a9-4758-9a90-e86625a3b149) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10716abc-ac76-45f1-9761-13f7a8eccf1c', 'volume_name': 'volume-10716abc-ac76-45f1-9761-13f7a8eccf1c', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:06:49 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-e307c382-7ab4-45aa-af9f-cd4da01b406e tempest-VolumesSnapshotListTestJSON-1176582296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c764fecc-6c15-4de5-8ec9-75d84239e047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:06:49 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-e307c382-7ab4-45aa-af9f-cd4da01b406e tempest-VolumesSnapshotListTestJSON-1176582296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c764fecc-6c15-4de5-8ec9-75d84239e047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:06:49 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-e307c382-7ab4-45aa-af9f-cd4da01b406e tempest-VolumesSnapshotListTestJSON-1176582296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d44c153-9a8a-4ed8-9dd6-0d61006f8efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:06:49 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-e307c382-7ab4-45aa-af9f-cd4da01b406e tempest-VolumesSnapshotListTestJSON-1176582296 None] Volume 10716abc-ac76-45f1-9761-13f7a8eccf1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10716abc-ac76-45f1-9761-13f7a8eccf1c', 'volume_size': 1}
Apr 28 22:06:49 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-e307c382-7ab4-45aa-af9f-cd4da01b406e tempest-VolumesSnapshotListTestJSON-1176582296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:06:49 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-e307c382-7ab4-45aa-af9f-cd4da01b406e tempest-VolumesSnapshotListTestJSON-1176582296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:06:49 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-e307c382-7ab4-45aa-af9f-cd4da01b406e tempest-VolumesSnapshotListTestJSON-1176582296 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:06:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-420760987',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10716abc-ac76-45f1-9761-13f7a8eccf1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb19e6886a7b45e099d4af715d2cd9c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:06:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:06:49Z,use_quota=True,user_id='63bcec86105a47ca81ea38831d4c4440',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:06:49 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-e307c382-7ab4-45aa-af9f-cd4da01b406e tempest-VolumesSnapshotListTestJSON-1176582296 None] Creating volume 10716abc-ac76-45f1-9761-13f7a8eccf1c {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:06:49 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-e307c382-7ab4-45aa-af9f-cd4da01b406e tempest-VolumesSnapshotListTestJSON-1176582296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:06:49 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-e307c382-7ab4-45aa-af9f-cd4da01b406e tempest-VolumesSnapshotListTestJSON-1176582296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:06:49 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-e307c382-7ab4-45aa-af9f-cd4da01b406e tempest-VolumesSnapshotListTestJSON-1176582296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:06:49 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-e307c382-7ab4-45aa-af9f-cd4da01b406e tempest-VolumesSnapshotListTestJSON-1176582296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:06:49 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-e307c382-7ab4-45aa-af9f-cd4da01b406e tempest-VolumesSnapshotListTestJSON-1176582296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:06:49 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-e307c382-7ab4-45aa-af9f-cd4da01b406e tempest-VolumesSnapshotListTestJSON-1176582296 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:06:49 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-e307c382-7ab4-45aa-af9f-cd4da01b406e tempest-VolumesSnapshotListTestJSON-1176582296 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:06:49 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e307c382-7ab4-45aa-af9f-cd4da01b406e tempest-VolumesSnapshotListTestJSON-1176582296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:06:49 devstack sudo[87517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c 1073741824
Apr 28 22:06:49 devstack sudo[87517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:06:50 devstack sudo[87515]: pam_unix(sudo:session): session closed for user root
Apr 28 22:06:50 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e875610c-424d-4cbb-ae5b-22294bf0f657 tempest-VolumesImageMetadata-1880590418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7bc8059c-969e-4685-adc5-6c092f68e5eb" returned: 1 in 1.357s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:06:50 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e875610c-424d-4cbb-ae5b-22294bf0f657 tempest-VolumesImageMetadata-1880590418 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7bc8059c-969e-4685-adc5-6c092f68e5eb' failed. Not Retrying. {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 28 22:06:50 devstack cinder-volume[83924]: DEBUG cinder.volume.volume_utils [None req-e875610c-424d-4cbb-ae5b-22294bf0f657 tempest-VolumesImageMetadata-1880590418 None] Downloaded image eea3f98a-f64b-4ae5-950b-6d03ae89a234 ((None, [{'url': 'file:///opt/stack/data/glance/images/eea3f98a-f64b-4ae5-950b-6d03ae89a234', 'metadata': {}}])) to volume 7bc8059c-969e-4685-adc5-6c092f68e5eb successfully. {{(pid=83924) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 28 22:06:50 devstack cinder-volume[83924]: DEBUG cinder.image.image_utils [None req-e875610c-424d-4cbb-ae5b-22294bf0f657 tempest-VolumesImageMetadata-1880590418 None] Temporary image eea3f98a-f64b-4ae5-950b-6d03ae89a234 for user 96db8eb3603146388272f46eb71b6fc3 is deleted. {{(pid=83924) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 28 22:06:50 devstack cinder-volume[83924]: DEBUG cinder.volume.volume_utils [None req-e875610c-424d-4cbb-ae5b-22294bf0f657 tempest-VolumesImageMetadata-1880590418 None] Marking volume 7bc8059c-969e-4685-adc5-6c092f68e5eb as bootable. {{(pid=83924) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 28 22:06:50 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-e875610c-424d-4cbb-ae5b-22294bf0f657 tempest-VolumesImageMetadata-1880590418 None] Copying metadata from image eea3f98a-f64b-4ae5-950b-6d03ae89a234 to 7bc8059c-969e-4685-adc5-6c092f68e5eb. {{(pid=83924) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 28 22:06:50 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-e875610c-424d-4cbb-ae5b-22294bf0f657 tempest-VolumesImageMetadata-1880590418 None] Creating volume glance metadata for volume 7bc8059c-969e-4685-adc5-6c092f68e5eb backed by image eea3f98a-f64b-4ae5-950b-6d03ae89a234 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'eea3f98a-f64b-4ae5-950b-6d03ae89a234', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83924) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 28 22:06:50 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-e875610c-424d-4cbb-ae5b-22294bf0f657 tempest-VolumesImageMetadata-1880590418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32d7d584-9a75-42dd-9b5b-f17938b57406) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bc8059c-969e-4685-adc5-6c092f68e5eb', 'volume_size': 1, 'image_id': 'eea3f98a-f64b-4ae5-950b-6d03ae89a234', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eea3f98a-f64b-4ae5-950b-6d03ae89a234', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c4919824590f4575ada7761aea13c85e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eea3f98a-f64b-4ae5-950b-6d03ae89a234', 'created_at': datetime.datetime(2026, 4, 28, 19, 59, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 19, 59, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eea3f98a-f64b-4ae5-950b-6d03ae89a234/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7844d53a2240>}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:06:50 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-e875610c-424d-4cbb-ae5b-22294bf0f657 tempest-VolumesImageMetadata-1880590418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c697870f-075a-40b2-9d8e-e462819f84cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:06:50 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-e875610c-424d-4cbb-ae5b-22294bf0f657 tempest-VolumesImageMetadata-1880590418 None] Volume volume-7bc8059c-969e-4685-adc5-6c092f68e5eb (7bc8059c-969e-4685-adc5-6c092f68e5eb): created successfully
Apr 28 22:06:50 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-e875610c-424d-4cbb-ae5b-22294bf0f657 tempest-VolumesImageMetadata-1880590418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c697870f-075a-40b2-9d8e-e462819f84cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:06:50 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-e875610c-424d-4cbb-ae5b-22294bf0f657 tempest-VolumesImageMetadata-1880590418 None] Flow 'volume_create_manager' (274f5ebe-c0ec-449d-93ea-f204c2c5fc5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:06:50 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-e875610c-424d-4cbb-ae5b-22294bf0f657 tempest-VolumesImageMetadata-1880590418 None] Created volume successfully.
Apr 28 22:06:50 devstack sudo[87517]: pam_unix(sudo:session): session closed for user root
Apr 28 22:06:50 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e307c382-7ab4-45aa-af9f-cd4da01b406e tempest-VolumesSnapshotListTestJSON-1176582296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c 1073741824" returned: 0 in 1.569s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:06:50 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e307c382-7ab4-45aa-af9f-cd4da01b406e tempest-VolumesSnapshotListTestJSON-1176582296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:06:50 devstack sudo[87533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c
Apr 28 22:06:50 devstack sudo[87533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:06:51 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-942005f7-2998-4488-9340-a26a6461fc7d tempest-VolumesImageMetadata-1880590418 None] Acquiring lock "cinder-7bc8059c-969e-4685-adc5-6c092f68e5eb-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:06:51 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-942005f7-2998-4488-9340-a26a6461fc7d tempest-VolumesImageMetadata-1880590418 None] Lock "cinder-7bc8059c-969e-4685-adc5-6c092f68e5eb-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:06:51 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-942005f7-2998-4488-9340-a26a6461fc7d tempest-VolumesImageMetadata-1880590418 None] Acquiring lock "cinder-quobyte-7bc8059c-969e-4685-adc5-6c092f68e5eb" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:06:51 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-942005f7-2998-4488-9340-a26a6461fc7d tempest-VolumesImageMetadata-1880590418 None] Lock "cinder-quobyte-7bc8059c-969e-4685-adc5-6c092f68e5eb" acquired by "delete_volume" :: waited 0.024s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:06:51 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4d4db8-0c63-415e-b28e-d40f424096c8]: (4, 'raw') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:06:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-942005f7-2998-4488-9340-a26a6461fc7d tempest-VolumesImageMetadata-1880590418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7bc8059c-969e-4685-adc5-6c092f68e5eb {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:06:51 devstack sudo[87536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7bc8059c-969e-4685-adc5-6c092f68e5eb
Apr 28 22:06:51 devstack sudo[87536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:06:51 devstack sudo[87533]: pam_unix(sudo:session): session closed for user root
Apr 28 22:06:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e307c382-7ab4-45aa-af9f-cd4da01b406e tempest-VolumesSnapshotListTestJSON-1176582296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c" returned: 0 in 0.756s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:06:51 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-e307c382-7ab4-45aa-af9f-cd4da01b406e tempest-VolumesSnapshotListTestJSON-1176582296 None] <== create_volume: return (2428ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:06:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-e307c382-7ab4-45aa-af9f-cd4da01b406e tempest-VolumesSnapshotListTestJSON-1176582296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.431s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:06:51 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-e307c382-7ab4-45aa-af9f-cd4da01b406e tempest-VolumesSnapshotListTestJSON-1176582296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d44c153-9a8a-4ed8-9dd6-0d61006f8efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10716abc-ac76-45f1-9761-13f7a8eccf1c', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:06:51 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-e307c382-7ab4-45aa-af9f-cd4da01b406e tempest-VolumesSnapshotListTestJSON-1176582296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (839c6ee1-fecb-402e-862a-4bd85f608720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:06:51 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-e307c382-7ab4-45aa-af9f-cd4da01b406e tempest-VolumesSnapshotListTestJSON-1176582296 None] Volume volume-10716abc-ac76-45f1-9761-13f7a8eccf1c (10716abc-ac76-45f1-9761-13f7a8eccf1c): created successfully
Apr 28 22:06:51 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-e307c382-7ab4-45aa-af9f-cd4da01b406e tempest-VolumesSnapshotListTestJSON-1176582296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (839c6ee1-fecb-402e-862a-4bd85f608720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:06:51 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-e307c382-7ab4-45aa-af9f-cd4da01b406e tempest-VolumesSnapshotListTestJSON-1176582296 None] Flow 'volume_create_manager' (5b64a66a-95b5-4c82-95f8-157505def21d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:06:51 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-e307c382-7ab4-45aa-af9f-cd4da01b406e tempest-VolumesSnapshotListTestJSON-1176582296 None] Created volume successfully.
Apr 28 22:06:52 devstack sudo[87536]: pam_unix(sudo:session): session closed for user root
Apr 28 22:06:52 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-942005f7-2998-4488-9340-a26a6461fc7d tempest-VolumesImageMetadata-1880590418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7bc8059c-969e-4685-adc5-6c092f68e5eb" returned: 0 in 0.762s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:06:52 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-942005f7-2998-4488-9340-a26a6461fc7d tempest-VolumesImageMetadata-1880590418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7bc8059c-969e-4685-adc5-6c092f68e5eb {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:06:52 devstack sudo[87540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7bc8059c-969e-4685-adc5-6c092f68e5eb
Apr 28 22:06:52 devstack sudo[87540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:06:52 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-2bb65084-ea5f-49f6-904e-e87057808a60 tempest-VolumesSnapshotListTestJSON-1176582296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:06:52 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-2bb65084-ea5f-49f6-904e-e87057808a60 tempest-VolumesSnapshotListTestJSON-1176582296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.012s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:06:52 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-2bb65084-ea5f-49f6-904e-e87057808a60 tempest-VolumesSnapshotListTestJSON-1176582296 None] Creating offline snapshot 04faca61-e870-438c-902a-fc0d41fdd8ea of volume 10716abc-ac76-45f1-9761-13f7a8eccf1c {{(pid=83924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 22:06:52 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15335e4-8fc4-42cb-9eac-71d27ef24880]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:06:52 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-2bb65084-ea5f-49f6-904e-e87057808a60 tempest-VolumesSnapshotListTestJSON-1176582296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:06:53 devstack sudo[87578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c
Apr 28 22:06:53 devstack sudo[87578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:06:53 devstack sudo[87540]: pam_unix(sudo:session): session closed for user root
Apr 28 22:06:53 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-942005f7-2998-4488-9340-a26a6461fc7d tempest-VolumesImageMetadata-1880590418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7bc8059c-969e-4685-adc5-6c092f68e5eb" returned: 1 in 1.740s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:06:53 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-942005f7-2998-4488-9340-a26a6461fc7d tempest-VolumesImageMetadata-1880590418 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7bc8059c-969e-4685-adc5-6c092f68e5eb' failed. Not Retrying. {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 28 22:06:53 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-942005f7-2998-4488-9340-a26a6461fc7d tempest-VolumesImageMetadata-1880590418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7bc8059c-969e-4685-adc5-6c092f68e5eb {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:06:53 devstack sudo[87587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7bc8059c-969e-4685-adc5-6c092f68e5eb
Apr 28 22:06:53 devstack sudo[87587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:06:54 devstack sudo[87578]: pam_unix(sudo:session): session closed for user root
Apr 28 22:06:54 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-2bb65084-ea5f-49f6-904e-e87057808a60 tempest-VolumesSnapshotListTestJSON-1176582296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c" returned: 0 in 1.392s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:06:54 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-2bb65084-ea5f-49f6-904e-e87057808a60 tempest-VolumesSnapshotListTestJSON-1176582296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.04faca61-e870-438c-902a-fc0d41fdd8ea 1G {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:06:54 devstack sudo[87593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.04faca61-e870-438c-902a-fc0d41fdd8ea 1G
Apr 28 22:06:54 devstack sudo[87593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:06:54 devstack sudo[87587]: pam_unix(sudo:session): session closed for user root
Apr 28 22:06:54 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-942005f7-2998-4488-9340-a26a6461fc7d tempest-VolumesImageMetadata-1880590418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7bc8059c-969e-4685-adc5-6c092f68e5eb" returned: 0 in 1.079s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:06:55 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-942005f7-2998-4488-9340-a26a6461fc7d tempest-VolumesImageMetadata-1880590418 None] Lock "cinder-quobyte-7bc8059c-969e-4685-adc5-6c092f68e5eb" released by "delete_volume" :: held 3.683s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:06:55 devstack cinder-volume[83924]: DEBUG dbcounter [-] [83924] Writing DB stats cinder:SELECT=49,cinder:UPDATE=56,cinder:DELETE=6,cinder:INSERT=16 {{(pid=83924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 28 22:06:55 devstack cinder-volume[83924]: DEBUG dbcounter [-] [83924] Writing DB stats cinder:SELECT=52,cinder:UPDATE=58,cinder:INSERT=20,cinder:DELETE=5 {{(pid=83924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 28 22:06:55 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-942005f7-2998-4488-9340-a26a6461fc7d tempest-VolumesImageMetadata-1880590418 None] Created reservations ['6a43943a-29cd-4882-8ad7-909eec8ec13e', '8ffef489-59be-4b09-b6cf-e3f45ae4b987', 'a784cf5f-ffa0-427b-af32-68cdf35be6cd', '7e7b2ff2-9943-4708-8ce6-db0e23c2cb35'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:06:55 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-942005f7-2998-4488-9340-a26a6461fc7d tempest-VolumesImageMetadata-1880590418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:06:55 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-942005f7-2998-4488-9340-a26a6461fc7d tempest-VolumesImageMetadata-1880590418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:06:55 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-942005f7-2998-4488-9340-a26a6461fc7d tempest-VolumesImageMetadata-1880590418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:06:55 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-942005f7-2998-4488-9340-a26a6461fc7d tempest-VolumesImageMetadata-1880590418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:06:55 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-942005f7-2998-4488-9340-a26a6461fc7d tempest-VolumesImageMetadata-1880590418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:06:55 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-942005f7-2998-4488-9340-a26a6461fc7d tempest-VolumesImageMetadata-1880590418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:06:55 devstack sudo[87596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:06:55 devstack sudo[87596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:06:55 devstack sudo[87593]: pam_unix(sudo:session): session closed for user root
Apr 28 22:06:55 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-2bb65084-ea5f-49f6-904e-e87057808a60 tempest-VolumesSnapshotListTestJSON-1176582296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.04faca61-e870-438c-902a-fc0d41fdd8ea 1G" returned: 0 in 1.620s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:06:55 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-2bb65084-ea5f-49f6-904e-e87057808a60 tempest-VolumesSnapshotListTestJSON-1176582296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10716abc-ac76-45f1-9761-13f7a8eccf1c -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.04faca61-e870-438c-902a-fc0d41fdd8ea {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:06:56 devstack sudo[87601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10716abc-ac76-45f1-9761-13f7a8eccf1c -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.04faca61-e870-438c-902a-fc0d41fdd8ea
Apr 28 22:06:56 devstack sudo[87601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:06:56 devstack sudo[87596]: pam_unix(sudo:session): session closed for user root
Apr 28 22:06:56 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-942005f7-2998-4488-9340-a26a6461fc7d tempest-VolumesImageMetadata-1880590418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 1.520s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:06:56 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-942005f7-2998-4488-9340-a26a6461fc7d tempest-VolumesImageMetadata-1880590418 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:06:56 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-942005f7-2998-4488-9340-a26a6461fc7d tempest-VolumesImageMetadata-1880590418 None] Deleted volume successfully.
Apr 28 22:06:56 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-942005f7-2998-4488-9340-a26a6461fc7d tempest-VolumesImageMetadata-1880590418 None] Lock "cinder-7bc8059c-969e-4685-adc5-6c092f68e5eb-delete_volume" released by "delete_volume" :: held 5.704s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:06:57 devstack sudo[87601]: pam_unix(sudo:session): session closed for user root
Apr 28 22:06:57 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-2bb65084-ea5f-49f6-904e-e87057808a60 tempest-VolumesSnapshotListTestJSON-1176582296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10716abc-ac76-45f1-9761-13f7a8eccf1c -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.04faca61-e870-438c-902a-fc0d41fdd8ea" returned: 0 in 1.800s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:06:57 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-2bb65084-ea5f-49f6-904e-e87057808a60 tempest-VolumesSnapshotListTestJSON-1176582296 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.04faca61-e870-438c-902a-fc0d41fdd8ea is being set with open permissions: ugo+rw
Apr 28 22:06:57 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-2bb65084-ea5f-49f6-904e-e87057808a60 tempest-VolumesSnapshotListTestJSON-1176582296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.04faca61-e870-438c-902a-fc0d41fdd8ea {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:06:57 devstack sudo[87607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.04faca61-e870-438c-902a-fc0d41fdd8ea
Apr 28 22:06:57 devstack sudo[87607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:06:59 devstack sudo[87607]: pam_unix(sudo:session): session closed for user root
Apr 28 22:06:59 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-2bb65084-ea5f-49f6-904e-e87057808a60 tempest-VolumesSnapshotListTestJSON-1176582296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.04faca61-e870-438c-902a-fc0d41fdd8ea" returned: 0 in 1.370s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:06:59 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-2bb65084-ea5f-49f6-904e-e87057808a60 tempest-VolumesSnapshotListTestJSON-1176582296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.info {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:06:59 devstack sudo[87628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.info
Apr 28 22:06:59 devstack sudo[87628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:00 devstack sudo[87628]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:00 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-2bb65084-ea5f-49f6-904e-e87057808a60 tempest-VolumesSnapshotListTestJSON-1176582296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.info" returned: 0 in 1.417s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:00 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-2bb65084-ea5f-49f6-904e-e87057808a60 tempest-VolumesSnapshotListTestJSON-1176582296 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.info is being set with open permissions: ugo+rw
Apr 28 22:07:00 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-2bb65084-ea5f-49f6-904e-e87057808a60 tempest-VolumesSnapshotListTestJSON-1176582296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.info {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:00 devstack sudo[87632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.info
Apr 28 22:07:00 devstack sudo[87632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:01 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-2bb65084-ea5f-49f6-904e-e87057808a60 tempest-VolumesSnapshotListTestJSON-1176582296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.info" returned: 0 in 1.256s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:01 devstack sudo[87632]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:02 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-2bb65084-ea5f-49f6-904e-e87057808a60 tempest-VolumesSnapshotListTestJSON-1176582296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 9.165s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:07:02 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-2bb65084-ea5f-49f6-904e-e87057808a60 tempest-VolumesSnapshotListTestJSON-1176582296 None] Create snapshot completed successfully
Apr 28 22:07:02 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-d7adebe3-5c49-448c-bec7-a2e03e2923fe tempest-VolumesSnapshotListTestJSON-1176582296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:07:02 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-d7adebe3-5c49-448c-bec7-a2e03e2923fe tempest-VolumesSnapshotListTestJSON-1176582296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:07:02 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-d7adebe3-5c49-448c-bec7-a2e03e2923fe tempest-VolumesSnapshotListTestJSON-1176582296 None] Creating offline snapshot 3ad2d0a7-73f4-4855-bffd-3624ba296339 of volume 10716abc-ac76-45f1-9761-13f7a8eccf1c {{(pid=83924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 22:07:02 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace14937-5d4d-4c65-9c14-b770bf6d9c4d]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:07:02 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-d7adebe3-5c49-448c-bec7-a2e03e2923fe tempest-VolumesSnapshotListTestJSON-1176582296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.04faca61-e870-438c-902a-fc0d41fdd8ea {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:03 devstack sudo[87677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.04faca61-e870-438c-902a-fc0d41fdd8ea
Apr 28 22:07:03 devstack sudo[87677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:04 devstack sudo[87677]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:04 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-d7adebe3-5c49-448c-bec7-a2e03e2923fe tempest-VolumesSnapshotListTestJSON-1176582296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.04faca61-e870-438c-902a-fc0d41fdd8ea" returned: 0 in 1.077s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:04 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-d7adebe3-5c49-448c-bec7-a2e03e2923fe tempest-VolumesSnapshotListTestJSON-1176582296 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10716abc-ac76-45f1-9761-13f7a8eccf1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 22:07:04 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-d7adebe3-5c49-448c-bec7-a2e03e2923fe tempest-VolumesSnapshotListTestJSON-1176582296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.04faca61-e870-438c-902a-fc0d41fdd8ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.3ad2d0a7-73f4-4855-bffd-3624ba296339 1G {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:04 devstack sudo[87687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.04faca61-e870-438c-902a-fc0d41fdd8ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.3ad2d0a7-73f4-4855-bffd-3624ba296339 1G
Apr 28 22:07:04 devstack sudo[87687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:05 devstack sudo[87687]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:05 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-d7adebe3-5c49-448c-bec7-a2e03e2923fe tempest-VolumesSnapshotListTestJSON-1176582296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.04faca61-e870-438c-902a-fc0d41fdd8ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.3ad2d0a7-73f4-4855-bffd-3624ba296339 1G" returned: 0 in 1.643s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:05 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-d7adebe3-5c49-448c-bec7-a2e03e2923fe tempest-VolumesSnapshotListTestJSON-1176582296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.04faca61-e870-438c-902a-fc0d41fdd8ea -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.3ad2d0a7-73f4-4855-bffd-3624ba296339 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:05 devstack sudo[87716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.04faca61-e870-438c-902a-fc0d41fdd8ea -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.3ad2d0a7-73f4-4855-bffd-3624ba296339
Apr 28 22:07:05 devstack sudo[87716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:06 devstack sudo[87716]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:06 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-d7adebe3-5c49-448c-bec7-a2e03e2923fe tempest-VolumesSnapshotListTestJSON-1176582296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.04faca61-e870-438c-902a-fc0d41fdd8ea -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.3ad2d0a7-73f4-4855-bffd-3624ba296339" returned: 0 in 0.985s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:06 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-d7adebe3-5c49-448c-bec7-a2e03e2923fe tempest-VolumesSnapshotListTestJSON-1176582296 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.3ad2d0a7-73f4-4855-bffd-3624ba296339 is being set with open permissions: ugo+rw
Apr 28 22:07:06 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-d7adebe3-5c49-448c-bec7-a2e03e2923fe tempest-VolumesSnapshotListTestJSON-1176582296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.3ad2d0a7-73f4-4855-bffd-3624ba296339 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:06 devstack sudo[87722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.3ad2d0a7-73f4-4855-bffd-3624ba296339
Apr 28 22:07:06 devstack sudo[87722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:07 devstack sudo[87722]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:07 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-d7adebe3-5c49-448c-bec7-a2e03e2923fe tempest-VolumesSnapshotListTestJSON-1176582296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.3ad2d0a7-73f4-4855-bffd-3624ba296339" returned: 0 in 1.149s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:07 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-d7adebe3-5c49-448c-bec7-a2e03e2923fe tempest-VolumesSnapshotListTestJSON-1176582296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.069s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:07:08 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-d7adebe3-5c49-448c-bec7-a2e03e2923fe tempest-VolumesSnapshotListTestJSON-1176582296 None] Create snapshot completed successfully
Apr 28 22:07:08 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-9c16dc91-598a-4727-a680-fd5180ff8462 tempest-VolumesSnapshotListTestJSON-1176582296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:07:08 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-9c16dc91-598a-4727-a680-fd5180ff8462 tempest-VolumesSnapshotListTestJSON-1176582296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:07:08 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-9c16dc91-598a-4727-a680-fd5180ff8462 tempest-VolumesSnapshotListTestJSON-1176582296 None] Creating offline snapshot 50d9d160-c123-4d61-a6da-b172da3d94f8 of volume 10716abc-ac76-45f1-9761-13f7a8eccf1c {{(pid=83924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 22:07:08 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[888af3e9-2522-436e-97fd-4aabaac14f44]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:07:08 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-9c16dc91-598a-4727-a680-fd5180ff8462 tempest-VolumesSnapshotListTestJSON-1176582296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.3ad2d0a7-73f4-4855-bffd-3624ba296339 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:09 devstack sudo[87763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.3ad2d0a7-73f4-4855-bffd-3624ba296339
Apr 28 22:07:09 devstack sudo[87763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:11 devstack sudo[87763]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:11 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-9c16dc91-598a-4727-a680-fd5180ff8462 tempest-VolumesSnapshotListTestJSON-1176582296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.3ad2d0a7-73f4-4855-bffd-3624ba296339" returned: 0 in 2.110s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:11 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-9c16dc91-598a-4727-a680-fd5180ff8462 tempest-VolumesSnapshotListTestJSON-1176582296 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10716abc-ac76-45f1-9761-13f7a8eccf1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 22:07:11 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-9c16dc91-598a-4727-a680-fd5180ff8462 tempest-VolumesSnapshotListTestJSON-1176582296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.3ad2d0a7-73f4-4855-bffd-3624ba296339,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.50d9d160-c123-4d61-a6da-b172da3d94f8 1G {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:11 devstack sudo[87769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.3ad2d0a7-73f4-4855-bffd-3624ba296339,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.50d9d160-c123-4d61-a6da-b172da3d94f8 1G
Apr 28 22:07:11 devstack sudo[87769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:12 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-eedd0da0-e812-4d16-95c4-21f93e04e754 tempest-VolumesTransfersTest-1325050054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:07:12 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-eedd0da0-e812-4d16-95c4-21f93e04e754 tempest-VolumesTransfersTest-1325050054 None] Flow 'volume_create_manager' (c329f41e-3052-4057-a510-41ddd5c7f4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:07:12 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-eedd0da0-e812-4d16-95c4-21f93e04e754 tempest-VolumesTransfersTest-1325050054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a8410bc-a0be-4587-ba54-2dfbe93030f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:12 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-eedd0da0-e812-4d16-95c4-21f93e04e754 tempest-VolumesTransfersTest-1325050054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a8410bc-a0be-4587-ba54-2dfbe93030f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:07:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-815655474',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74211fdb-37f3-4cde-9662-08926aedf99e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58a6189b47bb4a0a83ed0383a36812d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:07:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:07:13Z,use_quota=True,user_id='e2bae35ac4084575b2a152a91acb5946',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:12 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-eedd0da0-e812-4d16-95c4-21f93e04e754 tempest-VolumesTransfersTest-1325050054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2055680-bdba-4d82-ae52-8f8a2d7ecb9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:12 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-eedd0da0-e812-4d16-95c4-21f93e04e754 tempest-VolumesTransfersTest-1325050054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2055680-bdba-4d82-ae52-8f8a2d7ecb9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:12 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-eedd0da0-e812-4d16-95c4-21f93e04e754 tempest-VolumesTransfersTest-1325050054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (837cd553-e8a4-485c-a112-dedadabcd374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:12 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-eedd0da0-e812-4d16-95c4-21f93e04e754 tempest-VolumesTransfersTest-1325050054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (837cd553-e8a4-485c-a112-dedadabcd374) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74211fdb-37f3-4cde-9662-08926aedf99e', 'volume_name': 'volume-74211fdb-37f3-4cde-9662-08926aedf99e', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:12 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-eedd0da0-e812-4d16-95c4-21f93e04e754 tempest-VolumesTransfersTest-1325050054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2c0c357-4d0e-43fd-ad09-f4dba2fac43c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:12 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-eedd0da0-e812-4d16-95c4-21f93e04e754 tempest-VolumesTransfersTest-1325050054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2c0c357-4d0e-43fd-ad09-f4dba2fac43c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:12 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-eedd0da0-e812-4d16-95c4-21f93e04e754 tempest-VolumesTransfersTest-1325050054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13560367-861b-496b-91cc-42d4d3212d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:12 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-eedd0da0-e812-4d16-95c4-21f93e04e754 tempest-VolumesTransfersTest-1325050054 None] Volume 74211fdb-37f3-4cde-9662-08926aedf99e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74211fdb-37f3-4cde-9662-08926aedf99e', 'volume_size': 1}
Apr 28 22:07:12 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-eedd0da0-e812-4d16-95c4-21f93e04e754 tempest-VolumesTransfersTest-1325050054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:07:13 devstack sudo[87769]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:13 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-9c16dc91-598a-4727-a680-fd5180ff8462 tempest-VolumesSnapshotListTestJSON-1176582296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.3ad2d0a7-73f4-4855-bffd-3624ba296339,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.50d9d160-c123-4d61-a6da-b172da3d94f8 1G" returned: 0 in 2.613s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:13 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-9c16dc91-598a-4727-a680-fd5180ff8462 tempest-VolumesSnapshotListTestJSON-1176582296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.3ad2d0a7-73f4-4855-bffd-3624ba296339 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.50d9d160-c123-4d61-a6da-b172da3d94f8 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:13 devstack sudo[87828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.3ad2d0a7-73f4-4855-bffd-3624ba296339 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.50d9d160-c123-4d61-a6da-b172da3d94f8
Apr 28 22:07:13 devstack sudo[87828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:14 devstack sudo[87828]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:14 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-9c16dc91-598a-4727-a680-fd5180ff8462 tempest-VolumesSnapshotListTestJSON-1176582296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.3ad2d0a7-73f4-4855-bffd-3624ba296339 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.50d9d160-c123-4d61-a6da-b172da3d94f8" returned: 0 in 1.096s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:14 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-9c16dc91-598a-4727-a680-fd5180ff8462 tempest-VolumesSnapshotListTestJSON-1176582296 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.50d9d160-c123-4d61-a6da-b172da3d94f8 is being set with open permissions: ugo+rw
Apr 28 22:07:14 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-9c16dc91-598a-4727-a680-fd5180ff8462 tempest-VolumesSnapshotListTestJSON-1176582296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.50d9d160-c123-4d61-a6da-b172da3d94f8 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:14 devstack sudo[87869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.50d9d160-c123-4d61-a6da-b172da3d94f8
Apr 28 22:07:14 devstack sudo[87869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:15 devstack sudo[87869]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:15 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-9c16dc91-598a-4727-a680-fd5180ff8462 tempest-VolumesSnapshotListTestJSON-1176582296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.50d9d160-c123-4d61-a6da-b172da3d94f8" returned: 0 in 0.671s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:15 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-9c16dc91-598a-4727-a680-fd5180ff8462 tempest-VolumesSnapshotListTestJSON-1176582296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.710s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:07:15 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-eedd0da0-e812-4d16-95c4-21f93e04e754 tempest-VolumesTransfersTest-1325050054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.591s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:07:15 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-eedd0da0-e812-4d16-95c4-21f93e04e754 tempest-VolumesTransfersTest-1325050054 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:07:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-815655474',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74211fdb-37f3-4cde-9662-08926aedf99e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58a6189b47bb4a0a83ed0383a36812d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:07:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:07:13Z,use_quota=True,user_id='e2bae35ac4084575b2a152a91acb5946',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:07:15 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-eedd0da0-e812-4d16-95c4-21f93e04e754 tempest-VolumesTransfersTest-1325050054 None] Creating volume 74211fdb-37f3-4cde-9662-08926aedf99e {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:07:15 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-eedd0da0-e812-4d16-95c4-21f93e04e754 tempest-VolumesTransfersTest-1325050054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:07:15 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-eedd0da0-e812-4d16-95c4-21f93e04e754 tempest-VolumesTransfersTest-1325050054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:07:15 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-eedd0da0-e812-4d16-95c4-21f93e04e754 tempest-VolumesTransfersTest-1325050054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:07:15 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-eedd0da0-e812-4d16-95c4-21f93e04e754 tempest-VolumesTransfersTest-1325050054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:07:15 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-eedd0da0-e812-4d16-95c4-21f93e04e754 tempest-VolumesTransfersTest-1325050054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:07:15 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-eedd0da0-e812-4d16-95c4-21f93e04e754 tempest-VolumesTransfersTest-1325050054 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:07:15 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-eedd0da0-e812-4d16-95c4-21f93e04e754 tempest-VolumesTransfersTest-1325050054 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:07:15 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-eedd0da0-e812-4d16-95c4-21f93e04e754 tempest-VolumesTransfersTest-1325050054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-74211fdb-37f3-4cde-9662-08926aedf99e 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:15 devstack sudo[87873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-74211fdb-37f3-4cde-9662-08926aedf99e 1073741824
Apr 28 22:07:15 devstack sudo[87873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:15 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-9c16dc91-598a-4727-a680-fd5180ff8462 tempest-VolumesSnapshotListTestJSON-1176582296 None] Create snapshot completed successfully
Apr 28 22:07:16 devstack sudo[87873]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:16 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-eedd0da0-e812-4d16-95c4-21f93e04e754 tempest-VolumesTransfersTest-1325050054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-74211fdb-37f3-4cde-9662-08926aedf99e 1073741824" returned: 0 in 0.975s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:16 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-eedd0da0-e812-4d16-95c4-21f93e04e754 tempest-VolumesTransfersTest-1325050054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-74211fdb-37f3-4cde-9662-08926aedf99e {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:16 devstack sudo[87880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-74211fdb-37f3-4cde-9662-08926aedf99e
Apr 28 22:07:16 devstack sudo[87880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:17 devstack sudo[87880]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:17 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-eedd0da0-e812-4d16-95c4-21f93e04e754 tempest-VolumesTransfersTest-1325050054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-74211fdb-37f3-4cde-9662-08926aedf99e" returned: 0 in 0.634s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:17 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-eedd0da0-e812-4d16-95c4-21f93e04e754 tempest-VolumesTransfersTest-1325050054 None] <== create_volume: return (1670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:07:17 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-eedd0da0-e812-4d16-95c4-21f93e04e754 tempest-VolumesTransfersTest-1325050054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.675s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:07:17 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-eedd0da0-e812-4d16-95c4-21f93e04e754 tempest-VolumesTransfersTest-1325050054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13560367-861b-496b-91cc-42d4d3212d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74211fdb-37f3-4cde-9662-08926aedf99e', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:17 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-eedd0da0-e812-4d16-95c4-21f93e04e754 tempest-VolumesTransfersTest-1325050054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06fc8981-37b4-4526-901d-9e6b25de3ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:17 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-062685df-3efb-4213-802d-6e639ba3258d tempest-VolumesSnapshotListTestJSON-1176582296 None] Acquiring lock "cinder-50d9d160-c123-4d61-a6da-b172da3d94f8-delete_snapshot" by "delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:07:17 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-eedd0da0-e812-4d16-95c4-21f93e04e754 tempest-VolumesTransfersTest-1325050054 None] Volume volume-74211fdb-37f3-4cde-9662-08926aedf99e (74211fdb-37f3-4cde-9662-08926aedf99e): created successfully
Apr 28 22:07:17 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-eedd0da0-e812-4d16-95c4-21f93e04e754 tempest-VolumesTransfersTest-1325050054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06fc8981-37b4-4526-901d-9e6b25de3ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:17 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-eedd0da0-e812-4d16-95c4-21f93e04e754 tempest-VolumesTransfersTest-1325050054 None] Flow 'volume_create_manager' (c329f41e-3052-4057-a510-41ddd5c7f4c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:07:17 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-062685df-3efb-4213-802d-6e639ba3258d tempest-VolumesSnapshotListTestJSON-1176582296 None] Lock "cinder-50d9d160-c123-4d61-a6da-b172da3d94f8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:07:17 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-062685df-3efb-4213-802d-6e639ba3258d tempest-VolumesSnapshotListTestJSON-1176582296 None] Acquiring lock "cinder-quobyte-10716abc-ac76-45f1-9761-13f7a8eccf1c" by "delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:07:17 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-062685df-3efb-4213-802d-6e639ba3258d tempest-VolumesSnapshotListTestJSON-1176582296 None] Lock "cinder-quobyte-10716abc-ac76-45f1-9761-13f7a8eccf1c" acquired by "delete_snapshot" :: waited 0.020s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:07:17 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-062685df-3efb-4213-802d-6e639ba3258d tempest-VolumesSnapshotListTestJSON-1176582296 None] Acquiring lock "cinder-quobyte-50d9d160-c123-4d61-a6da-b172da3d94f8" by "_delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:07:17 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-eedd0da0-e812-4d16-95c4-21f93e04e754 tempest-VolumesTransfersTest-1325050054 None] Created volume successfully.
Apr 28 22:07:17 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-062685df-3efb-4213-802d-6e639ba3258d tempest-VolumesSnapshotListTestJSON-1176582296 None] Lock "cinder-quobyte-50d9d160-c123-4d61-a6da-b172da3d94f8" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:07:17 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-062685df-3efb-4213-802d-6e639ba3258d tempest-VolumesSnapshotListTestJSON-1176582296 None] Deleting offline snapshot 50d9d160-c123-4d61-a6da-b172da3d94f8 of volume 10716abc-ac76-45f1-9761-13f7a8eccf1c {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 22:07:17 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-062685df-3efb-4213-802d-6e639ba3258d tempest-VolumesSnapshotListTestJSON-1176582296 None] snapshot_file for this snap is: volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.50d9d160-c123-4d61-a6da-b172da3d94f8 {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 22:07:17 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[886b970e-4663-442d-8bbd-bf74efc7cdeb]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:07:17 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-062685df-3efb-4213-802d-6e639ba3258d tempest-VolumesSnapshotListTestJSON-1176582296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.50d9d160-c123-4d61-a6da-b172da3d94f8 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:17 devstack sudo[87883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.50d9d160-c123-4d61-a6da-b172da3d94f8
Apr 28 22:07:17 devstack sudo[87883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:18 devstack sudo[87883]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:18 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-062685df-3efb-4213-802d-6e639ba3258d tempest-VolumesSnapshotListTestJSON-1176582296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.50d9d160-c123-4d61-a6da-b172da3d94f8" returned: 0 in 0.693s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:18 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-062685df-3efb-4213-802d-6e639ba3258d tempest-VolumesSnapshotListTestJSON-1176582296 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10716abc-ac76-45f1-9761-13f7a8eccf1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 22:07:18 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d776ee8b-c9d8-4a64-a557-5d8fbfb86712]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:07:18 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-062685df-3efb-4213-802d-6e639ba3258d tempest-VolumesSnapshotListTestJSON-1176582296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.3ad2d0a7-73f4-4855-bffd-3624ba296339 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:18 devstack sudo[87888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.3ad2d0a7-73f4-4855-bffd-3624ba296339
Apr 28 22:07:18 devstack sudo[87888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:18 devstack sudo[87888]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:18 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-062685df-3efb-4213-802d-6e639ba3258d tempest-VolumesSnapshotListTestJSON-1176582296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.3ad2d0a7-73f4-4855-bffd-3624ba296339" returned: 0 in 0.847s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:18 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-062685df-3efb-4213-802d-6e639ba3258d tempest-VolumesSnapshotListTestJSON-1176582296 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10716abc-ac76-45f1-9761-13f7a8eccf1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 22:07:18 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-062685df-3efb-4213-802d-6e639ba3258d tempest-VolumesSnapshotListTestJSON-1176582296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.50d9d160-c123-4d61-a6da-b172da3d94f8 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:18 devstack sudo[87894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.50d9d160-c123-4d61-a6da-b172da3d94f8
Apr 28 22:07:18 devstack sudo[87894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:19 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-16ad27e9-4e30-4c01-928f-fd5b72aa453c tempest-VolumesTransfersTest-774627938 None] Transfer volume completed successfully.
Apr 28 22:07:19 devstack sudo[87894]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:19 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-062685df-3efb-4213-802d-6e639ba3258d tempest-VolumesSnapshotListTestJSON-1176582296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.50d9d160-c123-4d61-a6da-b172da3d94f8" returned: 0 in 1.058s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:19 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-062685df-3efb-4213-802d-6e639ba3258d tempest-VolumesSnapshotListTestJSON-1176582296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.50d9d160-c123-4d61-a6da-b172da3d94f8 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:20 devstack sudo[87900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.50d9d160-c123-4d61-a6da-b172da3d94f8
Apr 28 22:07:20 devstack sudo[87900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:20 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-94d6f893-3ce9-44de-a17c-d335f1f4ee3a tempest-VolumesTransfersTest-1557461886 None] Acquiring lock "cinder-74211fdb-37f3-4cde-9662-08926aedf99e-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:07:20 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-94d6f893-3ce9-44de-a17c-d335f1f4ee3a tempest-VolumesTransfersTest-1557461886 None] Lock "cinder-74211fdb-37f3-4cde-9662-08926aedf99e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:07:20 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-94d6f893-3ce9-44de-a17c-d335f1f4ee3a tempest-VolumesTransfersTest-1557461886 None] Acquiring lock "cinder-quobyte-74211fdb-37f3-4cde-9662-08926aedf99e" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:07:20 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-94d6f893-3ce9-44de-a17c-d335f1f4ee3a tempest-VolumesTransfersTest-1557461886 None] Lock "cinder-quobyte-74211fdb-37f3-4cde-9662-08926aedf99e" acquired by "delete_volume" :: waited 0.026s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:07:20 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39e0559-eb95-497b-99f7-6d25dfcbcd70]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:07:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-94d6f893-3ce9-44de-a17c-d335f1f4ee3a tempest-VolumesTransfersTest-1557461886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-74211fdb-37f3-4cde-9662-08926aedf99e {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:20 devstack sudo[87902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-74211fdb-37f3-4cde-9662-08926aedf99e
Apr 28 22:07:20 devstack sudo[87902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:21 devstack sudo[87900]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:21 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-062685df-3efb-4213-802d-6e639ba3258d tempest-VolumesSnapshotListTestJSON-1176582296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.50d9d160-c123-4d61-a6da-b172da3d94f8" returned: 0 in 1.245s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:21 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-062685df-3efb-4213-802d-6e639ba3258d tempest-VolumesSnapshotListTestJSON-1176582296 None] Lock "cinder-quobyte-50d9d160-c123-4d61-a6da-b172da3d94f8" released by "_delete_snapshot" :: held 3.982s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:07:21 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-062685df-3efb-4213-802d-6e639ba3258d tempest-VolumesSnapshotListTestJSON-1176582296 None] Lock "cinder-quobyte-10716abc-ac76-45f1-9761-13f7a8eccf1c" released by "delete_snapshot" :: held 4.012s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:07:21 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-062685df-3efb-4213-802d-6e639ba3258d tempest-VolumesSnapshotListTestJSON-1176582296 None] Created reservations ['4690c5d8-14c4-4855-9f84-f48ca2988be7', 'a001edce-6620-481e-abcc-456e2c437a7e', '9b17f95f-bc00-49e4-9b1d-c9c3d77b1e6f', '5ffa59fc-5958-4fc1-a605-36ed2a8c718a'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:07:21 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-062685df-3efb-4213-802d-6e639ba3258d tempest-VolumesSnapshotListTestJSON-1176582296 None] Delete snapshot completed successfully.
Apr 28 22:07:21 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-062685df-3efb-4213-802d-6e639ba3258d tempest-VolumesSnapshotListTestJSON-1176582296 None] Lock "cinder-50d9d160-c123-4d61-a6da-b172da3d94f8-delete_snapshot" released by "delete_snapshot" :: held 4.489s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:07:21 devstack sudo[87902]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:21 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-94d6f893-3ce9-44de-a17c-d335f1f4ee3a tempest-VolumesTransfersTest-1557461886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-74211fdb-37f3-4cde-9662-08926aedf99e" returned: 0 in 1.282s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:21 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-94d6f893-3ce9-44de-a17c-d335f1f4ee3a tempest-VolumesTransfersTest-1557461886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-74211fdb-37f3-4cde-9662-08926aedf99e {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:21 devstack sudo[87909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-74211fdb-37f3-4cde-9662-08926aedf99e
Apr 28 22:07:21 devstack sudo[87909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:22 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4d5ffff-a422-4e3a-b4b1-d05a9a0fe2d2 tempest-ServersNegativeTestJSON-1397346110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:07:22 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f4d5ffff-a422-4e3a-b4b1-d05a9a0fe2d2 tempest-ServersNegativeTestJSON-1397346110 None] Flow 'volume_create_manager' (b114b12e-1041-40dc-ad61-39a2c6cd6d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:07:22 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f4d5ffff-a422-4e3a-b4b1-d05a9a0fe2d2 tempest-ServersNegativeTestJSON-1397346110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb00eaf4-3c2e-458b-a2b6-f904bcc74190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:22 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f4d5ffff-a422-4e3a-b4b1-d05a9a0fe2d2 tempest-ServersNegativeTestJSON-1397346110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb00eaf4-3c2e-458b-a2b6-f904bcc74190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:07:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2123872708',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dba6dbfb-d587-4653-8ba1-58657e9387a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d729c0c67681495f9ef886bf30a711e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:07:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:07:22Z,use_quota=True,user_id='24232d7f860e41fa8aaf1e264a3dc8c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:22 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f4d5ffff-a422-4e3a-b4b1-d05a9a0fe2d2 tempest-ServersNegativeTestJSON-1397346110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af30c152-6543-4061-867b-670efdf4e856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:22 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f4d5ffff-a422-4e3a-b4b1-d05a9a0fe2d2 tempest-ServersNegativeTestJSON-1397346110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af30c152-6543-4061-867b-670efdf4e856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:22 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f4d5ffff-a422-4e3a-b4b1-d05a9a0fe2d2 tempest-ServersNegativeTestJSON-1397346110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09a81dc8-74a6-4514-b7ba-43eaa01bd6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:22 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f4d5ffff-a422-4e3a-b4b1-d05a9a0fe2d2 tempest-ServersNegativeTestJSON-1397346110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09a81dc8-74a6-4514-b7ba-43eaa01bd6ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dba6dbfb-d587-4653-8ba1-58657e9387a2', 'volume_name': 'volume-dba6dbfb-d587-4653-8ba1-58657e9387a2', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:22 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f4d5ffff-a422-4e3a-b4b1-d05a9a0fe2d2 tempest-ServersNegativeTestJSON-1397346110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd60598a-d504-43eb-9273-05824246b5da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:22 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f4d5ffff-a422-4e3a-b4b1-d05a9a0fe2d2 tempest-ServersNegativeTestJSON-1397346110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd60598a-d504-43eb-9273-05824246b5da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:22 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f4d5ffff-a422-4e3a-b4b1-d05a9a0fe2d2 tempest-ServersNegativeTestJSON-1397346110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca383b9a-b696-41bc-bd54-f58e800efd51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:22 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-f4d5ffff-a422-4e3a-b4b1-d05a9a0fe2d2 tempest-ServersNegativeTestJSON-1397346110 None] Volume dba6dbfb-d587-4653-8ba1-58657e9387a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dba6dbfb-d587-4653-8ba1-58657e9387a2', 'volume_size': 1}
Apr 28 22:07:22 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f4d5ffff-a422-4e3a-b4b1-d05a9a0fe2d2 tempest-ServersNegativeTestJSON-1397346110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:07:22 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f4d5ffff-a422-4e3a-b4b1-d05a9a0fe2d2 tempest-ServersNegativeTestJSON-1397346110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:07:22 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-f4d5ffff-a422-4e3a-b4b1-d05a9a0fe2d2 tempest-ServersNegativeTestJSON-1397346110 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:07:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2123872708',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dba6dbfb-d587-4653-8ba1-58657e9387a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d729c0c67681495f9ef886bf30a711e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:07:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:07:22Z,use_quota=True,user_id='24232d7f860e41fa8aaf1e264a3dc8c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:07:22 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-f4d5ffff-a422-4e3a-b4b1-d05a9a0fe2d2 tempest-ServersNegativeTestJSON-1397346110 None] Creating volume dba6dbfb-d587-4653-8ba1-58657e9387a2 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:07:22 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f4d5ffff-a422-4e3a-b4b1-d05a9a0fe2d2 tempest-ServersNegativeTestJSON-1397346110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:07:22 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f4d5ffff-a422-4e3a-b4b1-d05a9a0fe2d2 tempest-ServersNegativeTestJSON-1397346110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:07:22 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-f4d5ffff-a422-4e3a-b4b1-d05a9a0fe2d2 tempest-ServersNegativeTestJSON-1397346110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:07:22 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-f4d5ffff-a422-4e3a-b4b1-d05a9a0fe2d2 tempest-ServersNegativeTestJSON-1397346110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:07:22 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f4d5ffff-a422-4e3a-b4b1-d05a9a0fe2d2 tempest-ServersNegativeTestJSON-1397346110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:07:22 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-f4d5ffff-a422-4e3a-b4b1-d05a9a0fe2d2 tempest-ServersNegativeTestJSON-1397346110 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:07:22 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-f4d5ffff-a422-4e3a-b4b1-d05a9a0fe2d2 tempest-ServersNegativeTestJSON-1397346110 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:07:22 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f4d5ffff-a422-4e3a-b4b1-d05a9a0fe2d2 tempest-ServersNegativeTestJSON-1397346110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-dba6dbfb-d587-4653-8ba1-58657e9387a2 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:22 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-848886da-7c3b-4a46-92ce-f08b2fa709c1 tempest-VolumesSnapshotListTestJSON-1176582296 None] Acquiring lock "cinder-3ad2d0a7-73f4-4855-bffd-3624ba296339-delete_snapshot" by "delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:07:22 devstack sudo[87919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-dba6dbfb-d587-4653-8ba1-58657e9387a2 1073741824
Apr 28 22:07:22 devstack sudo[87919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:22 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-848886da-7c3b-4a46-92ce-f08b2fa709c1 tempest-VolumesSnapshotListTestJSON-1176582296 None] Lock "cinder-3ad2d0a7-73f4-4855-bffd-3624ba296339-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:07:22 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-848886da-7c3b-4a46-92ce-f08b2fa709c1 tempest-VolumesSnapshotListTestJSON-1176582296 None] Acquiring lock "cinder-quobyte-10716abc-ac76-45f1-9761-13f7a8eccf1c" by "delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:07:22 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-848886da-7c3b-4a46-92ce-f08b2fa709c1 tempest-VolumesSnapshotListTestJSON-1176582296 None] Lock "cinder-quobyte-10716abc-ac76-45f1-9761-13f7a8eccf1c" acquired by "delete_snapshot" :: waited 0.055s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:07:22 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-848886da-7c3b-4a46-92ce-f08b2fa709c1 tempest-VolumesSnapshotListTestJSON-1176582296 None] Acquiring lock "cinder-quobyte-3ad2d0a7-73f4-4855-bffd-3624ba296339" by "_delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:07:22 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-848886da-7c3b-4a46-92ce-f08b2fa709c1 tempest-VolumesSnapshotListTestJSON-1176582296 None] Lock "cinder-quobyte-3ad2d0a7-73f4-4855-bffd-3624ba296339" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:07:22 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-848886da-7c3b-4a46-92ce-f08b2fa709c1 tempest-VolumesSnapshotListTestJSON-1176582296 None] Deleting offline snapshot 3ad2d0a7-73f4-4855-bffd-3624ba296339 of volume 10716abc-ac76-45f1-9761-13f7a8eccf1c {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 22:07:23 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-848886da-7c3b-4a46-92ce-f08b2fa709c1 tempest-VolumesSnapshotListTestJSON-1176582296 None] snapshot_file for this snap is: volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.3ad2d0a7-73f4-4855-bffd-3624ba296339 {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 22:07:23 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2acdb901-6162-448a-9c61-d81976c84ce7]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:07:23 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-848886da-7c3b-4a46-92ce-f08b2fa709c1 tempest-VolumesSnapshotListTestJSON-1176582296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.3ad2d0a7-73f4-4855-bffd-3624ba296339 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:23 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-19988625-267c-42c5-99b2-32ae59d7a78f tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:07:23 devstack sudo[87909]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:23 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-19988625-267c-42c5-99b2-32ae59d7a78f tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Flow 'volume_create_manager' (c48a859c-396e-4ee0-85e8-fd15ecc67c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:07:23 devstack sudo[87922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.3ad2d0a7-73f4-4855-bffd-3624ba296339
Apr 28 22:07:23 devstack sudo[87922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:23 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-19988625-267c-42c5-99b2-32ae59d7a78f tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (355bbb4f-2c11-4a2d-a574-8e3219af8723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:23 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-94d6f893-3ce9-44de-a17c-d335f1f4ee3a tempest-VolumesTransfersTest-1557461886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-74211fdb-37f3-4cde-9662-08926aedf99e" returned: 0 in 1.496s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:23 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-19988625-267c-42c5-99b2-32ae59d7a78f tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (355bbb4f-2c11-4a2d-a574-8e3219af8723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:07:23Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ec3f721-0545-4552-add7-a099f022ffe2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ba6df43df164b399be36dcf6b7e9b24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:07:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:07:23Z,use_quota=True,user_id='24b64e2dfae54a799b1d01a1b58253a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:23 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-19988625-267c-42c5-99b2-32ae59d7a78f tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e86e6a17-f2c3-4bd5-a212-5a309e1caade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:23 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-19988625-267c-42c5-99b2-32ae59d7a78f tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e86e6a17-f2c3-4bd5-a212-5a309e1caade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:23 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-19988625-267c-42c5-99b2-32ae59d7a78f tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0a9ae7b-955f-41b5-91cd-f73e94a3b5c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:23 devstack cinder-volume[83924]: DEBUG cinder.image.glance [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-19988625-267c-42c5-99b2-32ae59d7a78f tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Creating Keystone auth plugin from conf {{(pid=83924) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 28 22:07:23 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-94d6f893-3ce9-44de-a17c-d335f1f4ee3a tempest-VolumesTransfersTest-1557461886 None] Lock "cinder-quobyte-74211fdb-37f3-4cde-9662-08926aedf99e" released by "delete_volume" :: held 2.925s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:07:23 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-94d6f893-3ce9-44de-a17c-d335f1f4ee3a tempest-VolumesTransfersTest-1557461886 None] Created reservations ['7d689340-5beb-4216-aa00-4e5431d98219', 'c0503814-73bc-4d0d-b01a-1bbffb0f00b1', '49dd83be-1e22-45b4-8347-69ac3b6124bb', '2b7d73b6-817f-441b-9f75-017b8650d245'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:07:23 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-94d6f893-3ce9-44de-a17c-d335f1f4ee3a tempest-VolumesTransfersTest-1557461886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:07:23 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-94d6f893-3ce9-44de-a17c-d335f1f4ee3a tempest-VolumesTransfersTest-1557461886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:07:23 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-94d6f893-3ce9-44de-a17c-d335f1f4ee3a tempest-VolumesTransfersTest-1557461886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:07:23 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-94d6f893-3ce9-44de-a17c-d335f1f4ee3a tempest-VolumesTransfersTest-1557461886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:07:23 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-94d6f893-3ce9-44de-a17c-d335f1f4ee3a tempest-VolumesTransfersTest-1557461886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:07:23 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-94d6f893-3ce9-44de-a17c-d335f1f4ee3a tempest-VolumesTransfersTest-1557461886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:23 devstack sudo[87935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:07:23 devstack sudo[87935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:23 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-19988625-267c-42c5-99b2-32ae59d7a78f tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0a9ae7b-955f-41b5-91cd-f73e94a3b5c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3ec3f721-0545-4552-add7-a099f022ffe2', 'volume_name': 'volume-3ec3f721-0545-4552-add7-a099f022ffe2', 'volume_size': 1, 'image_id': 'eea3f98a-f64b-4ae5-950b-6d03ae89a234', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eea3f98a-f64b-4ae5-950b-6d03ae89a234', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c4919824590f4575ada7761aea13c85e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eea3f98a-f64b-4ae5-950b-6d03ae89a234', 'created_at': datetime.datetime(2026, 4, 28, 19, 59, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 19, 59, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eea3f98a-f64b-4ae5-950b-6d03ae89a234/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7844d5988f50>}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:23 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-19988625-267c-42c5-99b2-32ae59d7a78f tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37a1afe3-50a9-4a57-a710-86c78c6f7258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:23 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-19988625-267c-42c5-99b2-32ae59d7a78f tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37a1afe3-50a9-4a57-a710-86c78c6f7258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:23 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-19988625-267c-42c5-99b2-32ae59d7a78f tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc633e74-4292-40f7-8736-1e8a474b4e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:23 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-19988625-267c-42c5-99b2-32ae59d7a78f tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Volume 3ec3f721-0545-4552-add7-a099f022ffe2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3ec3f721-0545-4552-add7-a099f022ffe2', 'volume_size': 1, 'image_id': 'eea3f98a-f64b-4ae5-950b-6d03ae89a234', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eea3f98a-f64b-4ae5-950b-6d03ae89a234', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c4919824590f4575ada7761aea13c85e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eea3f98a-f64b-4ae5-950b-6d03ae89a234', 'created_at': datetime.datetime(2026, 4, 28, 19, 59, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 19, 59, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eea3f98a-f64b-4ae5-950b-6d03ae89a234/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7844d5988f50>}
Apr 28 22:07:23 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-19988625-267c-42c5-99b2-32ae59d7a78f tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Trying to clone 3ec3f721-0545-4552-add7-a099f022ffe2 from image eea3f98a-f64b-4ae5-950b-6d03ae89a234 at location (None, [{'url': 'file:///opt/stack/data/glance/images/eea3f98a-f64b-4ae5-950b-6d03ae89a234', 'metadata': {}}]). {{(pid=83924) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 28 22:07:24 devstack sudo[87919]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:24 devstack sudo[87922]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:24 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f4d5ffff-a422-4e3a-b4b1-d05a9a0fe2d2 tempest-ServersNegativeTestJSON-1397346110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-dba6dbfb-d587-4653-8ba1-58657e9387a2 1073741824" returned: 0 in 1.619s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:24 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-848886da-7c3b-4a46-92ce-f08b2fa709c1 tempest-VolumesSnapshotListTestJSON-1176582296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.3ad2d0a7-73f4-4855-bffd-3624ba296339" returned: 0 in 1.363s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:24 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-848886da-7c3b-4a46-92ce-f08b2fa709c1 tempest-VolumesSnapshotListTestJSON-1176582296 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10716abc-ac76-45f1-9761-13f7a8eccf1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 22:07:24 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb8ebbe-2f0d-4131-b1ed-3b405bc34c7b]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:07:24 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-848886da-7c3b-4a46-92ce-f08b2fa709c1 tempest-VolumesSnapshotListTestJSON-1176582296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.04faca61-e870-438c-902a-fc0d41fdd8ea {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:24 devstack cinder-volume[83924]: DEBUG cinder.image.image_utils [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-19988625-267c-42c5-99b2-32ae59d7a78f tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_eea3f98a-f64b-4ae5-950b-6d03ae89a234_9vczntiidevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83924) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 28 22:07:24 devstack cinder-volume[83924]: INFO cinder.image.image_utils [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-19988625-267c-42c5-99b2-32ae59d7a78f tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Image download 20.69 MB at 20.69 MB/s
Apr 28 22:07:24 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f4d5ffff-a422-4e3a-b4b1-d05a9a0fe2d2 tempest-ServersNegativeTestJSON-1397346110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-dba6dbfb-d587-4653-8ba1-58657e9387a2 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:24 devstack sudo[87959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-dba6dbfb-d587-4653-8ba1-58657e9387a2
Apr 28 22:07:24 devstack sudo[87959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:24 devstack sudo[87958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.04faca61-e870-438c-902a-fc0d41fdd8ea
Apr 28 22:07:24 devstack sudo[87958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:24 devstack sudo[87935]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:24 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ea7417-4bff-4b1e-adac-c2a37a7da917]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:07:24 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-19988625-267c-42c5-99b2-32ae59d7a78f tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eea3f98a-f64b-4ae5-950b-6d03ae89a234_9vczntiidevstack@QuobyteHD {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:24 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-94d6f893-3ce9-44de-a17c-d335f1f4ee3a tempest-VolumesTransfersTest-1557461886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 1.017s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:24 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-94d6f893-3ce9-44de-a17c-d335f1f4ee3a tempest-VolumesTransfersTest-1557461886 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:07:24 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-94d6f893-3ce9-44de-a17c-d335f1f4ee3a tempest-VolumesTransfersTest-1557461886 None] Deleted volume successfully.
Apr 28 22:07:24 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-94d6f893-3ce9-44de-a17c-d335f1f4ee3a tempest-VolumesTransfersTest-1557461886 None] Lock "cinder-74211fdb-37f3-4cde-9662-08926aedf99e-delete_volume" released by "delete_volume" :: held 4.484s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:07:24 devstack sudo[87962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eea3f98a-f64b-4ae5-950b-6d03ae89a234_9vczntiidevstack@QuobyteHD
Apr 28 22:07:24 devstack sudo[87962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:25 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-b73ef641-ddf4-489d-8d42-2dea6b1a33b1 tempest-VolumesTransfersTest-1325050054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:07:25 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b73ef641-ddf4-489d-8d42-2dea6b1a33b1 tempest-VolumesTransfersTest-1325050054 None] Flow 'volume_create_manager' (fc52cd5f-3279-4910-a349-73535be7c639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:07:25 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b73ef641-ddf4-489d-8d42-2dea6b1a33b1 tempest-VolumesTransfersTest-1325050054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6a7f052-c950-4df3-a827-57d099c23f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:25 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b73ef641-ddf4-489d-8d42-2dea6b1a33b1 tempest-VolumesTransfersTest-1325050054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6a7f052-c950-4df3-a827-57d099c23f3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:07:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1959612234',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67f842c1-29fa-43ae-a86a-617a3c3d663f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58a6189b47bb4a0a83ed0383a36812d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:07:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:07:25Z,use_quota=True,user_id='e2bae35ac4084575b2a152a91acb5946',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:25 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b73ef641-ddf4-489d-8d42-2dea6b1a33b1 tempest-VolumesTransfersTest-1325050054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b271373-420f-4798-a725-e652ab55e943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:25 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b73ef641-ddf4-489d-8d42-2dea6b1a33b1 tempest-VolumesTransfersTest-1325050054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b271373-420f-4798-a725-e652ab55e943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:25 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b73ef641-ddf4-489d-8d42-2dea6b1a33b1 tempest-VolumesTransfersTest-1325050054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e30a0462-6344-404a-9c18-bc1cdfff5518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:25 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b73ef641-ddf4-489d-8d42-2dea6b1a33b1 tempest-VolumesTransfersTest-1325050054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e30a0462-6344-404a-9c18-bc1cdfff5518) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67f842c1-29fa-43ae-a86a-617a3c3d663f', 'volume_name': 'volume-67f842c1-29fa-43ae-a86a-617a3c3d663f', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:25 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b73ef641-ddf4-489d-8d42-2dea6b1a33b1 tempest-VolumesTransfersTest-1325050054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e18ab234-2dc7-411c-80a1-67f571e8b6a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:25 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b73ef641-ddf4-489d-8d42-2dea6b1a33b1 tempest-VolumesTransfersTest-1325050054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e18ab234-2dc7-411c-80a1-67f571e8b6a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:25 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b73ef641-ddf4-489d-8d42-2dea6b1a33b1 tempest-VolumesTransfersTest-1325050054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adac829b-db00-4652-aca4-f513b09727fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:25 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-b73ef641-ddf4-489d-8d42-2dea6b1a33b1 tempest-VolumesTransfersTest-1325050054 None] Volume 67f842c1-29fa-43ae-a86a-617a3c3d663f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67f842c1-29fa-43ae-a86a-617a3c3d663f', 'volume_size': 1}
Apr 28 22:07:25 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b73ef641-ddf4-489d-8d42-2dea6b1a33b1 tempest-VolumesTransfersTest-1325050054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:07:25 devstack sudo[87959]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:25 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f4d5ffff-a422-4e3a-b4b1-d05a9a0fe2d2 tempest-ServersNegativeTestJSON-1397346110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-dba6dbfb-d587-4653-8ba1-58657e9387a2" returned: 0 in 1.136s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:25 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-f4d5ffff-a422-4e3a-b4b1-d05a9a0fe2d2 tempest-ServersNegativeTestJSON-1397346110 None] <== create_volume: return (2968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:07:25 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f4d5ffff-a422-4e3a-b4b1-d05a9a0fe2d2 tempest-ServersNegativeTestJSON-1397346110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.977s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:07:25 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b73ef641-ddf4-489d-8d42-2dea6b1a33b1 tempest-VolumesTransfersTest-1325050054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.376s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:07:25 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-b73ef641-ddf4-489d-8d42-2dea6b1a33b1 tempest-VolumesTransfersTest-1325050054 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:07:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1959612234',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67f842c1-29fa-43ae-a86a-617a3c3d663f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58a6189b47bb4a0a83ed0383a36812d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:07:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:07:25Z,use_quota=True,user_id='e2bae35ac4084575b2a152a91acb5946',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:07:25 devstack sudo[87958]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:25 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-b73ef641-ddf4-489d-8d42-2dea6b1a33b1 tempest-VolumesTransfersTest-1325050054 None] Creating volume 67f842c1-29fa-43ae-a86a-617a3c3d663f {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:07:25 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b73ef641-ddf4-489d-8d42-2dea6b1a33b1 tempest-VolumesTransfersTest-1325050054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:07:25 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b73ef641-ddf4-489d-8d42-2dea6b1a33b1 tempest-VolumesTransfersTest-1325050054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:07:25 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-b73ef641-ddf4-489d-8d42-2dea6b1a33b1 tempest-VolumesTransfersTest-1325050054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:07:25 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-b73ef641-ddf4-489d-8d42-2dea6b1a33b1 tempest-VolumesTransfersTest-1325050054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:07:25 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b73ef641-ddf4-489d-8d42-2dea6b1a33b1 tempest-VolumesTransfersTest-1325050054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:07:25 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-b73ef641-ddf4-489d-8d42-2dea6b1a33b1 tempest-VolumesTransfersTest-1325050054 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:07:25 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-b73ef641-ddf4-489d-8d42-2dea6b1a33b1 tempest-VolumesTransfersTest-1325050054 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:07:25 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b73ef641-ddf4-489d-8d42-2dea6b1a33b1 tempest-VolumesTransfersTest-1325050054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-67f842c1-29fa-43ae-a86a-617a3c3d663f 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:25 devstack sudo[87962]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:25 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f4d5ffff-a422-4e3a-b4b1-d05a9a0fe2d2 tempest-ServersNegativeTestJSON-1397346110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca383b9a-b696-41bc-bd54-f58e800efd51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dba6dbfb-d587-4653-8ba1-58657e9387a2', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:25 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f4d5ffff-a422-4e3a-b4b1-d05a9a0fe2d2 tempest-ServersNegativeTestJSON-1397346110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d7a5a4b-3ec8-4254-88e0-6b0e100dfcd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:25 devstack sudo[87971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-67f842c1-29fa-43ae-a86a-617a3c3d663f 1073741824
Apr 28 22:07:25 devstack sudo[87971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:25 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-19988625-267c-42c5-99b2-32ae59d7a78f tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eea3f98a-f64b-4ae5-950b-6d03ae89a234_9vczntiidevstack@QuobyteHD" returned: 0 in 1.081s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:25 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-848886da-7c3b-4a46-92ce-f08b2fa709c1 tempest-VolumesSnapshotListTestJSON-1176582296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.04faca61-e870-438c-902a-fc0d41fdd8ea" returned: 0 in 1.305s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:25 devstack cinder-volume[83924]: DEBUG cinder.image.image_utils [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-19988625-267c-42c5-99b2-32ae59d7a78f tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Temporary image eea3f98a-f64b-4ae5-950b-6d03ae89a234 is fetched for user 24b64e2dfae54a799b1d01a1b58253a8. {{(pid=83924) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 28 22:07:25 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-848886da-7c3b-4a46-92ce-f08b2fa709c1 tempest-VolumesSnapshotListTestJSON-1176582296 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10716abc-ac76-45f1-9761-13f7a8eccf1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 22:07:25 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-848886da-7c3b-4a46-92ce-f08b2fa709c1 tempest-VolumesSnapshotListTestJSON-1176582296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.3ad2d0a7-73f4-4855-bffd-3624ba296339 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:25 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-f4d5ffff-a422-4e3a-b4b1-d05a9a0fe2d2 tempest-ServersNegativeTestJSON-1397346110 None] Volume volume-dba6dbfb-d587-4653-8ba1-58657e9387a2 (dba6dbfb-d587-4653-8ba1-58657e9387a2): created successfully
Apr 28 22:07:25 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f4d5ffff-a422-4e3a-b4b1-d05a9a0fe2d2 tempest-ServersNegativeTestJSON-1397346110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d7a5a4b-3ec8-4254-88e0-6b0e100dfcd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:25 devstack sudo[87973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.3ad2d0a7-73f4-4855-bffd-3624ba296339
Apr 28 22:07:25 devstack sudo[87973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:25 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f4d5ffff-a422-4e3a-b4b1-d05a9a0fe2d2 tempest-ServersNegativeTestJSON-1397346110 None] Flow 'volume_create_manager' (b114b12e-1041-40dc-ad61-39a2c6cd6d63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:07:25 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-f4d5ffff-a422-4e3a-b4b1-d05a9a0fe2d2 tempest-ServersNegativeTestJSON-1397346110 None] Created volume successfully.
Apr 28 22:07:25 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e046b9ba-4909-4e56-9054-5b7f651417b6]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:07:25 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-19988625-267c-42c5-99b2-32ae59d7a78f tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eea3f98a-f64b-4ae5-950b-6d03ae89a234_9vczntiidevstack@QuobyteHD {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:26 devstack sudo[87976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eea3f98a-f64b-4ae5-950b-6d03ae89a234_9vczntiidevstack@QuobyteHD
Apr 28 22:07:26 devstack sudo[87976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:26 devstack sudo[87976]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:26 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-19988625-267c-42c5-99b2-32ae59d7a78f tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eea3f98a-f64b-4ae5-950b-6d03ae89a234_9vczntiidevstack@QuobyteHD" returned: 0 in 0.964s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:26 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-19988625-267c-42c5-99b2-32ae59d7a78f tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:07:26 devstack sudo[87973]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:26 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-848886da-7c3b-4a46-92ce-f08b2fa709c1 tempest-VolumesSnapshotListTestJSON-1176582296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.3ad2d0a7-73f4-4855-bffd-3624ba296339" returned: 0 in 1.099s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:26 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-848886da-7c3b-4a46-92ce-f08b2fa709c1 tempest-VolumesSnapshotListTestJSON-1176582296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.3ad2d0a7-73f4-4855-bffd-3624ba296339 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:26 devstack sudo[87989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.3ad2d0a7-73f4-4855-bffd-3624ba296339
Apr 28 22:07:26 devstack sudo[87989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:27 devstack sudo[87971]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:27 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b73ef641-ddf4-489d-8d42-2dea6b1a33b1 tempest-VolumesTransfersTest-1325050054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-67f842c1-29fa-43ae-a86a-617a3c3d663f 1073741824" returned: 0 in 1.371s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:27 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b73ef641-ddf4-489d-8d42-2dea6b1a33b1 tempest-VolumesTransfersTest-1325050054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-67f842c1-29fa-43ae-a86a-617a3c3d663f {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:27 devstack sudo[87991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-67f842c1-29fa-43ae-a86a-617a3c3d663f
Apr 28 22:07:27 devstack sudo[87991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:27 devstack sudo[87989]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:27 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-848886da-7c3b-4a46-92ce-f08b2fa709c1 tempest-VolumesSnapshotListTestJSON-1176582296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.3ad2d0a7-73f4-4855-bffd-3624ba296339" returned: 0 in 0.865s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:27 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-848886da-7c3b-4a46-92ce-f08b2fa709c1 tempest-VolumesSnapshotListTestJSON-1176582296 None] Lock "cinder-quobyte-3ad2d0a7-73f4-4855-bffd-3624ba296339" released by "_delete_snapshot" :: held 4.821s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:07:27 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-848886da-7c3b-4a46-92ce-f08b2fa709c1 tempest-VolumesSnapshotListTestJSON-1176582296 None] Lock "cinder-quobyte-10716abc-ac76-45f1-9761-13f7a8eccf1c" released by "delete_snapshot" :: held 4.870s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:07:27 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-848886da-7c3b-4a46-92ce-f08b2fa709c1 tempest-VolumesSnapshotListTestJSON-1176582296 None] Created reservations ['a11a2e95-7f6b-4486-bb92-8ed5dc5ef584', '6adad1aa-e5db-4b9b-ad78-ed94fe4819ad', '25431ece-7227-4c87-b8dc-a3ff817f08aa', '320f10cf-fae1-498a-9fb1-eadf437ecc65'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:07:27 devstack sudo[87991]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:27 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b73ef641-ddf4-489d-8d42-2dea6b1a33b1 tempest-VolumesTransfersTest-1325050054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-67f842c1-29fa-43ae-a86a-617a3c3d663f" returned: 0 in 0.764s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:27 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-b73ef641-ddf4-489d-8d42-2dea6b1a33b1 tempest-VolumesTransfersTest-1325050054 None] <== create_volume: return (2224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:07:27 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b73ef641-ddf4-489d-8d42-2dea6b1a33b1 tempest-VolumesTransfersTest-1325050054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.231s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:07:27 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-19988625-267c-42c5-99b2-32ae59d7a78f tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.100s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:07:27 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-19988625-267c-42c5-99b2-32ae59d7a78f tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:07:23Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ec3f721-0545-4552-add7-a099f022ffe2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ba6df43df164b399be36dcf6b7e9b24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:07:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:07:23Z,use_quota=True,user_id='24b64e2dfae54a799b1d01a1b58253a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:07:27 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-19988625-267c-42c5-99b2-32ae59d7a78f tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Creating volume 3ec3f721-0545-4552-add7-a099f022ffe2 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:07:27 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-19988625-267c-42c5-99b2-32ae59d7a78f tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:07:27 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-19988625-267c-42c5-99b2-32ae59d7a78f tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:07:27 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-19988625-267c-42c5-99b2-32ae59d7a78f tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:07:27 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-19988625-267c-42c5-99b2-32ae59d7a78f tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:07:27 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-19988625-267c-42c5-99b2-32ae59d7a78f tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:07:27 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-19988625-267c-42c5-99b2-32ae59d7a78f tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:07:27 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-19988625-267c-42c5-99b2-32ae59d7a78f tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:07:27 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-19988625-267c-42c5-99b2-32ae59d7a78f tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3ec3f721-0545-4552-add7-a099f022ffe2 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:28 devstack sudo[87995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3ec3f721-0545-4552-add7-a099f022ffe2 1073741824
Apr 28 22:07:28 devstack sudo[87995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:28 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b73ef641-ddf4-489d-8d42-2dea6b1a33b1 tempest-VolumesTransfersTest-1325050054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adac829b-db00-4652-aca4-f513b09727fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67f842c1-29fa-43ae-a86a-617a3c3d663f', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:28 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b73ef641-ddf4-489d-8d42-2dea6b1a33b1 tempest-VolumesTransfersTest-1325050054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71700012-2353-4d2a-9918-b181e8c0526d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:28 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-b73ef641-ddf4-489d-8d42-2dea6b1a33b1 tempest-VolumesTransfersTest-1325050054 None] Volume volume-67f842c1-29fa-43ae-a86a-617a3c3d663f (67f842c1-29fa-43ae-a86a-617a3c3d663f): created successfully
Apr 28 22:07:28 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b73ef641-ddf4-489d-8d42-2dea6b1a33b1 tempest-VolumesTransfersTest-1325050054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71700012-2353-4d2a-9918-b181e8c0526d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:28 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b73ef641-ddf4-489d-8d42-2dea6b1a33b1 tempest-VolumesTransfersTest-1325050054 None] Flow 'volume_create_manager' (fc52cd5f-3279-4910-a349-73535be7c639) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:07:28 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-848886da-7c3b-4a46-92ce-f08b2fa709c1 tempest-VolumesSnapshotListTestJSON-1176582296 None] Delete snapshot completed successfully.
Apr 28 22:07:28 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-848886da-7c3b-4a46-92ce-f08b2fa709c1 tempest-VolumesSnapshotListTestJSON-1176582296 None] Lock "cinder-3ad2d0a7-73f4-4855-bffd-3624ba296339-delete_snapshot" released by "delete_snapshot" :: held 5.235s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:07:28 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-b73ef641-ddf4-489d-8d42-2dea6b1a33b1 tempest-VolumesTransfersTest-1325050054 None] Created volume successfully.
Apr 28 22:07:28 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-5feaf40b-7d12-4c21-9534-1304699e071c tempest-ServersNegativeTestJSON-1397346110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:07:28 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5feaf40b-7d12-4c21-9534-1304699e071c tempest-ServersNegativeTestJSON-1397346110 None] Flow 'volume_create_manager' (162c6980-c430-4664-80c0-e2c761fe601e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:07:28 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5feaf40b-7d12-4c21-9534-1304699e071c tempest-ServersNegativeTestJSON-1397346110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82efe977-caf2-4ec4-a69e-f66b4cb6da8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:28 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5feaf40b-7d12-4c21-9534-1304699e071c tempest-ServersNegativeTestJSON-1397346110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82efe977-caf2-4ec4-a69e-f66b4cb6da8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:07:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1508656164',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=301914d1-3a18-4e98-84b0-26c59357d8f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d729c0c67681495f9ef886bf30a711e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:07:28Z,use_quota=True,user_id='24232d7f860e41fa8aaf1e264a3dc8c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:28 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5feaf40b-7d12-4c21-9534-1304699e071c tempest-ServersNegativeTestJSON-1397346110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f9d6593-cdd7-4aec-97ff-3b86449acca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:28 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5feaf40b-7d12-4c21-9534-1304699e071c tempest-ServersNegativeTestJSON-1397346110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f9d6593-cdd7-4aec-97ff-3b86449acca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:28 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5feaf40b-7d12-4c21-9534-1304699e071c tempest-ServersNegativeTestJSON-1397346110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44e88ced-be24-40e9-aa1f-27cb8bd03756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:28 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5feaf40b-7d12-4c21-9534-1304699e071c tempest-ServersNegativeTestJSON-1397346110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44e88ced-be24-40e9-aa1f-27cb8bd03756) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '301914d1-3a18-4e98-84b0-26c59357d8f2', 'volume_name': 'volume-301914d1-3a18-4e98-84b0-26c59357d8f2', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:28 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5feaf40b-7d12-4c21-9534-1304699e071c tempest-ServersNegativeTestJSON-1397346110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fb7919b-81c5-4817-9fec-8f2d9b43c5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:28 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5feaf40b-7d12-4c21-9534-1304699e071c tempest-ServersNegativeTestJSON-1397346110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fb7919b-81c5-4817-9fec-8f2d9b43c5d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:28 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5feaf40b-7d12-4c21-9534-1304699e071c tempest-ServersNegativeTestJSON-1397346110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a2a965b-a3ff-4d27-abc8-7886db035226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:28 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-5feaf40b-7d12-4c21-9534-1304699e071c tempest-ServersNegativeTestJSON-1397346110 None] Volume 301914d1-3a18-4e98-84b0-26c59357d8f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-301914d1-3a18-4e98-84b0-26c59357d8f2', 'volume_size': 1}
Apr 28 22:07:28 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-5feaf40b-7d12-4c21-9534-1304699e071c tempest-ServersNegativeTestJSON-1397346110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:07:28 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-c871fa0d-25ad-4eac-94ac-9c9c74e22a77 tempest-VolumesSnapshotListTestJSON-1176582296 None] Acquiring lock "cinder-04faca61-e870-438c-902a-fc0d41fdd8ea-delete_snapshot" by "delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:07:28 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-c871fa0d-25ad-4eac-94ac-9c9c74e22a77 tempest-VolumesSnapshotListTestJSON-1176582296 None] Lock "cinder-04faca61-e870-438c-902a-fc0d41fdd8ea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:07:28 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-c871fa0d-25ad-4eac-94ac-9c9c74e22a77 tempest-VolumesSnapshotListTestJSON-1176582296 None] Acquiring lock "cinder-quobyte-10716abc-ac76-45f1-9761-13f7a8eccf1c" by "delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:07:28 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-c871fa0d-25ad-4eac-94ac-9c9c74e22a77 tempest-VolumesSnapshotListTestJSON-1176582296 None] Lock "cinder-quobyte-10716abc-ac76-45f1-9761-13f7a8eccf1c" acquired by "delete_snapshot" :: waited 0.016s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:07:28 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-c871fa0d-25ad-4eac-94ac-9c9c74e22a77 tempest-VolumesSnapshotListTestJSON-1176582296 None] Acquiring lock "cinder-quobyte-04faca61-e870-438c-902a-fc0d41fdd8ea" by "_delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:07:28 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-c871fa0d-25ad-4eac-94ac-9c9c74e22a77 tempest-VolumesSnapshotListTestJSON-1176582296 None] Lock "cinder-quobyte-04faca61-e870-438c-902a-fc0d41fdd8ea" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:07:28 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-c871fa0d-25ad-4eac-94ac-9c9c74e22a77 tempest-VolumesSnapshotListTestJSON-1176582296 None] Deleting offline snapshot 04faca61-e870-438c-902a-fc0d41fdd8ea of volume 10716abc-ac76-45f1-9761-13f7a8eccf1c {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 22:07:28 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-c871fa0d-25ad-4eac-94ac-9c9c74e22a77 tempest-VolumesSnapshotListTestJSON-1176582296 None] snapshot_file for this snap is: volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.04faca61-e870-438c-902a-fc0d41fdd8ea {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 22:07:28 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aeba7f3-0ab1-4321-ac08-412fecc9619f]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:07:28 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c871fa0d-25ad-4eac-94ac-9c9c74e22a77 tempest-VolumesSnapshotListTestJSON-1176582296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.04faca61-e870-438c-902a-fc0d41fdd8ea {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:28 devstack sudo[87997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.04faca61-e870-438c-902a-fc0d41fdd8ea
Apr 28 22:07:28 devstack sudo[87997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:28 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-16ebc007-c79b-4df3-9b4f-91f3eec0b8f3 tempest-VolumesTransfersTest-1557461886 None] Acquiring lock "cinder-67f842c1-29fa-43ae-a86a-617a3c3d663f-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:07:28 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-16ebc007-c79b-4df3-9b4f-91f3eec0b8f3 tempest-VolumesTransfersTest-1557461886 None] Lock "cinder-67f842c1-29fa-43ae-a86a-617a3c3d663f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:07:28 devstack sudo[87995]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:28 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-19988625-267c-42c5-99b2-32ae59d7a78f tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3ec3f721-0545-4552-add7-a099f022ffe2 1073741824" returned: 0 in 1.001s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:29 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-16ebc007-c79b-4df3-9b4f-91f3eec0b8f3 tempest-VolumesTransfersTest-1557461886 None] Acquiring lock "cinder-quobyte-67f842c1-29fa-43ae-a86a-617a3c3d663f" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:07:29 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-16ebc007-c79b-4df3-9b4f-91f3eec0b8f3 tempest-VolumesTransfersTest-1557461886 None] Lock "cinder-quobyte-67f842c1-29fa-43ae-a86a-617a3c3d663f" acquired by "delete_volume" :: waited 0.023s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:07:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-19988625-267c-42c5-99b2-32ae59d7a78f tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3ec3f721-0545-4552-add7-a099f022ffe2 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:29 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f78c82-61c1-46f7-b91a-e2fc24c2801d]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:07:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-16ebc007-c79b-4df3-9b4f-91f3eec0b8f3 tempest-VolumesTransfersTest-1557461886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-67f842c1-29fa-43ae-a86a-617a3c3d663f {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:29 devstack sudo[88003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3ec3f721-0545-4552-add7-a099f022ffe2
Apr 28 22:07:29 devstack sudo[88003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:29 devstack sudo[88004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-67f842c1-29fa-43ae-a86a-617a3c3d663f
Apr 28 22:07:29 devstack sudo[88004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:29 devstack sudo[87997]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c871fa0d-25ad-4eac-94ac-9c9c74e22a77 tempest-VolumesSnapshotListTestJSON-1176582296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.04faca61-e870-438c-902a-fc0d41fdd8ea" returned: 0 in 0.846s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:29 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-c871fa0d-25ad-4eac-94ac-9c9c74e22a77 tempest-VolumesSnapshotListTestJSON-1176582296 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10716abc-ac76-45f1-9761-13f7a8eccf1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 22:07:29 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43b3c9b-a981-4549-a75c-aab1c2fa6ffb]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:07:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c871fa0d-25ad-4eac-94ac-9c9c74e22a77 tempest-VolumesSnapshotListTestJSON-1176582296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:29 devstack sudo[88010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c
Apr 28 22:07:29 devstack sudo[88010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:29 devstack sudo[88003]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-19988625-267c-42c5-99b2-32ae59d7a78f tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3ec3f721-0545-4552-add7-a099f022ffe2" returned: 0 in 0.701s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:29 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-19988625-267c-42c5-99b2-32ae59d7a78f tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] <== create_volume: return (1779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:07:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-19988625-267c-42c5-99b2-32ae59d7a78f tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.782s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:07:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-5feaf40b-7d12-4c21-9534-1304699e071c tempest-ServersNegativeTestJSON-1397346110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.408s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:07:29 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-5feaf40b-7d12-4c21-9534-1304699e071c tempest-ServersNegativeTestJSON-1397346110 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:07:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1508656164',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=301914d1-3a18-4e98-84b0-26c59357d8f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d729c0c67681495f9ef886bf30a711e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:07:28Z,use_quota=True,user_id='24232d7f860e41fa8aaf1e264a3dc8c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:07:29 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-5feaf40b-7d12-4c21-9534-1304699e071c tempest-ServersNegativeTestJSON-1397346110 None] Creating volume 301914d1-3a18-4e98-84b0-26c59357d8f2 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:07:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-5feaf40b-7d12-4c21-9534-1304699e071c tempest-ServersNegativeTestJSON-1397346110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:07:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-5feaf40b-7d12-4c21-9534-1304699e071c tempest-ServersNegativeTestJSON-1397346110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:07:29 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-5feaf40b-7d12-4c21-9534-1304699e071c tempest-ServersNegativeTestJSON-1397346110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:07:29 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-5feaf40b-7d12-4c21-9534-1304699e071c tempest-ServersNegativeTestJSON-1397346110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:07:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-5feaf40b-7d12-4c21-9534-1304699e071c tempest-ServersNegativeTestJSON-1397346110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:07:29 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-5feaf40b-7d12-4c21-9534-1304699e071c tempest-ServersNegativeTestJSON-1397346110 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:07:29 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-5feaf40b-7d12-4c21-9534-1304699e071c tempest-ServersNegativeTestJSON-1397346110 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:07:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5feaf40b-7d12-4c21-9534-1304699e071c tempest-ServersNegativeTestJSON-1397346110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-301914d1-3a18-4e98-84b0-26c59357d8f2 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:29 devstack sudo[88015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-301914d1-3a18-4e98-84b0-26c59357d8f2 1073741824
Apr 28 22:07:29 devstack sudo[88015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:29 devstack cinder-volume[83924]: DEBUG cinder.volume.volume_utils [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-19988625-267c-42c5-99b2-32ae59d7a78f tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Attempting download of eea3f98a-f64b-4ae5-950b-6d03ae89a234 ((None, [{'url': 'file:///opt/stack/data/glance/images/eea3f98a-f64b-4ae5-950b-6d03ae89a234', 'metadata': {}}])) to volume 3ec3f721-0545-4552-add7-a099f022ffe2. {{(pid=83924) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 28 22:07:29 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7b66b8-7a42-4370-908e-fe28956886a3]: (4, 'raw') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:07:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-19988625-267c-42c5-99b2-32ae59d7a78f tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eea3f98a-f64b-4ae5-950b-6d03ae89a234_igg5qe3u {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:29 devstack sudo[88004]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-16ebc007-c79b-4df3-9b4f-91f3eec0b8f3 tempest-VolumesTransfersTest-1557461886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-67f842c1-29fa-43ae-a86a-617a3c3d663f" returned: 0 in 0.865s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-16ebc007-c79b-4df3-9b4f-91f3eec0b8f3 tempest-VolumesTransfersTest-1557461886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-67f842c1-29fa-43ae-a86a-617a3c3d663f {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:29 devstack sudo[88019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-67f842c1-29fa-43ae-a86a-617a3c3d663f
Apr 28 22:07:29 devstack sudo[88019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:30 devstack sudo[88018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eea3f98a-f64b-4ae5-950b-6d03ae89a234_igg5qe3u
Apr 28 22:07:30 devstack sudo[88018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:30 devstack sudo[88010]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:30 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c871fa0d-25ad-4eac-94ac-9c9c74e22a77 tempest-VolumesSnapshotListTestJSON-1176582296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c" returned: 0 in 0.820s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:30 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c871fa0d-25ad-4eac-94ac-9c9c74e22a77 tempest-VolumesSnapshotListTestJSON-1176582296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.04faca61-e870-438c-902a-fc0d41fdd8ea {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:30 devstack sudo[88025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.04faca61-e870-438c-902a-fc0d41fdd8ea
Apr 28 22:07:30 devstack sudo[88025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:30 devstack sudo[88018]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:30 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-19988625-267c-42c5-99b2-32ae59d7a78f tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eea3f98a-f64b-4ae5-950b-6d03ae89a234_igg5qe3u" returned: 0 in 0.816s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:30 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-19988625-267c-42c5-99b2-32ae59d7a78f tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eea3f98a-f64b-4ae5-950b-6d03ae89a234_igg5qe3u {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:30 devstack sudo[88019]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:30 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-16ebc007-c79b-4df3-9b4f-91f3eec0b8f3 tempest-VolumesTransfersTest-1557461886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-67f842c1-29fa-43ae-a86a-617a3c3d663f" returned: 0 in 0.894s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:30 devstack sudo[88015]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:30 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5feaf40b-7d12-4c21-9534-1304699e071c tempest-ServersNegativeTestJSON-1397346110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-301914d1-3a18-4e98-84b0-26c59357d8f2 1073741824" returned: 0 in 1.080s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:30 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-16ebc007-c79b-4df3-9b4f-91f3eec0b8f3 tempest-VolumesTransfersTest-1557461886 None] Lock "cinder-quobyte-67f842c1-29fa-43ae-a86a-617a3c3d663f" released by "delete_volume" :: held 1.819s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:07:30 devstack sudo[88034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eea3f98a-f64b-4ae5-950b-6d03ae89a234_igg5qe3u
Apr 28 22:07:30 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5feaf40b-7d12-4c21-9534-1304699e071c tempest-ServersNegativeTestJSON-1397346110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-301914d1-3a18-4e98-84b0-26c59357d8f2 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:30 devstack sudo[88034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:30 devstack sudo[88040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-301914d1-3a18-4e98-84b0-26c59357d8f2
Apr 28 22:07:30 devstack sudo[88040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:30 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-16ebc007-c79b-4df3-9b4f-91f3eec0b8f3 tempest-VolumesTransfersTest-1557461886 None] Created reservations ['48b2528c-a850-484e-86e1-4b57431c138e', '654f8db8-cfc9-4d01-894c-43bf2813f402', '0d61cdeb-5802-424f-bd03-2c30d5ee9210', 'd90d2449-16b5-41ea-9580-f5af5f3413b0'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:07:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-16ebc007-c79b-4df3-9b4f-91f3eec0b8f3 tempest-VolumesTransfersTest-1557461886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:07:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-16ebc007-c79b-4df3-9b4f-91f3eec0b8f3 tempest-VolumesTransfersTest-1557461886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:07:31 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-16ebc007-c79b-4df3-9b4f-91f3eec0b8f3 tempest-VolumesTransfersTest-1557461886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:07:31 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-16ebc007-c79b-4df3-9b4f-91f3eec0b8f3 tempest-VolumesTransfersTest-1557461886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:07:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-16ebc007-c79b-4df3-9b4f-91f3eec0b8f3 tempest-VolumesTransfersTest-1557461886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:07:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-16ebc007-c79b-4df3-9b4f-91f3eec0b8f3 tempest-VolumesTransfersTest-1557461886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:31 devstack sudo[88025]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c871fa0d-25ad-4eac-94ac-9c9c74e22a77 tempest-VolumesSnapshotListTestJSON-1176582296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.04faca61-e870-438c-902a-fc0d41fdd8ea" returned: 0 in 0.911s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c871fa0d-25ad-4eac-94ac-9c9c74e22a77 tempest-VolumesSnapshotListTestJSON-1176582296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.04faca61-e870-438c-902a-fc0d41fdd8ea {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:31 devstack sudo[88042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:07:31 devstack sudo[88042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:31 devstack sudo[88043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.04faca61-e870-438c-902a-fc0d41fdd8ea
Apr 28 22:07:31 devstack sudo[88043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:31 devstack sudo[88034]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-19988625-267c-42c5-99b2-32ae59d7a78f tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eea3f98a-f64b-4ae5-950b-6d03ae89a234_igg5qe3u" returned: 1 in 1.138s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-19988625-267c-42c5-99b2-32ae59d7a78f tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eea3f98a-f64b-4ae5-950b-6d03ae89a234_igg5qe3u' failed. Not Retrying. {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 28 22:07:31 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[30137756-cda1-41d2-95eb-c5cd7601eecc]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:07:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-19988625-267c-42c5-99b2-32ae59d7a78f tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eea3f98a-f64b-4ae5-950b-6d03ae89a234_9vczntiidevstack@QuobyteHD {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:31 devstack sudo[88040]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5feaf40b-7d12-4c21-9534-1304699e071c tempest-ServersNegativeTestJSON-1397346110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-301914d1-3a18-4e98-84b0-26c59357d8f2" returned: 0 in 1.082s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:31 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-5feaf40b-7d12-4c21-9534-1304699e071c tempest-ServersNegativeTestJSON-1397346110 None] <== create_volume: return (2219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:07:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-5feaf40b-7d12-4c21-9534-1304699e071c tempest-ServersNegativeTestJSON-1397346110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.223s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:07:31 devstack sudo[88042]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:32 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-16ebc007-c79b-4df3-9b4f-91f3eec0b8f3 tempest-VolumesTransfersTest-1557461886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.928s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:32 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-16ebc007-c79b-4df3-9b4f-91f3eec0b8f3 tempest-VolumesTransfersTest-1557461886 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:07:32 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-16ebc007-c79b-4df3-9b4f-91f3eec0b8f3 tempest-VolumesTransfersTest-1557461886 None] Deleted volume successfully.
Apr 28 22:07:32 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5feaf40b-7d12-4c21-9534-1304699e071c tempest-ServersNegativeTestJSON-1397346110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a2a965b-a3ff-4d27-abc8-7886db035226) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-301914d1-3a18-4e98-84b0-26c59357d8f2', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:32 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5feaf40b-7d12-4c21-9534-1304699e071c tempest-ServersNegativeTestJSON-1397346110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64193de3-e367-4bda-8cd6-8bfc7dc54a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:32 devstack sudo[88050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eea3f98a-f64b-4ae5-950b-6d03ae89a234_9vczntiidevstack@QuobyteHD
Apr 28 22:07:32 devstack sudo[88050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:32 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-5feaf40b-7d12-4c21-9534-1304699e071c tempest-ServersNegativeTestJSON-1397346110 None] Volume volume-301914d1-3a18-4e98-84b0-26c59357d8f2 (301914d1-3a18-4e98-84b0-26c59357d8f2): created successfully
Apr 28 22:07:32 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5feaf40b-7d12-4c21-9534-1304699e071c tempest-ServersNegativeTestJSON-1397346110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64193de3-e367-4bda-8cd6-8bfc7dc54a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:32 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5feaf40b-7d12-4c21-9534-1304699e071c tempest-ServersNegativeTestJSON-1397346110 None] Flow 'volume_create_manager' (162c6980-c430-4664-80c0-e2c761fe601e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:07:32 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-16ebc007-c79b-4df3-9b4f-91f3eec0b8f3 tempest-VolumesTransfersTest-1557461886 None] Lock "cinder-67f842c1-29fa-43ae-a86a-617a3c3d663f-delete_volume" released by "delete_volume" :: held 3.202s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:07:32 devstack sudo[88043]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:32 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c871fa0d-25ad-4eac-94ac-9c9c74e22a77 tempest-VolumesSnapshotListTestJSON-1176582296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c.04faca61-e870-438c-902a-fc0d41fdd8ea" returned: 0 in 1.073s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:32 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-5feaf40b-7d12-4c21-9534-1304699e071c tempest-ServersNegativeTestJSON-1397346110 None] Created volume successfully.
Apr 28 22:07:32 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-c871fa0d-25ad-4eac-94ac-9c9c74e22a77 tempest-VolumesSnapshotListTestJSON-1176582296 None] Lock "cinder-quobyte-04faca61-e870-438c-902a-fc0d41fdd8ea" released by "_delete_snapshot" :: held 3.807s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:07:32 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-c871fa0d-25ad-4eac-94ac-9c9c74e22a77 tempest-VolumesSnapshotListTestJSON-1176582296 None] Lock "cinder-quobyte-10716abc-ac76-45f1-9761-13f7a8eccf1c" released by "delete_snapshot" :: held 3.837s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:07:32 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-c871fa0d-25ad-4eac-94ac-9c9c74e22a77 tempest-VolumesSnapshotListTestJSON-1176582296 None] Created reservations ['67f205d9-dc2f-444a-994a-ad9b1f8f34cc', '62eeea58-f0e4-4f6c-8e40-9848a6858506', 'e7b8b576-8a1a-4003-99b9-5989056cfd0f', '759cff44-a5b0-4a15-9c93-cbcdf2d69696'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:07:32 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-c871fa0d-25ad-4eac-94ac-9c9c74e22a77 tempest-VolumesSnapshotListTestJSON-1176582296 None] Delete snapshot completed successfully.
Apr 28 22:07:32 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-c871fa0d-25ad-4eac-94ac-9c9c74e22a77 tempest-VolumesSnapshotListTestJSON-1176582296 None] Lock "cinder-04faca61-e870-438c-902a-fc0d41fdd8ea-delete_snapshot" released by "delete_snapshot" :: held 4.006s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:07:32 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-767c5a68-d3e6-49d8-9962-335c0b70f6f0 tempest-VolumesSnapshotListTestJSON-1176582296 None] Acquiring lock "cinder-10716abc-ac76-45f1-9761-13f7a8eccf1c-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:07:32 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-767c5a68-d3e6-49d8-9962-335c0b70f6f0 tempest-VolumesSnapshotListTestJSON-1176582296 None] Lock "cinder-10716abc-ac76-45f1-9761-13f7a8eccf1c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:07:32 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-767c5a68-d3e6-49d8-9962-335c0b70f6f0 tempest-VolumesSnapshotListTestJSON-1176582296 None] Acquiring lock "cinder-quobyte-10716abc-ac76-45f1-9761-13f7a8eccf1c" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:07:32 devstack sudo[88050]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:32 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-19988625-267c-42c5-99b2-32ae59d7a78f tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eea3f98a-f64b-4ae5-950b-6d03ae89a234_9vczntiidevstack@QuobyteHD" returned: 0 in 1.009s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:32 devstack cinder-volume[83924]: DEBUG cinder.image.image_utils [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-19988625-267c-42c5-99b2-32ae59d7a78f tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] eea3f98a-f64b-4ae5-950b-6d03ae89a234 was qcow2, converting to raw {{(pid=83924) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 28 22:07:32 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-19988625-267c-42c5-99b2-32ae59d7a78f tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eea3f98a-f64b-4ae5-950b-6d03ae89a234_9vczntiidevstack@QuobyteHD /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3ec3f721-0545-4552-add7-a099f022ffe2 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:32 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-767c5a68-d3e6-49d8-9962-335c0b70f6f0 tempest-VolumesSnapshotListTestJSON-1176582296 None] Lock "cinder-quobyte-10716abc-ac76-45f1-9761-13f7a8eccf1c" acquired by "delete_volume" :: waited 0.042s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:07:32 devstack sudo[88058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eea3f98a-f64b-4ae5-950b-6d03ae89a234_9vczntiidevstack@QuobyteHD /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3ec3f721-0545-4552-add7-a099f022ffe2
Apr 28 22:07:32 devstack sudo[88058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:32 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0ce315-3cb4-47d2-a070-81eb841a2bcf]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:07:32 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-767c5a68-d3e6-49d8-9962-335c0b70f6f0 tempest-VolumesSnapshotListTestJSON-1176582296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:33 devstack sudo[88060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c
Apr 28 22:07:33 devstack sudo[88060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:33 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-3b02561b-e634-4e0c-8bdf-c1bec274e5b9 tempest-ServersNegativeTestJSON-1397346110 None] Acquiring lock "cinder-301914d1-3a18-4e98-84b0-26c59357d8f2-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:07:33 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-3b02561b-e634-4e0c-8bdf-c1bec274e5b9 tempest-ServersNegativeTestJSON-1397346110 None] Lock "cinder-301914d1-3a18-4e98-84b0-26c59357d8f2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:07:33 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-3b02561b-e634-4e0c-8bdf-c1bec274e5b9 tempest-ServersNegativeTestJSON-1397346110 None] Acquiring lock "cinder-quobyte-301914d1-3a18-4e98-84b0-26c59357d8f2" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:07:33 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-3b02561b-e634-4e0c-8bdf-c1bec274e5b9 tempest-ServersNegativeTestJSON-1397346110 None] Lock "cinder-quobyte-301914d1-3a18-4e98-84b0-26c59357d8f2" acquired by "delete_volume" :: waited 0.028s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:07:33 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8478723-b50a-4411-ade9-a056a80cd187]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:07:33 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-3b02561b-e634-4e0c-8bdf-c1bec274e5b9 tempest-ServersNegativeTestJSON-1397346110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-301914d1-3a18-4e98-84b0-26c59357d8f2 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:33 devstack sudo[88062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-301914d1-3a18-4e98-84b0-26c59357d8f2
Apr 28 22:07:33 devstack sudo[88062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:34 devstack sudo[88060]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:34 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-767c5a68-d3e6-49d8-9962-335c0b70f6f0 tempest-VolumesSnapshotListTestJSON-1176582296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c" returned: 0 in 1.140s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:34 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-767c5a68-d3e6-49d8-9962-335c0b70f6f0 tempest-VolumesSnapshotListTestJSON-1176582296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:34 devstack sudo[88079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c
Apr 28 22:07:34 devstack sudo[88079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:34 devstack sudo[88062]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:34 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-3b02561b-e634-4e0c-8bdf-c1bec274e5b9 tempest-ServersNegativeTestJSON-1397346110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-301914d1-3a18-4e98-84b0-26c59357d8f2" returned: 0 in 1.028s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:34 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-3b02561b-e634-4e0c-8bdf-c1bec274e5b9 tempest-ServersNegativeTestJSON-1397346110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-301914d1-3a18-4e98-84b0-26c59357d8f2 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:34 devstack sudo[88085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-301914d1-3a18-4e98-84b0-26c59357d8f2
Apr 28 22:07:34 devstack sudo[88085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:35 devstack sudo[88079]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:35 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-767c5a68-d3e6-49d8-9962-335c0b70f6f0 tempest-VolumesSnapshotListTestJSON-1176582296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10716abc-ac76-45f1-9761-13f7a8eccf1c" returned: 0 in 1.041s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:35 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-767c5a68-d3e6-49d8-9962-335c0b70f6f0 tempest-VolumesSnapshotListTestJSON-1176582296 None] Lock "cinder-quobyte-10716abc-ac76-45f1-9761-13f7a8eccf1c" released by "delete_volume" :: held 2.275s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:07:35 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-767c5a68-d3e6-49d8-9962-335c0b70f6f0 tempest-VolumesSnapshotListTestJSON-1176582296 None] Created reservations ['305e3e1c-52e6-482f-82f1-faeaddf804c2', 'c4e15308-eb27-4bf2-9498-f7454d41b604', 'fca8644b-09b1-4927-be98-929f5a98eab9', '51b6d5f9-a03a-4cfc-98c4-eb24e3be8480'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:07:35 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-767c5a68-d3e6-49d8-9962-335c0b70f6f0 tempest-VolumesSnapshotListTestJSON-1176582296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:07:35 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-767c5a68-d3e6-49d8-9962-335c0b70f6f0 tempest-VolumesSnapshotListTestJSON-1176582296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:07:35 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-767c5a68-d3e6-49d8-9962-335c0b70f6f0 tempest-VolumesSnapshotListTestJSON-1176582296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:07:35 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-767c5a68-d3e6-49d8-9962-335c0b70f6f0 tempest-VolumesSnapshotListTestJSON-1176582296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:07:35 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-767c5a68-d3e6-49d8-9962-335c0b70f6f0 tempest-VolumesSnapshotListTestJSON-1176582296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:07:35 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-767c5a68-d3e6-49d8-9962-335c0b70f6f0 tempest-VolumesSnapshotListTestJSON-1176582296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:35 devstack sudo[88090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:07:35 devstack sudo[88090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:35 devstack sudo[88058]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:35 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-19988625-267c-42c5-99b2-32ae59d7a78f tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eea3f98a-f64b-4ae5-950b-6d03ae89a234_9vczntiidevstack@QuobyteHD /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3ec3f721-0545-4552-add7-a099f022ffe2" returned: 0 in 2.706s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:35 devstack cinder-volume[83924]: DEBUG cinder.image.image_utils [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-19988625-267c-42c5-99b2-32ae59d7a78f tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_eea3f98a-f64b-4ae5-950b-6d03ae89a234_9vczntiidevstack@QuobyteHD, size 112.00 MB, duration 2.71 sec, destination /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3ec3f721-0545-4552-add7-a099f022ffe2 {{(pid=83924) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 28 22:07:35 devstack cinder-volume[83924]: INFO cinder.image.image_utils [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-19988625-267c-42c5-99b2-32ae59d7a78f tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Converted 112.00 MB image at 41.28 MB/s
Apr 28 22:07:35 devstack sudo[88085]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:35 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-19988625-267c-42c5-99b2-32ae59d7a78f tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3ec3f721-0545-4552-add7-a099f022ffe2 1G {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:35 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-3b02561b-e634-4e0c-8bdf-c1bec274e5b9 tempest-ServersNegativeTestJSON-1397346110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-301914d1-3a18-4e98-84b0-26c59357d8f2" returned: 0 in 1.063s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:35 devstack sudo[88093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3ec3f721-0545-4552-add7-a099f022ffe2 1G
Apr 28 22:07:35 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-3b02561b-e634-4e0c-8bdf-c1bec274e5b9 tempest-ServersNegativeTestJSON-1397346110 None] Lock "cinder-quobyte-301914d1-3a18-4e98-84b0-26c59357d8f2" released by "delete_volume" :: held 2.199s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:07:35 devstack sudo[88093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:35 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-3b02561b-e634-4e0c-8bdf-c1bec274e5b9 tempest-ServersNegativeTestJSON-1397346110 None] Created reservations ['fe2d7ca1-6165-4cdb-948a-0c73bece932a', '7de2c18c-f0ec-4a47-a748-59cede9c2342', '97e31066-7e1c-4958-aa36-ce2f68c3a5c1', '09630589-6fc8-4842-ab61-ef27890d9af4'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:07:35 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-3b02561b-e634-4e0c-8bdf-c1bec274e5b9 tempest-ServersNegativeTestJSON-1397346110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:07:35 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-3b02561b-e634-4e0c-8bdf-c1bec274e5b9 tempest-ServersNegativeTestJSON-1397346110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:07:35 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-3b02561b-e634-4e0c-8bdf-c1bec274e5b9 tempest-ServersNegativeTestJSON-1397346110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:07:35 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-3b02561b-e634-4e0c-8bdf-c1bec274e5b9 tempest-ServersNegativeTestJSON-1397346110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:07:35 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-3b02561b-e634-4e0c-8bdf-c1bec274e5b9 tempest-ServersNegativeTestJSON-1397346110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:07:35 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-3b02561b-e634-4e0c-8bdf-c1bec274e5b9 tempest-ServersNegativeTestJSON-1397346110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:35 devstack sudo[88095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:07:35 devstack sudo[88095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:36 devstack sudo[88090]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:36 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-767c5a68-d3e6-49d8-9962-335c0b70f6f0 tempest-VolumesSnapshotListTestJSON-1176582296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.896s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:36 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-767c5a68-d3e6-49d8-9962-335c0b70f6f0 tempest-VolumesSnapshotListTestJSON-1176582296 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:07:36 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-767c5a68-d3e6-49d8-9962-335c0b70f6f0 tempest-VolumesSnapshotListTestJSON-1176582296 None] Deleted volume successfully.
Apr 28 22:07:36 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-767c5a68-d3e6-49d8-9962-335c0b70f6f0 tempest-VolumesSnapshotListTestJSON-1176582296 None] Lock "cinder-10716abc-ac76-45f1-9761-13f7a8eccf1c-delete_volume" released by "delete_volume" :: held 3.522s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:07:36 devstack sudo[88093]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:36 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-19988625-267c-42c5-99b2-32ae59d7a78f tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3ec3f721-0545-4552-add7-a099f022ffe2 1G" returned: 0 in 0.924s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:36 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b41148-0588-45a9-acd8-7d6a03818b98]: (4, 'raw') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:07:36 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-19988625-267c-42c5-99b2-32ae59d7a78f tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3ec3f721-0545-4552-add7-a099f022ffe2 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:36 devstack sudo[88095]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:36 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-3b02561b-e634-4e0c-8bdf-c1bec274e5b9 tempest-ServersNegativeTestJSON-1397346110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.780s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:36 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-3b02561b-e634-4e0c-8bdf-c1bec274e5b9 tempest-ServersNegativeTestJSON-1397346110 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:07:36 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-3b02561b-e634-4e0c-8bdf-c1bec274e5b9 tempest-ServersNegativeTestJSON-1397346110 None] Deleted volume successfully.
Apr 28 22:07:36 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-3b02561b-e634-4e0c-8bdf-c1bec274e5b9 tempest-ServersNegativeTestJSON-1397346110 None] Lock "cinder-301914d1-3a18-4e98-84b0-26c59357d8f2-delete_volume" released by "delete_volume" :: held 3.262s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:07:36 devstack sudo[88102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3ec3f721-0545-4552-add7-a099f022ffe2
Apr 28 22:07:36 devstack sudo[88102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:36 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-bab10314-003c-402c-849a-3d0c6893d9d8 tempest-ServersNegativeTestJSON-1397346110 None] Acquiring lock "cinder-dba6dbfb-d587-4653-8ba1-58657e9387a2-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:07:36 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-bab10314-003c-402c-849a-3d0c6893d9d8 tempest-ServersNegativeTestJSON-1397346110 None] Lock "cinder-dba6dbfb-d587-4653-8ba1-58657e9387a2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:07:37 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-bab10314-003c-402c-849a-3d0c6893d9d8 tempest-ServersNegativeTestJSON-1397346110 None] Acquiring lock "cinder-quobyte-dba6dbfb-d587-4653-8ba1-58657e9387a2" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:07:37 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-bab10314-003c-402c-849a-3d0c6893d9d8 tempest-ServersNegativeTestJSON-1397346110 None] Lock "cinder-quobyte-dba6dbfb-d587-4653-8ba1-58657e9387a2" acquired by "delete_volume" :: waited 0.019s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:07:37 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[31681c8a-7121-49f7-8ce4-d8859d824226]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:07:37 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-bab10314-003c-402c-849a-3d0c6893d9d8 tempest-ServersNegativeTestJSON-1397346110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-dba6dbfb-d587-4653-8ba1-58657e9387a2 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:37 devstack sudo[88104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-dba6dbfb-d587-4653-8ba1-58657e9387a2
Apr 28 22:07:37 devstack sudo[88104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:37 devstack sudo[88102]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:37 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-19988625-267c-42c5-99b2-32ae59d7a78f tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3ec3f721-0545-4552-add7-a099f022ffe2" returned: 0 in 1.000s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:37 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-19988625-267c-42c5-99b2-32ae59d7a78f tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3ec3f721-0545-4552-add7-a099f022ffe2 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:37 devstack sudo[88108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3ec3f721-0545-4552-add7-a099f022ffe2
Apr 28 22:07:37 devstack sudo[88108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:38 devstack sudo[88104]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:38 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-bab10314-003c-402c-849a-3d0c6893d9d8 tempest-ServersNegativeTestJSON-1397346110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-dba6dbfb-d587-4653-8ba1-58657e9387a2" returned: 0 in 0.961s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:38 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-bab10314-003c-402c-849a-3d0c6893d9d8 tempest-ServersNegativeTestJSON-1397346110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-dba6dbfb-d587-4653-8ba1-58657e9387a2 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:38 devstack sudo[88113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-dba6dbfb-d587-4653-8ba1-58657e9387a2
Apr 28 22:07:38 devstack sudo[88113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:38 devstack sudo[88108]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:38 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-19988625-267c-42c5-99b2-32ae59d7a78f tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3ec3f721-0545-4552-add7-a099f022ffe2" returned: 1 in 1.030s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:38 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-19988625-267c-42c5-99b2-32ae59d7a78f tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3ec3f721-0545-4552-add7-a099f022ffe2' failed. Not Retrying. {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 28 22:07:38 devstack cinder-volume[83924]: DEBUG cinder.volume.volume_utils [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-19988625-267c-42c5-99b2-32ae59d7a78f tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Downloaded image eea3f98a-f64b-4ae5-950b-6d03ae89a234 ((None, [{'url': 'file:///opt/stack/data/glance/images/eea3f98a-f64b-4ae5-950b-6d03ae89a234', 'metadata': {}}])) to volume 3ec3f721-0545-4552-add7-a099f022ffe2 successfully. {{(pid=83924) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 28 22:07:38 devstack cinder-volume[83924]: DEBUG cinder.image.image_utils [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-19988625-267c-42c5-99b2-32ae59d7a78f tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Temporary image eea3f98a-f64b-4ae5-950b-6d03ae89a234 for user 24b64e2dfae54a799b1d01a1b58253a8 is deleted. {{(pid=83924) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 28 22:07:38 devstack cinder-volume[83924]: DEBUG cinder.volume.volume_utils [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-19988625-267c-42c5-99b2-32ae59d7a78f tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Marking volume 3ec3f721-0545-4552-add7-a099f022ffe2 as bootable. {{(pid=83924) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 28 22:07:38 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-19988625-267c-42c5-99b2-32ae59d7a78f tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Copying metadata from image eea3f98a-f64b-4ae5-950b-6d03ae89a234 to 3ec3f721-0545-4552-add7-a099f022ffe2. {{(pid=83924) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 28 22:07:38 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-19988625-267c-42c5-99b2-32ae59d7a78f tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Creating volume glance metadata for volume 3ec3f721-0545-4552-add7-a099f022ffe2 backed by image eea3f98a-f64b-4ae5-950b-6d03ae89a234 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'eea3f98a-f64b-4ae5-950b-6d03ae89a234', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83924) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 28 22:07:38 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-19988625-267c-42c5-99b2-32ae59d7a78f tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc633e74-4292-40f7-8736-1e8a474b4e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ec3f721-0545-4552-add7-a099f022ffe2', 'volume_size': 1, 'image_id': 'eea3f98a-f64b-4ae5-950b-6d03ae89a234', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eea3f98a-f64b-4ae5-950b-6d03ae89a234', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c4919824590f4575ada7761aea13c85e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eea3f98a-f64b-4ae5-950b-6d03ae89a234', 'created_at': datetime.datetime(2026, 4, 28, 19, 59, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 19, 59, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eea3f98a-f64b-4ae5-950b-6d03ae89a234/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7844d5988f50>}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:38 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-19988625-267c-42c5-99b2-32ae59d7a78f tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d13ea37-da2e-41c6-8448-c6c509e1fbaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:38 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-19988625-267c-42c5-99b2-32ae59d7a78f tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Volume volume-3ec3f721-0545-4552-add7-a099f022ffe2 (3ec3f721-0545-4552-add7-a099f022ffe2): created successfully
Apr 28 22:07:38 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-19988625-267c-42c5-99b2-32ae59d7a78f tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d13ea37-da2e-41c6-8448-c6c509e1fbaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:38 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-19988625-267c-42c5-99b2-32ae59d7a78f tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Flow 'volume_create_manager' (c48a859c-396e-4ee0-85e8-fd15ecc67c9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:07:38 devstack cinder-volume[83924]: INFO cinder.volume.manager [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-19988625-267c-42c5-99b2-32ae59d7a78f tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Created volume successfully.
Apr 28 22:07:38 devstack sudo[88113]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:38 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-bab10314-003c-402c-849a-3d0c6893d9d8 tempest-ServersNegativeTestJSON-1397346110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-dba6dbfb-d587-4653-8ba1-58657e9387a2" returned: 0 in 0.852s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:38 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-bab10314-003c-402c-849a-3d0c6893d9d8 tempest-ServersNegativeTestJSON-1397346110 None] Lock "cinder-quobyte-dba6dbfb-d587-4653-8ba1-58657e9387a2" released by "delete_volume" :: held 1.858s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:07:38 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-bab10314-003c-402c-849a-3d0c6893d9d8 tempest-ServersNegativeTestJSON-1397346110 None] Created reservations ['2571b4f1-ef64-44f2-9da0-13b506c1fd13', 'e20385d3-f2cf-4bbd-90f3-2628624f0e06', 'e1a7c3b1-d652-43c1-93c1-6bbcb98ab0bb', 'b9a65c79-0d64-4b2e-a0fa-e1c2c6a7e74d'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:07:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-bab10314-003c-402c-849a-3d0c6893d9d8 tempest-ServersNegativeTestJSON-1397346110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:07:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-bab10314-003c-402c-849a-3d0c6893d9d8 tempest-ServersNegativeTestJSON-1397346110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:07:39 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-bab10314-003c-402c-849a-3d0c6893d9d8 tempest-ServersNegativeTestJSON-1397346110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:07:39 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-bab10314-003c-402c-849a-3d0c6893d9d8 tempest-ServersNegativeTestJSON-1397346110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:07:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-bab10314-003c-402c-849a-3d0c6893d9d8 tempest-ServersNegativeTestJSON-1397346110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:07:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-bab10314-003c-402c-849a-3d0c6893d9d8 tempest-ServersNegativeTestJSON-1397346110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:39 devstack sudo[88119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:07:39 devstack sudo[88119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:39 devstack cinder-volume[83924]: DEBUG oslo_service.periodic_task [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83924) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 28 22:07:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:07:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:07:39 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:07:39 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:07:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:07:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:39 devstack sudo[88121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:07:39 devstack sudo[88121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:40 devstack sudo[88119]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:40 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-bab10314-003c-402c-849a-3d0c6893d9d8 tempest-ServersNegativeTestJSON-1397346110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 1.092s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:40 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-bab10314-003c-402c-849a-3d0c6893d9d8 tempest-ServersNegativeTestJSON-1397346110 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:07:40 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-bab10314-003c-402c-849a-3d0c6893d9d8 tempest-ServersNegativeTestJSON-1397346110 None] Deleted volume successfully.
Apr 28 22:07:40 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-bab10314-003c-402c-849a-3d0c6893d9d8 tempest-ServersNegativeTestJSON-1397346110 None] Lock "cinder-dba6dbfb-d587-4653-8ba1-58657e9387a2-delete_volume" released by "delete_volume" :: held 3.260s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:07:40 devstack sudo[88121]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:40 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.850s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:40 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:07:41 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-34aecd01-39f8-4d63-964e-f00a0d28a4a1 tempest-CreateVolumesFromImageTest-1947233898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:07:41 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-34aecd01-39f8-4d63-964e-f00a0d28a4a1 tempest-CreateVolumesFromImageTest-1947233898 None] Flow 'volume_create_manager' (5403fb40-d4d4-4b17-89fc-f06fd31ed741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:07:41 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-34aecd01-39f8-4d63-964e-f00a0d28a4a1 tempest-CreateVolumesFromImageTest-1947233898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a92a7e35-2a54-420c-a407-8ca0f134d868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:41 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-34aecd01-39f8-4d63-964e-f00a0d28a4a1 tempest-CreateVolumesFromImageTest-1947233898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a92a7e35-2a54-420c-a407-8ca0f134d868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:07:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1823731037',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6abd9c05-af76-4a9d-972b-75990911039b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f5e84999d8545819116c06fc7b36b0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:07:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:07:41Z,use_quota=True,user_id='ddd305a2da2a4bf0a965b7080b07399a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:41 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-34aecd01-39f8-4d63-964e-f00a0d28a4a1 tempest-CreateVolumesFromImageTest-1947233898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ea32b4d-a1e6-4112-92a1-1630ba621b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:41 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-34aecd01-39f8-4d63-964e-f00a0d28a4a1 tempest-CreateVolumesFromImageTest-1947233898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ea32b4d-a1e6-4112-92a1-1630ba621b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:41 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-34aecd01-39f8-4d63-964e-f00a0d28a4a1 tempest-CreateVolumesFromImageTest-1947233898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b63f72c9-5a93-47cb-96c1-29758b46b135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:41 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-34aecd01-39f8-4d63-964e-f00a0d28a4a1 tempest-CreateVolumesFromImageTest-1947233898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b63f72c9-5a93-47cb-96c1-29758b46b135) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6abd9c05-af76-4a9d-972b-75990911039b', 'volume_name': 'volume-6abd9c05-af76-4a9d-972b-75990911039b', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:41 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-34aecd01-39f8-4d63-964e-f00a0d28a4a1 tempest-CreateVolumesFromImageTest-1947233898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7f68241-8425-4b34-b51f-a436d5e2a234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:41 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-34aecd01-39f8-4d63-964e-f00a0d28a4a1 tempest-CreateVolumesFromImageTest-1947233898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7f68241-8425-4b34-b51f-a436d5e2a234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:41 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-34aecd01-39f8-4d63-964e-f00a0d28a4a1 tempest-CreateVolumesFromImageTest-1947233898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b0b33e7-a531-4567-943a-0c837792232c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:41 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-34aecd01-39f8-4d63-964e-f00a0d28a4a1 tempest-CreateVolumesFromImageTest-1947233898 None] Volume 6abd9c05-af76-4a9d-972b-75990911039b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6abd9c05-af76-4a9d-972b-75990911039b', 'volume_size': 1}
Apr 28 22:07:41 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-34aecd01-39f8-4d63-964e-f00a0d28a4a1 tempest-CreateVolumesFromImageTest-1947233898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:07:41 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-34aecd01-39f8-4d63-964e-f00a0d28a4a1 tempest-CreateVolumesFromImageTest-1947233898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:07:41 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-34aecd01-39f8-4d63-964e-f00a0d28a4a1 tempest-CreateVolumesFromImageTest-1947233898 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:07:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1823731037',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6abd9c05-af76-4a9d-972b-75990911039b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f5e84999d8545819116c06fc7b36b0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:07:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:07:41Z,use_quota=True,user_id='ddd305a2da2a4bf0a965b7080b07399a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:07:41 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-34aecd01-39f8-4d63-964e-f00a0d28a4a1 tempest-CreateVolumesFromImageTest-1947233898 None] Creating volume 6abd9c05-af76-4a9d-972b-75990911039b {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:07:41 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-34aecd01-39f8-4d63-964e-f00a0d28a4a1 tempest-CreateVolumesFromImageTest-1947233898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:07:41 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-34aecd01-39f8-4d63-964e-f00a0d28a4a1 tempest-CreateVolumesFromImageTest-1947233898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:07:41 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-34aecd01-39f8-4d63-964e-f00a0d28a4a1 tempest-CreateVolumesFromImageTest-1947233898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:07:41 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-34aecd01-39f8-4d63-964e-f00a0d28a4a1 tempest-CreateVolumesFromImageTest-1947233898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:07:41 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-34aecd01-39f8-4d63-964e-f00a0d28a4a1 tempest-CreateVolumesFromImageTest-1947233898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:07:41 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-34aecd01-39f8-4d63-964e-f00a0d28a4a1 tempest-CreateVolumesFromImageTest-1947233898 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:07:41 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-34aecd01-39f8-4d63-964e-f00a0d28a4a1 tempest-CreateVolumesFromImageTest-1947233898 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:07:41 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-34aecd01-39f8-4d63-964e-f00a0d28a4a1 tempest-CreateVolumesFromImageTest-1947233898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6abd9c05-af76-4a9d-972b-75990911039b 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:41 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-eca7b459-d8e5-4bca-8ec4-3a797cf01c66 tempest-VolumesTransfersV357Test-514240020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:07:41 devstack sudo[88166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6abd9c05-af76-4a9d-972b-75990911039b 1073741824
Apr 28 22:07:41 devstack sudo[88166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:41 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-eca7b459-d8e5-4bca-8ec4-3a797cf01c66 tempest-VolumesTransfersV357Test-514240020 None] Flow 'volume_create_manager' (d04b8765-961f-4fcf-9e6c-3ed387fb1c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:07:41 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-eca7b459-d8e5-4bca-8ec4-3a797cf01c66 tempest-VolumesTransfersV357Test-514240020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8bd11c1-e968-4d94-8ff5-8bf179257272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:41 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-eca7b459-d8e5-4bca-8ec4-3a797cf01c66 tempest-VolumesTransfersV357Test-514240020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8bd11c1-e968-4d94-8ff5-8bf179257272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:07:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1133096972',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7930941d-0d30-40b5-bfe2-e09d150a9ef8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='221dbd889a8040b2962ed37916037164',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:07:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:07:41Z,use_quota=True,user_id='a58760f43e4b494e94a3be850786a77a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:41 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-eca7b459-d8e5-4bca-8ec4-3a797cf01c66 tempest-VolumesTransfersV357Test-514240020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11ed46aa-47e9-497a-9029-b2be98e76e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:41 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-eca7b459-d8e5-4bca-8ec4-3a797cf01c66 tempest-VolumesTransfersV357Test-514240020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11ed46aa-47e9-497a-9029-b2be98e76e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:41 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-eca7b459-d8e5-4bca-8ec4-3a797cf01c66 tempest-VolumesTransfersV357Test-514240020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ae8e277-2541-4aa3-841b-29d5ee1c3840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:41 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-eca7b459-d8e5-4bca-8ec4-3a797cf01c66 tempest-VolumesTransfersV357Test-514240020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ae8e277-2541-4aa3-841b-29d5ee1c3840) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7930941d-0d30-40b5-bfe2-e09d150a9ef8', 'volume_name': 'volume-7930941d-0d30-40b5-bfe2-e09d150a9ef8', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:41 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-eca7b459-d8e5-4bca-8ec4-3a797cf01c66 tempest-VolumesTransfersV357Test-514240020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18320b80-dd86-4fea-a56d-81d78f0bd2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:41 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-eca7b459-d8e5-4bca-8ec4-3a797cf01c66 tempest-VolumesTransfersV357Test-514240020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18320b80-dd86-4fea-a56d-81d78f0bd2fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:41 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-eca7b459-d8e5-4bca-8ec4-3a797cf01c66 tempest-VolumesTransfersV357Test-514240020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b764479-5080-4573-9467-93273b50f7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:41 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-eca7b459-d8e5-4bca-8ec4-3a797cf01c66 tempest-VolumesTransfersV357Test-514240020 None] Volume 7930941d-0d30-40b5-bfe2-e09d150a9ef8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7930941d-0d30-40b5-bfe2-e09d150a9ef8', 'volume_size': 1}
Apr 28 22:07:41 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-eca7b459-d8e5-4bca-8ec4-3a797cf01c66 tempest-VolumesTransfersV357Test-514240020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:07:41 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-8513e24f-b205-4a7e-810c-1d92a3ab1f5c tempest-CreateVolumesFromImageTest-1947233898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:07:41 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-8513e24f-b205-4a7e-810c-1d92a3ab1f5c tempest-CreateVolumesFromImageTest-1947233898 None] Flow 'volume_create_manager' (f845cdf7-5782-4ffe-8ff3-86481780cf25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:07:41 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-8513e24f-b205-4a7e-810c-1d92a3ab1f5c tempest-CreateVolumesFromImageTest-1947233898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70ba17d6-667a-43db-86d9-7d439c3504e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:41 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-8513e24f-b205-4a7e-810c-1d92a3ab1f5c tempest-CreateVolumesFromImageTest-1947233898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70ba17d6-667a-43db-86d9-7d439c3504e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:07:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1654393130',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c776d5fb-dc0e-4bfb-beaa-1c87e8604d0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f5e84999d8545819116c06fc7b36b0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:07:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:07:42Z,use_quota=True,user_id='ddd305a2da2a4bf0a965b7080b07399a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:41 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-8513e24f-b205-4a7e-810c-1d92a3ab1f5c tempest-CreateVolumesFromImageTest-1947233898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf075ee6-464e-4d24-ba15-59fe1ba48a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:41 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-8513e24f-b205-4a7e-810c-1d92a3ab1f5c tempest-CreateVolumesFromImageTest-1947233898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf075ee6-464e-4d24-ba15-59fe1ba48a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:41 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-8513e24f-b205-4a7e-810c-1d92a3ab1f5c tempest-CreateVolumesFromImageTest-1947233898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbbd3a66-ffe7-4352-a3b0-339854bb8ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:41 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-8513e24f-b205-4a7e-810c-1d92a3ab1f5c tempest-CreateVolumesFromImageTest-1947233898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbbd3a66-ffe7-4352-a3b0-339854bb8ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c776d5fb-dc0e-4bfb-beaa-1c87e8604d0c', 'volume_name': 'volume-c776d5fb-dc0e-4bfb-beaa-1c87e8604d0c', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:41 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-8513e24f-b205-4a7e-810c-1d92a3ab1f5c tempest-CreateVolumesFromImageTest-1947233898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33e77713-0f23-4939-b819-2d58c9337492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:41 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-8513e24f-b205-4a7e-810c-1d92a3ab1f5c tempest-CreateVolumesFromImageTest-1947233898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33e77713-0f23-4939-b819-2d58c9337492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:42 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-8513e24f-b205-4a7e-810c-1d92a3ab1f5c tempest-CreateVolumesFromImageTest-1947233898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4cc5288-faf0-43f3-9b57-2a4893688584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:42 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-8513e24f-b205-4a7e-810c-1d92a3ab1f5c tempest-CreateVolumesFromImageTest-1947233898 None] Volume c776d5fb-dc0e-4bfb-beaa-1c87e8604d0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c776d5fb-dc0e-4bfb-beaa-1c87e8604d0c', 'volume_size': 1}
Apr 28 22:07:42 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-8513e24f-b205-4a7e-810c-1d92a3ab1f5c tempest-CreateVolumesFromImageTest-1947233898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:07:42 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-20658d09-7f82-44d1-b157-5f93c6cd2aec tempest-CreateVolumesFromImageTest-1947233898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:07:42 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-20658d09-7f82-44d1-b157-5f93c6cd2aec tempest-CreateVolumesFromImageTest-1947233898 None] Flow 'volume_create_manager' (cacc31af-83bf-414a-8a0e-61b543ba067d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:07:42 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-20658d09-7f82-44d1-b157-5f93c6cd2aec tempest-CreateVolumesFromImageTest-1947233898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea66568b-1563-4ea9-9404-340ca4602465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:42 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-c55d1407-e1e7-4344-ba70-bbc62bf28364 tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:07:42 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-20658d09-7f82-44d1-b157-5f93c6cd2aec tempest-CreateVolumesFromImageTest-1947233898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea66568b-1563-4ea9-9404-340ca4602465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:07:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1237303790',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fe9777d-385d-40d8-bb05-b312df91a923,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f5e84999d8545819116c06fc7b36b0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:07:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:07:42Z,use_quota=True,user_id='ddd305a2da2a4bf0a965b7080b07399a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:42 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-20658d09-7f82-44d1-b157-5f93c6cd2aec tempest-CreateVolumesFromImageTest-1947233898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d82fceb-7db0-4af7-955c-32d8419b889b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:42 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-20658d09-7f82-44d1-b157-5f93c6cd2aec tempest-CreateVolumesFromImageTest-1947233898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d82fceb-7db0-4af7-955c-32d8419b889b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:42 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-20658d09-7f82-44d1-b157-5f93c6cd2aec tempest-CreateVolumesFromImageTest-1947233898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef55fcda-3b90-4212-b132-67d571ab0623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:42 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-20658d09-7f82-44d1-b157-5f93c6cd2aec tempest-CreateVolumesFromImageTest-1947233898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef55fcda-3b90-4212-b132-67d571ab0623) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fe9777d-385d-40d8-bb05-b312df91a923', 'volume_name': 'volume-0fe9777d-385d-40d8-bb05-b312df91a923', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:42 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-20658d09-7f82-44d1-b157-5f93c6cd2aec tempest-CreateVolumesFromImageTest-1947233898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc076582-4780-46e0-9f0c-67393515a67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:42 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-20658d09-7f82-44d1-b157-5f93c6cd2aec tempest-CreateVolumesFromImageTest-1947233898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc076582-4780-46e0-9f0c-67393515a67f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:42 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-20658d09-7f82-44d1-b157-5f93c6cd2aec tempest-CreateVolumesFromImageTest-1947233898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56509cae-2dbc-4a2f-a74e-95516db024fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:42 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-20658d09-7f82-44d1-b157-5f93c6cd2aec tempest-CreateVolumesFromImageTest-1947233898 None] Volume 0fe9777d-385d-40d8-bb05-b312df91a923: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fe9777d-385d-40d8-bb05-b312df91a923', 'volume_size': 1}
Apr 28 22:07:42 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-20658d09-7f82-44d1-b157-5f93c6cd2aec tempest-CreateVolumesFromImageTest-1947233898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:07:42 devstack sudo[88166]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:42 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-34aecd01-39f8-4d63-964e-f00a0d28a4a1 tempest-CreateVolumesFromImageTest-1947233898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6abd9c05-af76-4a9d-972b-75990911039b 1073741824" returned: 0 in 1.276s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:42 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-6312db7d-4c4e-44e6-bc47-fa9b9d66b1f2 tempest-CreateVolumesFromImageTest-1947233898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:07:42 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-6312db7d-4c4e-44e6-bc47-fa9b9d66b1f2 tempest-CreateVolumesFromImageTest-1947233898 None] Flow 'volume_create_manager' (4d97d252-6301-4513-a0fd-d68901619d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:07:42 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-6312db7d-4c4e-44e6-bc47-fa9b9d66b1f2 tempest-CreateVolumesFromImageTest-1947233898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (822c289c-0051-42d6-8bd3-cab83d432d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:42 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-6312db7d-4c4e-44e6-bc47-fa9b9d66b1f2 tempest-CreateVolumesFromImageTest-1947233898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (822c289c-0051-42d6-8bd3-cab83d432d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:07:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1802572336',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2394b175-5c05-4ad0-ae50-fb4e0e1bd05a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f5e84999d8545819116c06fc7b36b0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:07:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:07:43Z,use_quota=True,user_id='ddd305a2da2a4bf0a965b7080b07399a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:42 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-6312db7d-4c4e-44e6-bc47-fa9b9d66b1f2 tempest-CreateVolumesFromImageTest-1947233898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8323d1a7-06c8-401b-9009-5a03c826a81d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:42 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-6312db7d-4c4e-44e6-bc47-fa9b9d66b1f2 tempest-CreateVolumesFromImageTest-1947233898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8323d1a7-06c8-401b-9009-5a03c826a81d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:43 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-6312db7d-4c4e-44e6-bc47-fa9b9d66b1f2 tempest-CreateVolumesFromImageTest-1947233898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e462a5e-2631-4035-93fc-db5f7f423375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:43 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-6312db7d-4c4e-44e6-bc47-fa9b9d66b1f2 tempest-CreateVolumesFromImageTest-1947233898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e462a5e-2631-4035-93fc-db5f7f423375) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2394b175-5c05-4ad0-ae50-fb4e0e1bd05a', 'volume_name': 'volume-2394b175-5c05-4ad0-ae50-fb4e0e1bd05a', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:43 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-6312db7d-4c4e-44e6-bc47-fa9b9d66b1f2 tempest-CreateVolumesFromImageTest-1947233898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2aa8843-e541-4a80-b384-89ce6512287e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:43 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-6312db7d-4c4e-44e6-bc47-fa9b9d66b1f2 tempest-CreateVolumesFromImageTest-1947233898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2aa8843-e541-4a80-b384-89ce6512287e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:43 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-6312db7d-4c4e-44e6-bc47-fa9b9d66b1f2 tempest-CreateVolumesFromImageTest-1947233898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e457b40-192f-4bf1-8ad5-86ba81c9dfcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:43 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-6312db7d-4c4e-44e6-bc47-fa9b9d66b1f2 tempest-CreateVolumesFromImageTest-1947233898 None] Volume 2394b175-5c05-4ad0-ae50-fb4e0e1bd05a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2394b175-5c05-4ad0-ae50-fb4e0e1bd05a', 'volume_size': 1}
Apr 28 22:07:43 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-6312db7d-4c4e-44e6-bc47-fa9b9d66b1f2 tempest-CreateVolumesFromImageTest-1947233898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:07:43 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-34aecd01-39f8-4d63-964e-f00a0d28a4a1 tempest-CreateVolumesFromImageTest-1947233898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6abd9c05-af76-4a9d-972b-75990911039b {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:43 devstack sudo[88183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6abd9c05-af76-4a9d-972b-75990911039b
Apr 28 22:07:43 devstack sudo[88183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:43 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bad6538-20d6-43d7-af6e-321d8adc90cd tempest-CreateVolumesFromImageTest-1947233898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:07:43 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5bad6538-20d6-43d7-af6e-321d8adc90cd tempest-CreateVolumesFromImageTest-1947233898 None] Flow 'volume_create_manager' (73b46194-1714-4bdf-9f16-135c7354ccb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:07:43 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5bad6538-20d6-43d7-af6e-321d8adc90cd tempest-CreateVolumesFromImageTest-1947233898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7671b385-93e7-4af4-b531-789f20467ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:43 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5bad6538-20d6-43d7-af6e-321d8adc90cd tempest-CreateVolumesFromImageTest-1947233898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7671b385-93e7-4af4-b531-789f20467ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:07:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-440826361',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=394ff1f0-692a-4b07-8aee-a783fe077f58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f5e84999d8545819116c06fc7b36b0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:07:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:07:43Z,use_quota=True,user_id='ddd305a2da2a4bf0a965b7080b07399a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:43 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5bad6538-20d6-43d7-af6e-321d8adc90cd tempest-CreateVolumesFromImageTest-1947233898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (165a4a6c-a54e-4048-8401-a114f793f37b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:43 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5bad6538-20d6-43d7-af6e-321d8adc90cd tempest-CreateVolumesFromImageTest-1947233898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (165a4a6c-a54e-4048-8401-a114f793f37b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:43 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5bad6538-20d6-43d7-af6e-321d8adc90cd tempest-CreateVolumesFromImageTest-1947233898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3239e10a-4b20-4709-816b-82c2ff6510a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:43 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5bad6538-20d6-43d7-af6e-321d8adc90cd tempest-CreateVolumesFromImageTest-1947233898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3239e10a-4b20-4709-816b-82c2ff6510a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '394ff1f0-692a-4b07-8aee-a783fe077f58', 'volume_name': 'volume-394ff1f0-692a-4b07-8aee-a783fe077f58', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:43 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5bad6538-20d6-43d7-af6e-321d8adc90cd tempest-CreateVolumesFromImageTest-1947233898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c85433d1-af8c-4921-8060-4a0a8ca9720b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:43 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5bad6538-20d6-43d7-af6e-321d8adc90cd tempest-CreateVolumesFromImageTest-1947233898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c85433d1-af8c-4921-8060-4a0a8ca9720b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:43 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5bad6538-20d6-43d7-af6e-321d8adc90cd tempest-CreateVolumesFromImageTest-1947233898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a15f7ae6-67e5-4f6f-b1b7-52b983c0705b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:43 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-5bad6538-20d6-43d7-af6e-321d8adc90cd tempest-CreateVolumesFromImageTest-1947233898 None] Volume 394ff1f0-692a-4b07-8aee-a783fe077f58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-394ff1f0-692a-4b07-8aee-a783fe077f58', 'volume_size': 1}
Apr 28 22:07:43 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-5bad6538-20d6-43d7-af6e-321d8adc90cd tempest-CreateVolumesFromImageTest-1947233898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:07:43 devstack sudo[88183]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:43 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-34aecd01-39f8-4d63-964e-f00a0d28a4a1 tempest-CreateVolumesFromImageTest-1947233898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6abd9c05-af76-4a9d-972b-75990911039b" returned: 0 in 0.637s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:43 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-34aecd01-39f8-4d63-964e-f00a0d28a4a1 tempest-CreateVolumesFromImageTest-1947233898 None] <== create_volume: return (2098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:07:43 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-34aecd01-39f8-4d63-964e-f00a0d28a4a1 tempest-CreateVolumesFromImageTest-1947233898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.102s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:07:43 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-eca7b459-d8e5-4bca-8ec4-3a797cf01c66 tempest-VolumesTransfersV357Test-514240020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.918s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:07:43 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-eca7b459-d8e5-4bca-8ec4-3a797cf01c66 tempest-VolumesTransfersV357Test-514240020 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:07:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1133096972',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7930941d-0d30-40b5-bfe2-e09d150a9ef8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='221dbd889a8040b2962ed37916037164',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:07:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:07:41Z,use_quota=True,user_id='a58760f43e4b494e94a3be850786a77a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:07:43 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-eca7b459-d8e5-4bca-8ec4-3a797cf01c66 tempest-VolumesTransfersV357Test-514240020 None] Creating volume 7930941d-0d30-40b5-bfe2-e09d150a9ef8 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:07:43 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-eca7b459-d8e5-4bca-8ec4-3a797cf01c66 tempest-VolumesTransfersV357Test-514240020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:07:43 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-eca7b459-d8e5-4bca-8ec4-3a797cf01c66 tempest-VolumesTransfersV357Test-514240020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:07:43 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-eca7b459-d8e5-4bca-8ec4-3a797cf01c66 tempest-VolumesTransfersV357Test-514240020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:07:43 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-eca7b459-d8e5-4bca-8ec4-3a797cf01c66 tempest-VolumesTransfersV357Test-514240020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:07:43 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-eca7b459-d8e5-4bca-8ec4-3a797cf01c66 tempest-VolumesTransfersV357Test-514240020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:07:43 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-eca7b459-d8e5-4bca-8ec4-3a797cf01c66 tempest-VolumesTransfersV357Test-514240020 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:07:43 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-eca7b459-d8e5-4bca-8ec4-3a797cf01c66 tempest-VolumesTransfersV357Test-514240020 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:07:43 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-eca7b459-d8e5-4bca-8ec4-3a797cf01c66 tempest-VolumesTransfersV357Test-514240020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7930941d-0d30-40b5-bfe2-e09d150a9ef8 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:43 devstack sudo[88186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7930941d-0d30-40b5-bfe2-e09d150a9ef8 1073741824
Apr 28 22:07:43 devstack sudo[88186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:43 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-34aecd01-39f8-4d63-964e-f00a0d28a4a1 tempest-CreateVolumesFromImageTest-1947233898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b0b33e7-a531-4567-943a-0c837792232c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6abd9c05-af76-4a9d-972b-75990911039b', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:43 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-34aecd01-39f8-4d63-964e-f00a0d28a4a1 tempest-CreateVolumesFromImageTest-1947233898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f87f369c-7676-4c36-a7eb-080eb07377b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:43 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-34aecd01-39f8-4d63-964e-f00a0d28a4a1 tempest-CreateVolumesFromImageTest-1947233898 None] Volume volume-6abd9c05-af76-4a9d-972b-75990911039b (6abd9c05-af76-4a9d-972b-75990911039b): created successfully
Apr 28 22:07:43 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-34aecd01-39f8-4d63-964e-f00a0d28a4a1 tempest-CreateVolumesFromImageTest-1947233898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f87f369c-7676-4c36-a7eb-080eb07377b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:43 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-34aecd01-39f8-4d63-964e-f00a0d28a4a1 tempest-CreateVolumesFromImageTest-1947233898 None] Flow 'volume_create_manager' (5403fb40-d4d4-4b17-89fc-f06fd31ed741) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:07:43 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-34aecd01-39f8-4d63-964e-f00a0d28a4a1 tempest-CreateVolumesFromImageTest-1947233898 None] Created volume successfully.
Apr 28 22:07:44 devstack sudo[88186]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:44 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-eca7b459-d8e5-4bca-8ec4-3a797cf01c66 tempest-VolumesTransfersV357Test-514240020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7930941d-0d30-40b5-bfe2-e09d150a9ef8 1073741824" returned: 0 in 0.891s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:44 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-eca7b459-d8e5-4bca-8ec4-3a797cf01c66 tempest-VolumesTransfersV357Test-514240020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7930941d-0d30-40b5-bfe2-e09d150a9ef8 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:44 devstack sudo[88192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7930941d-0d30-40b5-bfe2-e09d150a9ef8
Apr 28 22:07:44 devstack sudo[88192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:45 devstack sudo[88192]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:45 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-eca7b459-d8e5-4bca-8ec4-3a797cf01c66 tempest-VolumesTransfersV357Test-514240020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7930941d-0d30-40b5-bfe2-e09d150a9ef8" returned: 0 in 0.621s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:45 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-eca7b459-d8e5-4bca-8ec4-3a797cf01c66 tempest-VolumesTransfersV357Test-514240020 None] <== create_volume: return (1556ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:07:45 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-eca7b459-d8e5-4bca-8ec4-3a797cf01c66 tempest-VolumesTransfersV357Test-514240020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.558s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:07:45 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-8513e24f-b205-4a7e-810c-1d92a3ab1f5c tempest-CreateVolumesFromImageTest-1947233898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.248s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:07:45 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-8513e24f-b205-4a7e-810c-1d92a3ab1f5c tempest-CreateVolumesFromImageTest-1947233898 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:07:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1654393130',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c776d5fb-dc0e-4bfb-beaa-1c87e8604d0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f5e84999d8545819116c06fc7b36b0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:07:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:07:42Z,use_quota=True,user_id='ddd305a2da2a4bf0a965b7080b07399a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:07:45 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-8513e24f-b205-4a7e-810c-1d92a3ab1f5c tempest-CreateVolumesFromImageTest-1947233898 None] Creating volume c776d5fb-dc0e-4bfb-beaa-1c87e8604d0c {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:07:45 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-8513e24f-b205-4a7e-810c-1d92a3ab1f5c tempest-CreateVolumesFromImageTest-1947233898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:07:45 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-8513e24f-b205-4a7e-810c-1d92a3ab1f5c tempest-CreateVolumesFromImageTest-1947233898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:07:45 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-8513e24f-b205-4a7e-810c-1d92a3ab1f5c tempest-CreateVolumesFromImageTest-1947233898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:07:45 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-8513e24f-b205-4a7e-810c-1d92a3ab1f5c tempest-CreateVolumesFromImageTest-1947233898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:07:45 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-8513e24f-b205-4a7e-810c-1d92a3ab1f5c tempest-CreateVolumesFromImageTest-1947233898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:07:45 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-8513e24f-b205-4a7e-810c-1d92a3ab1f5c tempest-CreateVolumesFromImageTest-1947233898 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:07:45 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-8513e24f-b205-4a7e-810c-1d92a3ab1f5c tempest-CreateVolumesFromImageTest-1947233898 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:07:45 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-8513e24f-b205-4a7e-810c-1d92a3ab1f5c tempest-CreateVolumesFromImageTest-1947233898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-c776d5fb-dc0e-4bfb-beaa-1c87e8604d0c 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:45 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-eca7b459-d8e5-4bca-8ec4-3a797cf01c66 tempest-VolumesTransfersV357Test-514240020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b764479-5080-4573-9467-93273b50f7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7930941d-0d30-40b5-bfe2-e09d150a9ef8', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:45 devstack sudo[88195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-c776d5fb-dc0e-4bfb-beaa-1c87e8604d0c 1073741824
Apr 28 22:07:45 devstack sudo[88195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:45 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-eca7b459-d8e5-4bca-8ec4-3a797cf01c66 tempest-VolumesTransfersV357Test-514240020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63ab9a0a-20c7-4e25-8fc2-fb3b2d58f85e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:45 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-eca7b459-d8e5-4bca-8ec4-3a797cf01c66 tempest-VolumesTransfersV357Test-514240020 None] Volume volume-7930941d-0d30-40b5-bfe2-e09d150a9ef8 (7930941d-0d30-40b5-bfe2-e09d150a9ef8): created successfully
Apr 28 22:07:45 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-eca7b459-d8e5-4bca-8ec4-3a797cf01c66 tempest-VolumesTransfersV357Test-514240020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63ab9a0a-20c7-4e25-8fc2-fb3b2d58f85e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:45 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-eca7b459-d8e5-4bca-8ec4-3a797cf01c66 tempest-VolumesTransfersV357Test-514240020 None] Flow 'volume_create_manager' (d04b8765-961f-4fcf-9e6c-3ed387fb1c0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:07:45 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-eca7b459-d8e5-4bca-8ec4-3a797cf01c66 tempest-VolumesTransfersV357Test-514240020 None] Created volume successfully.
Apr 28 22:07:46 devstack sudo[88195]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-8513e24f-b205-4a7e-810c-1d92a3ab1f5c tempest-CreateVolumesFromImageTest-1947233898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-c776d5fb-dc0e-4bfb-beaa-1c87e8604d0c 1073741824" returned: 0 in 0.800s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-8513e24f-b205-4a7e-810c-1d92a3ab1f5c tempest-CreateVolumesFromImageTest-1947233898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-c776d5fb-dc0e-4bfb-beaa-1c87e8604d0c {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:46 devstack sudo[88202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-c776d5fb-dc0e-4bfb-beaa-1c87e8604d0c
Apr 28 22:07:46 devstack sudo[88202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:46 devstack sudo[88202]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-8513e24f-b205-4a7e-810c-1d92a3ab1f5c tempest-CreateVolumesFromImageTest-1947233898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-c776d5fb-dc0e-4bfb-beaa-1c87e8604d0c" returned: 0 in 0.730s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:46 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-8513e24f-b205-4a7e-810c-1d92a3ab1f5c tempest-CreateVolumesFromImageTest-1947233898 None] <== create_volume: return (1579ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:07:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-8513e24f-b205-4a7e-810c-1d92a3ab1f5c tempest-CreateVolumesFromImageTest-1947233898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.582s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:07:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-c55d1407-e1e7-4344-ba70-bbc62bf28364 tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.412s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:07:46 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-d76259e3-b314-4fd0-880c-5627f76bf722 tempest-VolumesTransfersV357Test-1403065569 None] Transfer volume completed successfully.
Apr 28 22:07:46 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-8513e24f-b205-4a7e-810c-1d92a3ab1f5c tempest-CreateVolumesFromImageTest-1947233898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4cc5288-faf0-43f3-9b57-2a4893688584) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c776d5fb-dc0e-4bfb-beaa-1c87e8604d0c', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:46 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-8513e24f-b205-4a7e-810c-1d92a3ab1f5c tempest-CreateVolumesFromImageTest-1947233898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0d15d05-4c16-44d3-a18d-d8ad1e786b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:46 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-8513e24f-b205-4a7e-810c-1d92a3ab1f5c tempest-CreateVolumesFromImageTest-1947233898 None] Volume volume-c776d5fb-dc0e-4bfb-beaa-1c87e8604d0c (c776d5fb-dc0e-4bfb-beaa-1c87e8604d0c): created successfully
Apr 28 22:07:46 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-8513e24f-b205-4a7e-810c-1d92a3ab1f5c tempest-CreateVolumesFromImageTest-1947233898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0d15d05-4c16-44d3-a18d-d8ad1e786b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:46 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-8513e24f-b205-4a7e-810c-1d92a3ab1f5c tempest-CreateVolumesFromImageTest-1947233898 None] Flow 'volume_create_manager' (f845cdf7-5782-4ffe-8ff3-86481780cf25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:07:46 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ac6907-9ea1-49ec-b548-52474d40a069]: (4, 'raw') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:07:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-c55d1407-e1e7-4344-ba70-bbc62bf28364 tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3ec3f721-0545-4552-add7-a099f022ffe2 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:46 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-8513e24f-b205-4a7e-810c-1d92a3ab1f5c tempest-CreateVolumesFromImageTest-1947233898 None] Created volume successfully.
Apr 28 22:07:47 devstack sudo[88205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3ec3f721-0545-4552-add7-a099f022ffe2
Apr 28 22:07:47 devstack sudo[88205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:47 devstack sudo[88205]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:47 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-c55d1407-e1e7-4344-ba70-bbc62bf28364 tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3ec3f721-0545-4552-add7-a099f022ffe2" returned: 0 in 0.792s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:47 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-c55d1407-e1e7-4344-ba70-bbc62bf28364 tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3ec3f721-0545-4552-add7-a099f022ffe2 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:47 devstack sudo[88209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3ec3f721-0545-4552-add7-a099f022ffe2
Apr 28 22:07:47 devstack sudo[88209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:47 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-66559b9c-7ab3-4b72-9722-8239cbde2adb tempest-VolumesTransfersV357Test-1352248279 None] Acquiring lock "cinder-7930941d-0d30-40b5-bfe2-e09d150a9ef8-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:07:47 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-66559b9c-7ab3-4b72-9722-8239cbde2adb tempest-VolumesTransfersV357Test-1352248279 None] Lock "cinder-7930941d-0d30-40b5-bfe2-e09d150a9ef8-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:07:48 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-66559b9c-7ab3-4b72-9722-8239cbde2adb tempest-VolumesTransfersV357Test-1352248279 None] Acquiring lock "cinder-quobyte-7930941d-0d30-40b5-bfe2-e09d150a9ef8" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:07:48 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-66559b9c-7ab3-4b72-9722-8239cbde2adb tempest-VolumesTransfersV357Test-1352248279 None] Lock "cinder-quobyte-7930941d-0d30-40b5-bfe2-e09d150a9ef8" acquired by "delete_volume" :: waited 0.019s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:07:48 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf592c7-68e5-4eb1-8448-233639920fe3]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:07:48 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-66559b9c-7ab3-4b72-9722-8239cbde2adb tempest-VolumesTransfersV357Test-1352248279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7930941d-0d30-40b5-bfe2-e09d150a9ef8 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:48 devstack sudo[88211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7930941d-0d30-40b5-bfe2-e09d150a9ef8
Apr 28 22:07:48 devstack sudo[88211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:48 devstack sudo[88209]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:48 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-c55d1407-e1e7-4344-ba70-bbc62bf28364 tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3ec3f721-0545-4552-add7-a099f022ffe2" returned: 1 in 0.889s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:48 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-c55d1407-e1e7-4344-ba70-bbc62bf28364 tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3ec3f721-0545-4552-add7-a099f022ffe2' failed. Not Retrying. {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 28 22:07:48 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-c55d1407-e1e7-4344-ba70-bbc62bf28364 tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.753s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:07:48 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-20658d09-7f82-44d1-b157-5f93c6cd2aec tempest-CreateVolumesFromImageTest-1947233898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.096s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:07:48 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-20658d09-7f82-44d1-b157-5f93c6cd2aec tempest-CreateVolumesFromImageTest-1947233898 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:07:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1237303790',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fe9777d-385d-40d8-bb05-b312df91a923,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f5e84999d8545819116c06fc7b36b0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:07:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:07:42Z,use_quota=True,user_id='ddd305a2da2a4bf0a965b7080b07399a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:07:48 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-20658d09-7f82-44d1-b157-5f93c6cd2aec tempest-CreateVolumesFromImageTest-1947233898 None] Creating volume 0fe9777d-385d-40d8-bb05-b312df91a923 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:07:48 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-20658d09-7f82-44d1-b157-5f93c6cd2aec tempest-CreateVolumesFromImageTest-1947233898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:07:48 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-20658d09-7f82-44d1-b157-5f93c6cd2aec tempest-CreateVolumesFromImageTest-1947233898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:07:48 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-20658d09-7f82-44d1-b157-5f93c6cd2aec tempest-CreateVolumesFromImageTest-1947233898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:07:48 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-20658d09-7f82-44d1-b157-5f93c6cd2aec tempest-CreateVolumesFromImageTest-1947233898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:07:48 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-20658d09-7f82-44d1-b157-5f93c6cd2aec tempest-CreateVolumesFromImageTest-1947233898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:07:48 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-20658d09-7f82-44d1-b157-5f93c6cd2aec tempest-CreateVolumesFromImageTest-1947233898 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:07:48 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-20658d09-7f82-44d1-b157-5f93c6cd2aec tempest-CreateVolumesFromImageTest-1947233898 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:07:48 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-20658d09-7f82-44d1-b157-5f93c6cd2aec tempest-CreateVolumesFromImageTest-1947233898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-0fe9777d-385d-40d8-bb05-b312df91a923 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:48 devstack sudo[88217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-0fe9777d-385d-40d8-bb05-b312df91a923 1073741824
Apr 28 22:07:48 devstack sudo[88217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:48 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-c55d1407-e1e7-4344-ba70-bbc62bf28364 tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2', 'name': 'volume-3ec3f721-0545-4552-add7-a099f022ffe2', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '57921aad-fe00-4cd3-84e0-a8d57d483ddf', 'enforce_multipath': True} {{(pid=83924) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 28 22:07:48 devstack cinder-volume[83924]: INFO cinder.volume.manager [req-b2d73751-b95a-45fd-9d4f-d64fa77c93c4 req-c55d1407-e1e7-4344-ba70-bbc62bf28364 tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] attachment_update completed successfully.
Apr 28 22:07:48 devstack sudo[88211]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:48 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-66559b9c-7ab3-4b72-9722-8239cbde2adb tempest-VolumesTransfersV357Test-1352248279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7930941d-0d30-40b5-bfe2-e09d150a9ef8" returned: 0 in 0.909s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:48 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-66559b9c-7ab3-4b72-9722-8239cbde2adb tempest-VolumesTransfersV357Test-1352248279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7930941d-0d30-40b5-bfe2-e09d150a9ef8 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:48 devstack sudo[88222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7930941d-0d30-40b5-bfe2-e09d150a9ef8
Apr 28 22:07:49 devstack sudo[88222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:49 devstack sudo[88222]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:49 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-66559b9c-7ab3-4b72-9722-8239cbde2adb tempest-VolumesTransfersV357Test-1352248279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7930941d-0d30-40b5-bfe2-e09d150a9ef8" returned: 0 in 0.763s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:49 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-66559b9c-7ab3-4b72-9722-8239cbde2adb tempest-VolumesTransfersV357Test-1352248279 None] Lock "cinder-quobyte-7930941d-0d30-40b5-bfe2-e09d150a9ef8" released by "delete_volume" :: held 1.734s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:07:49 devstack sudo[88217]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:49 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-20658d09-7f82-44d1-b157-5f93c6cd2aec tempest-CreateVolumesFromImageTest-1947233898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-0fe9777d-385d-40d8-bb05-b312df91a923 1073741824" returned: 0 in 1.155s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:49 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-20658d09-7f82-44d1-b157-5f93c6cd2aec tempest-CreateVolumesFromImageTest-1947233898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-0fe9777d-385d-40d8-bb05-b312df91a923 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:49 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-66559b9c-7ab3-4b72-9722-8239cbde2adb tempest-VolumesTransfersV357Test-1352248279 None] Created reservations ['81f5dbc2-a96c-45c2-95cb-7ed80a542d16', '9ad14e26-386d-4455-8fac-40e68b1c4afd', '87d02812-7458-42d8-aea7-c6d1667f00ae', '6e157024-97ba-4188-932d-cf719f51542f'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:07:49 devstack sudo[88228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-0fe9777d-385d-40d8-bb05-b312df91a923
Apr 28 22:07:49 devstack sudo[88228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:49 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-66559b9c-7ab3-4b72-9722-8239cbde2adb tempest-VolumesTransfersV357Test-1352248279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:07:49 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-66559b9c-7ab3-4b72-9722-8239cbde2adb tempest-VolumesTransfersV357Test-1352248279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:07:49 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-66559b9c-7ab3-4b72-9722-8239cbde2adb tempest-VolumesTransfersV357Test-1352248279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:07:49 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-66559b9c-7ab3-4b72-9722-8239cbde2adb tempest-VolumesTransfersV357Test-1352248279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:07:49 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-66559b9c-7ab3-4b72-9722-8239cbde2adb tempest-VolumesTransfersV357Test-1352248279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:07:49 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-66559b9c-7ab3-4b72-9722-8239cbde2adb tempest-VolumesTransfersV357Test-1352248279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:49 devstack sudo[88230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:07:49 devstack sudo[88230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:50 devstack sudo[88228]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:50 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-20658d09-7f82-44d1-b157-5f93c6cd2aec tempest-CreateVolumesFromImageTest-1947233898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-0fe9777d-385d-40d8-bb05-b312df91a923" returned: 0 in 0.839s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:50 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-20658d09-7f82-44d1-b157-5f93c6cd2aec tempest-CreateVolumesFromImageTest-1947233898 None] <== create_volume: return (2068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:07:50 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-20658d09-7f82-44d1-b157-5f93c6cd2aec tempest-CreateVolumesFromImageTest-1947233898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.073s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:07:50 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-6312db7d-4c4e-44e6-bc47-fa9b9d66b1f2 tempest-CreateVolumesFromImageTest-1947233898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.649s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:07:50 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-6312db7d-4c4e-44e6-bc47-fa9b9d66b1f2 tempest-CreateVolumesFromImageTest-1947233898 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:07:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1802572336',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2394b175-5c05-4ad0-ae50-fb4e0e1bd05a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f5e84999d8545819116c06fc7b36b0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:07:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:07:43Z,use_quota=True,user_id='ddd305a2da2a4bf0a965b7080b07399a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:07:50 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-6312db7d-4c4e-44e6-bc47-fa9b9d66b1f2 tempest-CreateVolumesFromImageTest-1947233898 None] Creating volume 2394b175-5c05-4ad0-ae50-fb4e0e1bd05a {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:07:50 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-6312db7d-4c4e-44e6-bc47-fa9b9d66b1f2 tempest-CreateVolumesFromImageTest-1947233898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:07:50 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-6312db7d-4c4e-44e6-bc47-fa9b9d66b1f2 tempest-CreateVolumesFromImageTest-1947233898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:07:50 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-6312db7d-4c4e-44e6-bc47-fa9b9d66b1f2 tempest-CreateVolumesFromImageTest-1947233898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:07:50 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-6312db7d-4c4e-44e6-bc47-fa9b9d66b1f2 tempest-CreateVolumesFromImageTest-1947233898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:07:50 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-6312db7d-4c4e-44e6-bc47-fa9b9d66b1f2 tempest-CreateVolumesFromImageTest-1947233898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:07:50 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-6312db7d-4c4e-44e6-bc47-fa9b9d66b1f2 tempest-CreateVolumesFromImageTest-1947233898 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:07:50 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-6312db7d-4c4e-44e6-bc47-fa9b9d66b1f2 tempest-CreateVolumesFromImageTest-1947233898 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:07:50 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-6312db7d-4c4e-44e6-bc47-fa9b9d66b1f2 tempest-CreateVolumesFromImageTest-1947233898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2394b175-5c05-4ad0-ae50-fb4e0e1bd05a 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:50 devstack sudo[88234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2394b175-5c05-4ad0-ae50-fb4e0e1bd05a 1073741824
Apr 28 22:07:50 devstack sudo[88234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:50 devstack sudo[88230]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:50 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-20658d09-7f82-44d1-b157-5f93c6cd2aec tempest-CreateVolumesFromImageTest-1947233898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56509cae-2dbc-4a2f-a74e-95516db024fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fe9777d-385d-40d8-bb05-b312df91a923', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:50 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-20658d09-7f82-44d1-b157-5f93c6cd2aec tempest-CreateVolumesFromImageTest-1947233898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27595b13-d01b-4781-84eb-dd98acd2d525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:50 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b009427-3a29-4e4e-8af1-09ed91466834 tempest-VolumesTransfersV357Test-514240020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:07:50 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-9b009427-3a29-4e4e-8af1-09ed91466834 tempest-VolumesTransfersV357Test-514240020 None] Flow 'volume_create_manager' (5e99fe4e-94f9-487e-9dfe-e5596825b3d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:07:50 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-9b009427-3a29-4e4e-8af1-09ed91466834 tempest-VolumesTransfersV357Test-514240020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cbb87c6-101b-4eb1-8536-cdfe79966416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:50 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-66559b9c-7ab3-4b72-9722-8239cbde2adb tempest-VolumesTransfersV357Test-1352248279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.916s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:50 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-66559b9c-7ab3-4b72-9722-8239cbde2adb tempest-VolumesTransfersV357Test-1352248279 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:07:50 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-9b009427-3a29-4e4e-8af1-09ed91466834 tempest-VolumesTransfersV357Test-514240020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cbb87c6-101b-4eb1-8536-cdfe79966416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-579450131',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=782c4692-b397-4681-88b3-260d630b868d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='221dbd889a8040b2962ed37916037164',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:07:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:07:51Z,use_quota=True,user_id='a58760f43e4b494e94a3be850786a77a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:50 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-9b009427-3a29-4e4e-8af1-09ed91466834 tempest-VolumesTransfersV357Test-514240020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0ef5058-6130-4805-8765-e88d210691b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:50 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-9b009427-3a29-4e4e-8af1-09ed91466834 tempest-VolumesTransfersV357Test-514240020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0ef5058-6130-4805-8765-e88d210691b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:50 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-9b009427-3a29-4e4e-8af1-09ed91466834 tempest-VolumesTransfersV357Test-514240020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0229b77f-0c24-4fb4-ad3a-6891d73c313e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:50 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-9b009427-3a29-4e4e-8af1-09ed91466834 tempest-VolumesTransfersV357Test-514240020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0229b77f-0c24-4fb4-ad3a-6891d73c313e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '782c4692-b397-4681-88b3-260d630b868d', 'volume_name': 'volume-782c4692-b397-4681-88b3-260d630b868d', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:50 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-9b009427-3a29-4e4e-8af1-09ed91466834 tempest-VolumesTransfersV357Test-514240020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9fcfa61-305b-4f3a-942e-51b9dfb0bdcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:50 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-9b009427-3a29-4e4e-8af1-09ed91466834 tempest-VolumesTransfersV357Test-514240020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9fcfa61-305b-4f3a-942e-51b9dfb0bdcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:50 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-9b009427-3a29-4e4e-8af1-09ed91466834 tempest-VolumesTransfersV357Test-514240020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b5a74dd-e4cc-4ea2-84fc-0e5d84db4a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:50 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-9b009427-3a29-4e4e-8af1-09ed91466834 tempest-VolumesTransfersV357Test-514240020 None] Volume 782c4692-b397-4681-88b3-260d630b868d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-782c4692-b397-4681-88b3-260d630b868d', 'volume_size': 1}
Apr 28 22:07:50 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-9b009427-3a29-4e4e-8af1-09ed91466834 tempest-VolumesTransfersV357Test-514240020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:07:50 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-66559b9c-7ab3-4b72-9722-8239cbde2adb tempest-VolumesTransfersV357Test-1352248279 None] Deleted volume successfully.
Apr 28 22:07:50 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-20658d09-7f82-44d1-b157-5f93c6cd2aec tempest-CreateVolumesFromImageTest-1947233898 None] Volume volume-0fe9777d-385d-40d8-bb05-b312df91a923 (0fe9777d-385d-40d8-bb05-b312df91a923): created successfully
Apr 28 22:07:51 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-20658d09-7f82-44d1-b157-5f93c6cd2aec tempest-CreateVolumesFromImageTest-1947233898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27595b13-d01b-4781-84eb-dd98acd2d525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:51 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-20658d09-7f82-44d1-b157-5f93c6cd2aec tempest-CreateVolumesFromImageTest-1947233898 None] Flow 'volume_create_manager' (cacc31af-83bf-414a-8a0e-61b543ba067d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:07:51 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-20658d09-7f82-44d1-b157-5f93c6cd2aec tempest-CreateVolumesFromImageTest-1947233898 None] Created volume successfully.
Apr 28 22:07:51 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-66559b9c-7ab3-4b72-9722-8239cbde2adb tempest-VolumesTransfersV357Test-1352248279 None] Lock "cinder-7930941d-0d30-40b5-bfe2-e09d150a9ef8-delete_volume" released by "delete_volume" :: held 3.109s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:07:51 devstack sudo[88234]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-6312db7d-4c4e-44e6-bc47-fa9b9d66b1f2 tempest-CreateVolumesFromImageTest-1947233898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2394b175-5c05-4ad0-ae50-fb4e0e1bd05a 1073741824" returned: 0 in 1.039s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-6312db7d-4c4e-44e6-bc47-fa9b9d66b1f2 tempest-CreateVolumesFromImageTest-1947233898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2394b175-5c05-4ad0-ae50-fb4e0e1bd05a {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:51 devstack sudo[88244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2394b175-5c05-4ad0-ae50-fb4e0e1bd05a
Apr 28 22:07:51 devstack sudo[88244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:52 devstack sudo[88244]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:52 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-6312db7d-4c4e-44e6-bc47-fa9b9d66b1f2 tempest-CreateVolumesFromImageTest-1947233898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2394b175-5c05-4ad0-ae50-fb4e0e1bd05a" returned: 0 in 0.631s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:52 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-6312db7d-4c4e-44e6-bc47-fa9b9d66b1f2 tempest-CreateVolumesFromImageTest-1947233898 None] <== create_volume: return (1739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:07:52 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-6312db7d-4c4e-44e6-bc47-fa9b9d66b1f2 tempest-CreateVolumesFromImageTest-1947233898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.747s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:07:52 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-5bad6538-20d6-43d7-af6e-321d8adc90cd tempest-CreateVolumesFromImageTest-1947233898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.955s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:07:52 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-5bad6538-20d6-43d7-af6e-321d8adc90cd tempest-CreateVolumesFromImageTest-1947233898 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:07:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-440826361',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=394ff1f0-692a-4b07-8aee-a783fe077f58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f5e84999d8545819116c06fc7b36b0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:07:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:07:43Z,use_quota=True,user_id='ddd305a2da2a4bf0a965b7080b07399a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:07:52 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-5bad6538-20d6-43d7-af6e-321d8adc90cd tempest-CreateVolumesFromImageTest-1947233898 None] Creating volume 394ff1f0-692a-4b07-8aee-a783fe077f58 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:07:52 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-5bad6538-20d6-43d7-af6e-321d8adc90cd tempest-CreateVolumesFromImageTest-1947233898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:07:52 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-5bad6538-20d6-43d7-af6e-321d8adc90cd tempest-CreateVolumesFromImageTest-1947233898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:07:52 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-5bad6538-20d6-43d7-af6e-321d8adc90cd tempest-CreateVolumesFromImageTest-1947233898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:07:52 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-5bad6538-20d6-43d7-af6e-321d8adc90cd tempest-CreateVolumesFromImageTest-1947233898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:07:52 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-5bad6538-20d6-43d7-af6e-321d8adc90cd tempest-CreateVolumesFromImageTest-1947233898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:07:52 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-5bad6538-20d6-43d7-af6e-321d8adc90cd tempest-CreateVolumesFromImageTest-1947233898 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:07:52 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-5bad6538-20d6-43d7-af6e-321d8adc90cd tempest-CreateVolumesFromImageTest-1947233898 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:07:52 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5bad6538-20d6-43d7-af6e-321d8adc90cd tempest-CreateVolumesFromImageTest-1947233898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-394ff1f0-692a-4b07-8aee-a783fe077f58 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:52 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-6312db7d-4c4e-44e6-bc47-fa9b9d66b1f2 tempest-CreateVolumesFromImageTest-1947233898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e457b40-192f-4bf1-8ad5-86ba81c9dfcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2394b175-5c05-4ad0-ae50-fb4e0e1bd05a', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:52 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-6312db7d-4c4e-44e6-bc47-fa9b9d66b1f2 tempest-CreateVolumesFromImageTest-1947233898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0781b31-5ae0-456b-9ffd-c90cf4c17d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:52 devstack sudo[88248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-394ff1f0-692a-4b07-8aee-a783fe077f58 1073741824
Apr 28 22:07:52 devstack sudo[88248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:52 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-6312db7d-4c4e-44e6-bc47-fa9b9d66b1f2 tempest-CreateVolumesFromImageTest-1947233898 None] Volume volume-2394b175-5c05-4ad0-ae50-fb4e0e1bd05a (2394b175-5c05-4ad0-ae50-fb4e0e1bd05a): created successfully
Apr 28 22:07:52 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-6312db7d-4c4e-44e6-bc47-fa9b9d66b1f2 tempest-CreateVolumesFromImageTest-1947233898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0781b31-5ae0-456b-9ffd-c90cf4c17d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:52 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-6312db7d-4c4e-44e6-bc47-fa9b9d66b1f2 tempest-CreateVolumesFromImageTest-1947233898 None] Flow 'volume_create_manager' (4d97d252-6301-4513-a0fd-d68901619d56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:07:52 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-6312db7d-4c4e-44e6-bc47-fa9b9d66b1f2 tempest-CreateVolumesFromImageTest-1947233898 None] Created volume successfully.
Apr 28 22:07:53 devstack sudo[88248]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:53 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5bad6538-20d6-43d7-af6e-321d8adc90cd tempest-CreateVolumesFromImageTest-1947233898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-394ff1f0-692a-4b07-8aee-a783fe077f58 1073741824" returned: 0 in 0.943s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:53 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5bad6538-20d6-43d7-af6e-321d8adc90cd tempest-CreateVolumesFromImageTest-1947233898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-394ff1f0-692a-4b07-8aee-a783fe077f58 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:53 devstack sudo[88271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-394ff1f0-692a-4b07-8aee-a783fe077f58
Apr 28 22:07:53 devstack sudo[88271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:54 devstack sudo[88271]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:54 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5bad6538-20d6-43d7-af6e-321d8adc90cd tempest-CreateVolumesFromImageTest-1947233898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-394ff1f0-692a-4b07-8aee-a783fe077f58" returned: 0 in 0.871s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:54 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-5bad6538-20d6-43d7-af6e-321d8adc90cd tempest-CreateVolumesFromImageTest-1947233898 None] <== create_volume: return (1956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:07:54 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-5bad6538-20d6-43d7-af6e-321d8adc90cd tempest-CreateVolumesFromImageTest-1947233898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.962s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:07:54 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-9b009427-3a29-4e4e-8af1-09ed91466834 tempest-VolumesTransfersV357Test-514240020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.427s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:07:54 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-9b009427-3a29-4e4e-8af1-09ed91466834 tempest-VolumesTransfersV357Test-514240020 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-579450131',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=782c4692-b397-4681-88b3-260d630b868d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='221dbd889a8040b2962ed37916037164',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:07:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:07:51Z,use_quota=True,user_id='a58760f43e4b494e94a3be850786a77a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:07:54 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-9b009427-3a29-4e4e-8af1-09ed91466834 tempest-VolumesTransfersV357Test-514240020 None] Creating volume 782c4692-b397-4681-88b3-260d630b868d {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:07:54 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-9b009427-3a29-4e4e-8af1-09ed91466834 tempest-VolumesTransfersV357Test-514240020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:07:54 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-9b009427-3a29-4e4e-8af1-09ed91466834 tempest-VolumesTransfersV357Test-514240020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:07:54 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-9b009427-3a29-4e4e-8af1-09ed91466834 tempest-VolumesTransfersV357Test-514240020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:07:54 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-9b009427-3a29-4e4e-8af1-09ed91466834 tempest-VolumesTransfersV357Test-514240020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:07:54 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-9b009427-3a29-4e4e-8af1-09ed91466834 tempest-VolumesTransfersV357Test-514240020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:07:54 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-9b009427-3a29-4e4e-8af1-09ed91466834 tempest-VolumesTransfersV357Test-514240020 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:07:54 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-9b009427-3a29-4e4e-8af1-09ed91466834 tempest-VolumesTransfersV357Test-514240020 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:07:54 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-9b009427-3a29-4e4e-8af1-09ed91466834 tempest-VolumesTransfersV357Test-514240020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-782c4692-b397-4681-88b3-260d630b868d 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:54 devstack sudo[88294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-782c4692-b397-4681-88b3-260d630b868d 1073741824
Apr 28 22:07:54 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5bad6538-20d6-43d7-af6e-321d8adc90cd tempest-CreateVolumesFromImageTest-1947233898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a15f7ae6-67e5-4f6f-b1b7-52b983c0705b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-394ff1f0-692a-4b07-8aee-a783fe077f58', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:54 devstack sudo[88294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:54 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5bad6538-20d6-43d7-af6e-321d8adc90cd tempest-CreateVolumesFromImageTest-1947233898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8b5c073-4c5b-49b5-b62d-4d9273a6f12d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:54 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-5bad6538-20d6-43d7-af6e-321d8adc90cd tempest-CreateVolumesFromImageTest-1947233898 None] Volume volume-394ff1f0-692a-4b07-8aee-a783fe077f58 (394ff1f0-692a-4b07-8aee-a783fe077f58): created successfully
Apr 28 22:07:54 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5bad6538-20d6-43d7-af6e-321d8adc90cd tempest-CreateVolumesFromImageTest-1947233898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8b5c073-4c5b-49b5-b62d-4d9273a6f12d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:54 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5bad6538-20d6-43d7-af6e-321d8adc90cd tempest-CreateVolumesFromImageTest-1947233898 None] Flow 'volume_create_manager' (73b46194-1714-4bdf-9f16-135c7354ccb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:07:54 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-5bad6538-20d6-43d7-af6e-321d8adc90cd tempest-CreateVolumesFromImageTest-1947233898 None] Created volume successfully.
Apr 28 22:07:55 devstack sudo[88294]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:55 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-9b009427-3a29-4e4e-8af1-09ed91466834 tempest-VolumesTransfersV357Test-514240020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-782c4692-b397-4681-88b3-260d630b868d 1073741824" returned: 0 in 0.891s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:55 devstack cinder-volume[83924]: DEBUG dbcounter [-] [83924] Writing DB stats cinder:SELECT=101,cinder:INSERT=28,cinder:UPDATE=117,cinder:DELETE=7 {{(pid=83924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 28 22:07:55 devstack cinder-volume[83924]: DEBUG dbcounter [-] [83924] Writing DB stats cinder:INSERT=37,cinder:UPDATE=107,cinder:SELECT=84,cinder:DELETE=14 {{(pid=83924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 28 22:07:55 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-9b009427-3a29-4e4e-8af1-09ed91466834 tempest-VolumesTransfersV357Test-514240020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-782c4692-b397-4681-88b3-260d630b868d {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:55 devstack sudo[88301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-782c4692-b397-4681-88b3-260d630b868d
Apr 28 22:07:55 devstack sudo[88301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:55 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-b025151a-6ecf-4c21-a9bb-02e061094d2e tempest-GroupSnapshotsTest-1124623539 None] Group tempest-GroupSnapshotsTest-Group-1515105086: creating
Apr 28 22:07:55 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-b025151a-6ecf-4c21-a9bb-02e061094d2e tempest-GroupSnapshotsTest-1124623539 None] Group tempest-GroupSnapshotsTest-Group-1515105086: created successfully
Apr 28 22:07:55 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-b025151a-6ecf-4c21-a9bb-02e061094d2e tempest-GroupSnapshotsTest-1124623539 None] Create group completed successfully.
Apr 28 22:07:55 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-6cba4329-a420-482d-be0f-5ce06366a2c3 tempest-CreateVolumesFromImageTest-1947233898 None] Acquiring lock "cinder-394ff1f0-692a-4b07-8aee-a783fe077f58-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:07:55 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-6cba4329-a420-482d-be0f-5ce06366a2c3 tempest-CreateVolumesFromImageTest-1947233898 None] Lock "cinder-394ff1f0-692a-4b07-8aee-a783fe077f58-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:07:55 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-6cba4329-a420-482d-be0f-5ce06366a2c3 tempest-CreateVolumesFromImageTest-1947233898 None] Acquiring lock "cinder-quobyte-394ff1f0-692a-4b07-8aee-a783fe077f58" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:07:55 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-6cba4329-a420-482d-be0f-5ce06366a2c3 tempest-CreateVolumesFromImageTest-1947233898 None] Lock "cinder-quobyte-394ff1f0-692a-4b07-8aee-a783fe077f58" acquired by "delete_volume" :: waited 0.029s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:07:55 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b728c8eb-c37e-4586-8e42-87336b7a8a85]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:07:55 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-6cba4329-a420-482d-be0f-5ce06366a2c3 tempest-CreateVolumesFromImageTest-1947233898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-394ff1f0-692a-4b07-8aee-a783fe077f58 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:55 devstack sudo[88303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-394ff1f0-692a-4b07-8aee-a783fe077f58
Apr 28 22:07:55 devstack sudo[88303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:56 devstack sudo[88301]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:56 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-9b009427-3a29-4e4e-8af1-09ed91466834 tempest-VolumesTransfersV357Test-514240020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-782c4692-b397-4681-88b3-260d630b868d" returned: 0 in 0.876s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:56 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-9b009427-3a29-4e4e-8af1-09ed91466834 tempest-VolumesTransfersV357Test-514240020 None] <== create_volume: return (1834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:07:56 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-9b009427-3a29-4e4e-8af1-09ed91466834 tempest-VolumesTransfersV357Test-514240020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.843s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:07:56 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-9b009427-3a29-4e4e-8af1-09ed91466834 tempest-VolumesTransfersV357Test-514240020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b5a74dd-e4cc-4ea2-84fc-0e5d84db4a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-782c4692-b397-4681-88b3-260d630b868d', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:56 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-9b009427-3a29-4e4e-8af1-09ed91466834 tempest-VolumesTransfersV357Test-514240020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eca6a9e-1cc3-4451-a9f7-7d99fd76e222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:56 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-9b009427-3a29-4e4e-8af1-09ed91466834 tempest-VolumesTransfersV357Test-514240020 None] Volume volume-782c4692-b397-4681-88b3-260d630b868d (782c4692-b397-4681-88b3-260d630b868d): created successfully
Apr 28 22:07:56 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-9b009427-3a29-4e4e-8af1-09ed91466834 tempest-VolumesTransfersV357Test-514240020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eca6a9e-1cc3-4451-a9f7-7d99fd76e222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:56 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-9b009427-3a29-4e4e-8af1-09ed91466834 tempest-VolumesTransfersV357Test-514240020 None] Flow 'volume_create_manager' (5e99fe4e-94f9-487e-9dfe-e5596825b3d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:07:56 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-9b009427-3a29-4e4e-8af1-09ed91466834 tempest-VolumesTransfersV357Test-514240020 None] Created volume successfully.
Apr 28 22:07:56 devstack sudo[88303]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:56 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-6cba4329-a420-482d-be0f-5ce06366a2c3 tempest-CreateVolumesFromImageTest-1947233898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-394ff1f0-692a-4b07-8aee-a783fe077f58" returned: 0 in 0.970s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:56 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-6cba4329-a420-482d-be0f-5ce06366a2c3 tempest-CreateVolumesFromImageTest-1947233898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-394ff1f0-692a-4b07-8aee-a783fe077f58 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:56 devstack sudo[88309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-394ff1f0-692a-4b07-8aee-a783fe077f58
Apr 28 22:07:56 devstack sudo[88309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:57 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd9971a7-aa78-4741-b57e-76df94d43cda tempest-GroupSnapshotsTest-1124623539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:07:57 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-cd9971a7-aa78-4741-b57e-76df94d43cda tempest-GroupSnapshotsTest-1124623539 None] Flow 'volume_create_manager' (e572c5d1-f61a-44ed-a0df-7a6fc9ae17d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:07:57 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-cd9971a7-aa78-4741-b57e-76df94d43cda tempest-GroupSnapshotsTest-1124623539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6e9bed3-86fd-4921-b75d-02f70d904ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:57 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-cd9971a7-aa78-4741-b57e-76df94d43cda tempest-GroupSnapshotsTest-1124623539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6e9bed3-86fd-4921-b75d-02f70d904ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:07:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-473655961',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9bdbb838-b652-4966-9c4b-f254026f5330,host='devstack@QuobyteHD#QuobyteHD',id=9ecc363c-d1c7-4c96-9459-b6296668afda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29d2f5d38aff44ebb5481ff2a7413f6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:07:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:07:57Z,use_quota=True,user_id='6cc1cf2f2521481c81eae86959034746',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2cd47580-38d6-40db-9deb-e1b6454d88ab),volume_type_id=2cd47580-38d6-40db-9deb-e1b6454d88ab)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:57 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-cd9971a7-aa78-4741-b57e-76df94d43cda tempest-GroupSnapshotsTest-1124623539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73e0f42e-1a15-4351-be61-a8eb7308277b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:57 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-cd9971a7-aa78-4741-b57e-76df94d43cda tempest-GroupSnapshotsTest-1124623539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73e0f42e-1a15-4351-be61-a8eb7308277b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:57 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-cd9971a7-aa78-4741-b57e-76df94d43cda tempest-GroupSnapshotsTest-1124623539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eb089eb-2a76-4a01-95f9-c15f12e5ace1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:57 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-cd9971a7-aa78-4741-b57e-76df94d43cda tempest-GroupSnapshotsTest-1124623539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eb089eb-2a76-4a01-95f9-c15f12e5ace1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ecc363c-d1c7-4c96-9459-b6296668afda', 'volume_name': 'volume-9ecc363c-d1c7-4c96-9459-b6296668afda', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:57 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-cd9971a7-aa78-4741-b57e-76df94d43cda tempest-GroupSnapshotsTest-1124623539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (777f455e-2058-454e-a266-d8b9629180fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:57 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-cd9971a7-aa78-4741-b57e-76df94d43cda tempest-GroupSnapshotsTest-1124623539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (777f455e-2058-454e-a266-d8b9629180fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:07:57 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-cd9971a7-aa78-4741-b57e-76df94d43cda tempest-GroupSnapshotsTest-1124623539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d7c020a-628b-45df-a547-8826839e433a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:07:57 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-cd9971a7-aa78-4741-b57e-76df94d43cda tempest-GroupSnapshotsTest-1124623539 None] Volume 9ecc363c-d1c7-4c96-9459-b6296668afda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ecc363c-d1c7-4c96-9459-b6296668afda', 'volume_size': 1}
Apr 28 22:07:57 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-cd9971a7-aa78-4741-b57e-76df94d43cda tempest-GroupSnapshotsTest-1124623539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:07:57 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-cd9971a7-aa78-4741-b57e-76df94d43cda tempest-GroupSnapshotsTest-1124623539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:07:57 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-cd9971a7-aa78-4741-b57e-76df94d43cda tempest-GroupSnapshotsTest-1124623539 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=9bdbb838-b652-4966-9c4b-f254026f5330,created_at=2026-04-28T20:07:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-473655961',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9bdbb838-b652-4966-9c4b-f254026f5330,host='devstack@QuobyteHD#QuobyteHD',id=9ecc363c-d1c7-4c96-9459-b6296668afda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29d2f5d38aff44ebb5481ff2a7413f6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:07:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:07:57Z,use_quota=True,user_id='6cc1cf2f2521481c81eae86959034746',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2cd47580-38d6-40db-9deb-e1b6454d88ab),volume_type_id=2cd47580-38d6-40db-9deb-e1b6454d88ab)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:07:57 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-cd9971a7-aa78-4741-b57e-76df94d43cda tempest-GroupSnapshotsTest-1124623539 None] Creating volume 9ecc363c-d1c7-4c96-9459-b6296668afda {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:07:57 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-cd9971a7-aa78-4741-b57e-76df94d43cda tempest-GroupSnapshotsTest-1124623539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:07:57 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-cd9971a7-aa78-4741-b57e-76df94d43cda tempest-GroupSnapshotsTest-1124623539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:07:57 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-cd9971a7-aa78-4741-b57e-76df94d43cda tempest-GroupSnapshotsTest-1124623539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:07:57 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-cd9971a7-aa78-4741-b57e-76df94d43cda tempest-GroupSnapshotsTest-1124623539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:07:57 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-cd9971a7-aa78-4741-b57e-76df94d43cda tempest-GroupSnapshotsTest-1124623539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:07:57 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-cd9971a7-aa78-4741-b57e-76df94d43cda tempest-GroupSnapshotsTest-1124623539 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:07:57 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-cd9971a7-aa78-4741-b57e-76df94d43cda tempest-GroupSnapshotsTest-1124623539 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:07:57 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-cd9971a7-aa78-4741-b57e-76df94d43cda tempest-GroupSnapshotsTest-1124623539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9ecc363c-d1c7-4c96-9459-b6296668afda 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:57 devstack sudo[88312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9ecc363c-d1c7-4c96-9459-b6296668afda 1073741824
Apr 28 22:07:57 devstack sudo[88312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:57 devstack sudo[88309]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:57 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-6cba4329-a420-482d-be0f-5ce06366a2c3 tempest-CreateVolumesFromImageTest-1947233898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-394ff1f0-692a-4b07-8aee-a783fe077f58" returned: 0 in 1.026s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:57 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-6cba4329-a420-482d-be0f-5ce06366a2c3 tempest-CreateVolumesFromImageTest-1947233898 None] Lock "cinder-quobyte-394ff1f0-692a-4b07-8aee-a783fe077f58" released by "delete_volume" :: held 2.061s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:07:57 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-6cba4329-a420-482d-be0f-5ce06366a2c3 tempest-CreateVolumesFromImageTest-1947233898 None] Created reservations ['0d9ff7ed-b466-47b0-aad6-adc0361bb80f', '3929353e-ad6a-4c54-b3dd-566110b9b029', '7a713091-8e26-4df7-a9ea-c2acf15a71e5', '4cab72f3-181a-482f-9d89-a08b9f3cf423'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:07:58 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-6cba4329-a420-482d-be0f-5ce06366a2c3 tempest-CreateVolumesFromImageTest-1947233898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:07:58 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-6cba4329-a420-482d-be0f-5ce06366a2c3 tempest-CreateVolumesFromImageTest-1947233898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:07:58 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-6cba4329-a420-482d-be0f-5ce06366a2c3 tempest-CreateVolumesFromImageTest-1947233898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:07:58 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-6cba4329-a420-482d-be0f-5ce06366a2c3 tempest-CreateVolumesFromImageTest-1947233898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:07:58 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-6cba4329-a420-482d-be0f-5ce06366a2c3 tempest-CreateVolumesFromImageTest-1947233898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:07:58 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-6cba4329-a420-482d-be0f-5ce06366a2c3 tempest-CreateVolumesFromImageTest-1947233898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:58 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-c4ca3982-8994-4252-8bdd-606f378b155e tempest-VolumesTransfersV357Test-1352248279 None] Acquiring lock "cinder-782c4692-b397-4681-88b3-260d630b868d-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:07:58 devstack sudo[88314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:07:58 devstack sudo[88314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:58 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-c4ca3982-8994-4252-8bdd-606f378b155e tempest-VolumesTransfersV357Test-1352248279 None] Lock "cinder-782c4692-b397-4681-88b3-260d630b868d-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:07:58 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-c4ca3982-8994-4252-8bdd-606f378b155e tempest-VolumesTransfersV357Test-1352248279 None] Acquiring lock "cinder-quobyte-782c4692-b397-4681-88b3-260d630b868d" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:07:58 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-c4ca3982-8994-4252-8bdd-606f378b155e tempest-VolumesTransfersV357Test-1352248279 None] Lock "cinder-quobyte-782c4692-b397-4681-88b3-260d630b868d" acquired by "delete_volume" :: waited 0.029s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:07:58 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3a3d48-84b5-419e-8550-4a413ab4e542]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:07:58 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c4ca3982-8994-4252-8bdd-606f378b155e tempest-VolumesTransfersV357Test-1352248279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-782c4692-b397-4681-88b3-260d630b868d {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:58 devstack sudo[88316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-782c4692-b397-4681-88b3-260d630b868d
Apr 28 22:07:58 devstack sudo[88316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:59 devstack sudo[88312]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:59 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-cd9971a7-aa78-4741-b57e-76df94d43cda tempest-GroupSnapshotsTest-1124623539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9ecc363c-d1c7-4c96-9459-b6296668afda 1073741824" returned: 0 in 1.443s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:59 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-cd9971a7-aa78-4741-b57e-76df94d43cda tempest-GroupSnapshotsTest-1124623539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9ecc363c-d1c7-4c96-9459-b6296668afda {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:59 devstack sudo[88324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9ecc363c-d1c7-4c96-9459-b6296668afda
Apr 28 22:07:59 devstack sudo[88324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:59 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-54f0c5b7-3c4f-40b3-b8f1-108685f2af37 tempest-CreateVolumesFromImageTest-1947233898 None] Acquiring lock "cinder-2394b175-5c05-4ad0-ae50-fb4e0e1bd05a-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:07:59 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-54f0c5b7-3c4f-40b3-b8f1-108685f2af37 tempest-CreateVolumesFromImageTest-1947233898 None] Lock "cinder-2394b175-5c05-4ad0-ae50-fb4e0e1bd05a-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:07:59 devstack sudo[88314]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:59 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-6cba4329-a420-482d-be0f-5ce06366a2c3 tempest-CreateVolumesFromImageTest-1947233898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 1.261s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:59 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-6cba4329-a420-482d-be0f-5ce06366a2c3 tempest-CreateVolumesFromImageTest-1947233898 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:07:59 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-6cba4329-a420-482d-be0f-5ce06366a2c3 tempest-CreateVolumesFromImageTest-1947233898 None] Deleted volume successfully.
Apr 28 22:07:59 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-54f0c5b7-3c4f-40b3-b8f1-108685f2af37 tempest-CreateVolumesFromImageTest-1947233898 None] Acquiring lock "cinder-quobyte-2394b175-5c05-4ad0-ae50-fb4e0e1bd05a" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:07:59 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-6cba4329-a420-482d-be0f-5ce06366a2c3 tempest-CreateVolumesFromImageTest-1947233898 None] Lock "cinder-394ff1f0-692a-4b07-8aee-a783fe077f58-delete_volume" released by "delete_volume" :: held 3.731s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:07:59 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-54f0c5b7-3c4f-40b3-b8f1-108685f2af37 tempest-CreateVolumesFromImageTest-1947233898 None] Lock "cinder-quobyte-2394b175-5c05-4ad0-ae50-fb4e0e1bd05a" acquired by "delete_volume" :: waited 0.040s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:07:59 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ae68cc-6d33-4dd1-b9f4-dc6c49ea608d]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:07:59 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-54f0c5b7-3c4f-40b3-b8f1-108685f2af37 tempest-CreateVolumesFromImageTest-1947233898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2394b175-5c05-4ad0-ae50-fb4e0e1bd05a {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:59 devstack sudo[88316]: pam_unix(sudo:session): session closed for user root
Apr 28 22:07:59 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c4ca3982-8994-4252-8bdd-606f378b155e tempest-VolumesTransfersV357Test-1352248279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-782c4692-b397-4681-88b3-260d630b868d" returned: 0 in 1.365s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:07:59 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c4ca3982-8994-4252-8bdd-606f378b155e tempest-VolumesTransfersV357Test-1352248279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-782c4692-b397-4681-88b3-260d630b868d {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:07:59 devstack sudo[88330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-782c4692-b397-4681-88b3-260d630b868d
Apr 28 22:07:59 devstack sudo[88330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:07:59 devstack sudo[88329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2394b175-5c05-4ad0-ae50-fb4e0e1bd05a
Apr 28 22:07:59 devstack sudo[88329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:00 devstack sudo[88324]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:00 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-cd9971a7-aa78-4741-b57e-76df94d43cda tempest-GroupSnapshotsTest-1124623539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9ecc363c-d1c7-4c96-9459-b6296668afda" returned: 0 in 1.065s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:00 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-cd9971a7-aa78-4741-b57e-76df94d43cda tempest-GroupSnapshotsTest-1124623539 None] <== create_volume: return (2595ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:08:00 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-cd9971a7-aa78-4741-b57e-76df94d43cda tempest-GroupSnapshotsTest-1124623539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.601s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:08:00 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-cd9971a7-aa78-4741-b57e-76df94d43cda tempest-GroupSnapshotsTest-1124623539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d7c020a-628b-45df-a547-8826839e433a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ecc363c-d1c7-4c96-9459-b6296668afda', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:08:00 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-cd9971a7-aa78-4741-b57e-76df94d43cda tempest-GroupSnapshotsTest-1124623539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9616249c-def1-40fb-825b-bbe1bff401aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:08:00 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-cd9971a7-aa78-4741-b57e-76df94d43cda tempest-GroupSnapshotsTest-1124623539 None] Volume volume-9ecc363c-d1c7-4c96-9459-b6296668afda (9ecc363c-d1c7-4c96-9459-b6296668afda): created successfully
Apr 28 22:08:00 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-cd9971a7-aa78-4741-b57e-76df94d43cda tempest-GroupSnapshotsTest-1124623539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9616249c-def1-40fb-825b-bbe1bff401aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:08:00 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-cd9971a7-aa78-4741-b57e-76df94d43cda tempest-GroupSnapshotsTest-1124623539 None] Flow 'volume_create_manager' (e572c5d1-f61a-44ed-a0df-7a6fc9ae17d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:08:00 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-cd9971a7-aa78-4741-b57e-76df94d43cda tempest-GroupSnapshotsTest-1124623539 None] Created volume successfully.
Apr 28 22:08:00 devstack sudo[88329]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:00 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-54f0c5b7-3c4f-40b3-b8f1-108685f2af37 tempest-CreateVolumesFromImageTest-1947233898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2394b175-5c05-4ad0-ae50-fb4e0e1bd05a" returned: 0 in 1.200s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:00 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-54f0c5b7-3c4f-40b3-b8f1-108685f2af37 tempest-CreateVolumesFromImageTest-1947233898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2394b175-5c05-4ad0-ae50-fb4e0e1bd05a {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:00 devstack sudo[88338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2394b175-5c05-4ad0-ae50-fb4e0e1bd05a
Apr 28 22:08:00 devstack sudo[88338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:00 devstack sudo[88330]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:00 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c4ca3982-8994-4252-8bdd-606f378b155e tempest-VolumesTransfersV357Test-1352248279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-782c4692-b397-4681-88b3-260d630b868d" returned: 0 in 1.108s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:00 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-c4ca3982-8994-4252-8bdd-606f378b155e tempest-VolumesTransfersV357Test-1352248279 None] Lock "cinder-quobyte-782c4692-b397-4681-88b3-260d630b868d" released by "delete_volume" :: held 2.552s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:08:00 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-c4ca3982-8994-4252-8bdd-606f378b155e tempest-VolumesTransfersV357Test-1352248279 None] Created reservations ['02f1ebc3-4f89-4050-a23a-936ff479806a', '7adf15ad-d943-4eac-be1c-cf2759587974', '14fad04a-dbe0-4f0b-b2f7-085aea155745', '3aa60200-8376-4fa7-89e9-152b398e6eda'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:08:01 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-c4ca3982-8994-4252-8bdd-606f378b155e tempest-VolumesTransfersV357Test-1352248279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:08:01 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-c4ca3982-8994-4252-8bdd-606f378b155e tempest-VolumesTransfersV357Test-1352248279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:08:01 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-c4ca3982-8994-4252-8bdd-606f378b155e tempest-VolumesTransfersV357Test-1352248279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:08:01 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-c4ca3982-8994-4252-8bdd-606f378b155e tempest-VolumesTransfersV357Test-1352248279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:08:01 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-c4ca3982-8994-4252-8bdd-606f378b155e tempest-VolumesTransfersV357Test-1352248279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:08:01 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c4ca3982-8994-4252-8bdd-606f378b155e tempest-VolumesTransfersV357Test-1352248279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:01 devstack sudo[88340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:08:01 devstack sudo[88340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:01 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-f6fed529-6b66-4c53-87d0-148fc2880bf2 tempest-GroupSnapshotsTest-1124623539 None] GroupSnapshot b6c481c7-ec2e-4a80-bd94-fcd041c067a0: creating.
Apr 28 22:08:01 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f6fed529-6b66-4c53-87d0-148fc2880bf2 tempest-GroupSnapshotsTest-1124623539 None] Group snapshot b6c481c7-ec2e-4a80-bd94-fcd041c067a0: creating. {{(pid=83924) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 28 22:08:01 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f6fed529-6b66-4c53-87d0-148fc2880bf2 tempest-GroupSnapshotsTest-1124623539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:08:01 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f6fed529-6b66-4c53-87d0-148fc2880bf2 tempest-GroupSnapshotsTest-1124623539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:08:01 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-f6fed529-6b66-4c53-87d0-148fc2880bf2 tempest-GroupSnapshotsTest-1124623539 None] Creating offline snapshot 8400c8fd-2845-4708-aa62-70a1a5108be7 of volume 9ecc363c-d1c7-4c96-9459-b6296668afda {{(pid=83924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 22:08:01 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[793bcb5c-1100-4ebe-97cf-4440af8c29eb]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:08:01 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f6fed529-6b66-4c53-87d0-148fc2880bf2 tempest-GroupSnapshotsTest-1124623539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9ecc363c-d1c7-4c96-9459-b6296668afda {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:01 devstack sudo[88342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9ecc363c-d1c7-4c96-9459-b6296668afda
Apr 28 22:08:01 devstack sudo[88342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:01 devstack sudo[88338]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:01 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-54f0c5b7-3c4f-40b3-b8f1-108685f2af37 tempest-CreateVolumesFromImageTest-1947233898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2394b175-5c05-4ad0-ae50-fb4e0e1bd05a" returned: 0 in 1.016s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:01 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-54f0c5b7-3c4f-40b3-b8f1-108685f2af37 tempest-CreateVolumesFromImageTest-1947233898 None] Lock "cinder-quobyte-2394b175-5c05-4ad0-ae50-fb4e0e1bd05a" released by "delete_volume" :: held 2.304s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:08:01 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-54f0c5b7-3c4f-40b3-b8f1-108685f2af37 tempest-CreateVolumesFromImageTest-1947233898 None] Created reservations ['86088ac7-beac-4697-99b6-137123970a51', '06a6d120-b9cf-4b20-806d-b99dcc697125', '4f5b65f2-9e44-4ad0-9c80-b4503ebd6138', 'e4452aae-036d-4069-8f82-c3fad6395072'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:08:01 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-54f0c5b7-3c4f-40b3-b8f1-108685f2af37 tempest-CreateVolumesFromImageTest-1947233898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:08:01 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-54f0c5b7-3c4f-40b3-b8f1-108685f2af37 tempest-CreateVolumesFromImageTest-1947233898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:08:01 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-54f0c5b7-3c4f-40b3-b8f1-108685f2af37 tempest-CreateVolumesFromImageTest-1947233898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:08:01 devstack sudo[88340]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:01 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-54f0c5b7-3c4f-40b3-b8f1-108685f2af37 tempest-CreateVolumesFromImageTest-1947233898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:08:01 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-54f0c5b7-3c4f-40b3-b8f1-108685f2af37 tempest-CreateVolumesFromImageTest-1947233898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:08:01 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-54f0c5b7-3c4f-40b3-b8f1-108685f2af37 tempest-CreateVolumesFromImageTest-1947233898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:02 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c4ca3982-8994-4252-8bdd-606f378b155e tempest-VolumesTransfersV357Test-1352248279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.960s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:02 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-c4ca3982-8994-4252-8bdd-606f378b155e tempest-VolumesTransfersV357Test-1352248279 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:08:02 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-c4ca3982-8994-4252-8bdd-606f378b155e tempest-VolumesTransfersV357Test-1352248279 None] Deleted volume successfully.
Apr 28 22:08:02 devstack sudo[88346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:08:02 devstack sudo[88346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:02 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-c4ca3982-8994-4252-8bdd-606f378b155e tempest-VolumesTransfersV357Test-1352248279 None] Lock "cinder-782c4692-b397-4681-88b3-260d630b868d-delete_volume" released by "delete_volume" :: held 3.885s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:08:02 devstack sudo[88342]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:02 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f6fed529-6b66-4c53-87d0-148fc2880bf2 tempest-GroupSnapshotsTest-1124623539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9ecc363c-d1c7-4c96-9459-b6296668afda" returned: 0 in 1.011s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:02 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f6fed529-6b66-4c53-87d0-148fc2880bf2 tempest-GroupSnapshotsTest-1124623539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9ecc363c-d1c7-4c96-9459-b6296668afda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9ecc363c-d1c7-4c96-9459-b6296668afda.8400c8fd-2845-4708-aa62-70a1a5108be7 1G {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:02 devstack sudo[88352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9ecc363c-d1c7-4c96-9459-b6296668afda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9ecc363c-d1c7-4c96-9459-b6296668afda.8400c8fd-2845-4708-aa62-70a1a5108be7 1G
Apr 28 22:08:02 devstack sudo[88352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:02 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-923b59c5-02a6-42d0-8c16-b73096e69485 tempest-CreateVolumesFromImageTest-1947233898 None] Acquiring lock "cinder-0fe9777d-385d-40d8-bb05-b312df91a923-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:08:02 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-923b59c5-02a6-42d0-8c16-b73096e69485 tempest-CreateVolumesFromImageTest-1947233898 None] Lock "cinder-0fe9777d-385d-40d8-bb05-b312df91a923-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:08:02 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-923b59c5-02a6-42d0-8c16-b73096e69485 tempest-CreateVolumesFromImageTest-1947233898 None] Acquiring lock "cinder-quobyte-0fe9777d-385d-40d8-bb05-b312df91a923" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:08:03 devstack sudo[88346]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:03 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-54f0c5b7-3c4f-40b3-b8f1-108685f2af37 tempest-CreateVolumesFromImageTest-1947233898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 1.023s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:03 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-54f0c5b7-3c4f-40b3-b8f1-108685f2af37 tempest-CreateVolumesFromImageTest-1947233898 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:08:03 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-923b59c5-02a6-42d0-8c16-b73096e69485 tempest-CreateVolumesFromImageTest-1947233898 None] Lock "cinder-quobyte-0fe9777d-385d-40d8-bb05-b312df91a923" acquired by "delete_volume" :: waited 0.044s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:08:03 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-54f0c5b7-3c4f-40b3-b8f1-108685f2af37 tempest-CreateVolumesFromImageTest-1947233898 None] Deleted volume successfully.
Apr 28 22:08:03 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3cc163a-d232-48ff-a36e-98753f5653a1]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:08:03 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-923b59c5-02a6-42d0-8c16-b73096e69485 tempest-CreateVolumesFromImageTest-1947233898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-0fe9777d-385d-40d8-bb05-b312df91a923 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:03 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-54f0c5b7-3c4f-40b3-b8f1-108685f2af37 tempest-CreateVolumesFromImageTest-1947233898 None] Lock "cinder-2394b175-5c05-4ad0-ae50-fb4e0e1bd05a-delete_volume" released by "delete_volume" :: held 3.848s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:08:03 devstack sudo[88369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-0fe9777d-385d-40d8-bb05-b312df91a923
Apr 28 22:08:03 devstack sudo[88369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:03 devstack sudo[88352]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:03 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f6fed529-6b66-4c53-87d0-148fc2880bf2 tempest-GroupSnapshotsTest-1124623539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9ecc363c-d1c7-4c96-9459-b6296668afda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9ecc363c-d1c7-4c96-9459-b6296668afda.8400c8fd-2845-4708-aa62-70a1a5108be7 1G" returned: 0 in 1.333s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:03 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f6fed529-6b66-4c53-87d0-148fc2880bf2 tempest-GroupSnapshotsTest-1124623539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ecc363c-d1c7-4c96-9459-b6296668afda -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9ecc363c-d1c7-4c96-9459-b6296668afda.8400c8fd-2845-4708-aa62-70a1a5108be7 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:03 devstack sudo[88395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ecc363c-d1c7-4c96-9459-b6296668afda -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9ecc363c-d1c7-4c96-9459-b6296668afda.8400c8fd-2845-4708-aa62-70a1a5108be7
Apr 28 22:08:03 devstack sudo[88395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:04 devstack sudo[88369]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:04 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-923b59c5-02a6-42d0-8c16-b73096e69485 tempest-CreateVolumesFromImageTest-1947233898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-0fe9777d-385d-40d8-bb05-b312df91a923" returned: 0 in 0.998s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:04 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-923b59c5-02a6-42d0-8c16-b73096e69485 tempest-CreateVolumesFromImageTest-1947233898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-0fe9777d-385d-40d8-bb05-b312df91a923 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:04 devstack sudo[88400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-0fe9777d-385d-40d8-bb05-b312df91a923
Apr 28 22:08:04 devstack sudo[88400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:04 devstack sudo[88395]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:04 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f6fed529-6b66-4c53-87d0-148fc2880bf2 tempest-GroupSnapshotsTest-1124623539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ecc363c-d1c7-4c96-9459-b6296668afda -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9ecc363c-d1c7-4c96-9459-b6296668afda.8400c8fd-2845-4708-aa62-70a1a5108be7" returned: 0 in 0.912s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:04 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-f6fed529-6b66-4c53-87d0-148fc2880bf2 tempest-GroupSnapshotsTest-1124623539 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9ecc363c-d1c7-4c96-9459-b6296668afda.8400c8fd-2845-4708-aa62-70a1a5108be7 is being set with open permissions: ugo+rw: NotImplementedError
Apr 28 22:08:04 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f6fed529-6b66-4c53-87d0-148fc2880bf2 tempest-GroupSnapshotsTest-1124623539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9ecc363c-d1c7-4c96-9459-b6296668afda.8400c8fd-2845-4708-aa62-70a1a5108be7 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:04 devstack sudo[88406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9ecc363c-d1c7-4c96-9459-b6296668afda.8400c8fd-2845-4708-aa62-70a1a5108be7
Apr 28 22:08:04 devstack sudo[88406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:04 devstack sudo[88400]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:04 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-923b59c5-02a6-42d0-8c16-b73096e69485 tempest-CreateVolumesFromImageTest-1947233898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-0fe9777d-385d-40d8-bb05-b312df91a923" returned: 0 in 0.811s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:04 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-923b59c5-02a6-42d0-8c16-b73096e69485 tempest-CreateVolumesFromImageTest-1947233898 None] Lock "cinder-quobyte-0fe9777d-385d-40d8-bb05-b312df91a923" released by "delete_volume" :: held 1.892s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:08:05 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-923b59c5-02a6-42d0-8c16-b73096e69485 tempest-CreateVolumesFromImageTest-1947233898 None] Created reservations ['ee75f333-4a3e-4145-80d1-16bdbcced5cd', '16c743b0-f7b0-4089-b596-9d10204aeaa9', '52c39e5b-c3df-402c-8b45-b1f709663f74', 'a545ea06-7b71-4906-8c5b-addd5d186bb9'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:08:05 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-923b59c5-02a6-42d0-8c16-b73096e69485 tempest-CreateVolumesFromImageTest-1947233898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:08:05 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-923b59c5-02a6-42d0-8c16-b73096e69485 tempest-CreateVolumesFromImageTest-1947233898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:08:05 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-923b59c5-02a6-42d0-8c16-b73096e69485 tempest-CreateVolumesFromImageTest-1947233898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:08:05 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-923b59c5-02a6-42d0-8c16-b73096e69485 tempest-CreateVolumesFromImageTest-1947233898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:08:05 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-923b59c5-02a6-42d0-8c16-b73096e69485 tempest-CreateVolumesFromImageTest-1947233898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:08:05 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-923b59c5-02a6-42d0-8c16-b73096e69485 tempest-CreateVolumesFromImageTest-1947233898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:05 devstack sudo[88408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:08:05 devstack sudo[88408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:05 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-19b343bc-b724-4c5d-a7fb-f2dccc600301 tempest-CreateVolumesFromImageTest-1947233898 None] Acquiring lock "cinder-c776d5fb-dc0e-4bfb-beaa-1c87e8604d0c-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:08:05 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-19b343bc-b724-4c5d-a7fb-f2dccc600301 tempest-CreateVolumesFromImageTest-1947233898 None] Lock "cinder-c776d5fb-dc0e-4bfb-beaa-1c87e8604d0c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:08:05 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-19b343bc-b724-4c5d-a7fb-f2dccc600301 tempest-CreateVolumesFromImageTest-1947233898 None] Acquiring lock "cinder-quobyte-c776d5fb-dc0e-4bfb-beaa-1c87e8604d0c" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:08:05 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-19b343bc-b724-4c5d-a7fb-f2dccc600301 tempest-CreateVolumesFromImageTest-1947233898 None] Lock "cinder-quobyte-c776d5fb-dc0e-4bfb-beaa-1c87e8604d0c" acquired by "delete_volume" :: waited 0.026s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:08:05 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84eebb3-867d-42da-9fdf-d9ae0ef7206d]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:08:05 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-19b343bc-b724-4c5d-a7fb-f2dccc600301 tempest-CreateVolumesFromImageTest-1947233898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-c776d5fb-dc0e-4bfb-beaa-1c87e8604d0c {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:05 devstack sudo[88411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-c776d5fb-dc0e-4bfb-beaa-1c87e8604d0c
Apr 28 22:08:05 devstack sudo[88411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:05 devstack sudo[88406]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:05 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f6fed529-6b66-4c53-87d0-148fc2880bf2 tempest-GroupSnapshotsTest-1124623539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9ecc363c-d1c7-4c96-9459-b6296668afda.8400c8fd-2845-4708-aa62-70a1a5108be7" returned: 0 in 1.077s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:05 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f6fed529-6b66-4c53-87d0-148fc2880bf2 tempest-GroupSnapshotsTest-1124623539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9ecc363c-d1c7-4c96-9459-b6296668afda.info {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:05 devstack sudo[88425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9ecc363c-d1c7-4c96-9459-b6296668afda.info
Apr 28 22:08:05 devstack sudo[88425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:06 devstack sudo[88408]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:06 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-923b59c5-02a6-42d0-8c16-b73096e69485 tempest-CreateVolumesFromImageTest-1947233898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 1.075s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:06 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-923b59c5-02a6-42d0-8c16-b73096e69485 tempest-CreateVolumesFromImageTest-1947233898 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:08:06 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-923b59c5-02a6-42d0-8c16-b73096e69485 tempest-CreateVolumesFromImageTest-1947233898 None] Deleted volume successfully.
Apr 28 22:08:06 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-923b59c5-02a6-42d0-8c16-b73096e69485 tempest-CreateVolumesFromImageTest-1947233898 None] Lock "cinder-0fe9777d-385d-40d8-bb05-b312df91a923-delete_volume" released by "delete_volume" :: held 3.371s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:08:06 devstack sudo[88411]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:06 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-19b343bc-b724-4c5d-a7fb-f2dccc600301 tempest-CreateVolumesFromImageTest-1947233898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-c776d5fb-dc0e-4bfb-beaa-1c87e8604d0c" returned: 0 in 1.134s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:06 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-19b343bc-b724-4c5d-a7fb-f2dccc600301 tempest-CreateVolumesFromImageTest-1947233898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-c776d5fb-dc0e-4bfb-beaa-1c87e8604d0c {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:06 devstack sudo[88442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-c776d5fb-dc0e-4bfb-beaa-1c87e8604d0c
Apr 28 22:08:06 devstack sudo[88442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:06 devstack sudo[88425]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:06 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f6fed529-6b66-4c53-87d0-148fc2880bf2 tempest-GroupSnapshotsTest-1124623539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9ecc363c-d1c7-4c96-9459-b6296668afda.info" returned: 0 in 0.784s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:06 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-f6fed529-6b66-4c53-87d0-148fc2880bf2 tempest-GroupSnapshotsTest-1124623539 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9ecc363c-d1c7-4c96-9459-b6296668afda.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 28 22:08:06 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f6fed529-6b66-4c53-87d0-148fc2880bf2 tempest-GroupSnapshotsTest-1124623539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9ecc363c-d1c7-4c96-9459-b6296668afda.info {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:06 devstack sudo[88444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9ecc363c-d1c7-4c96-9459-b6296668afda.info
Apr 28 22:08:06 devstack sudo[88444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:07 devstack sudo[88442]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:07 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-19b343bc-b724-4c5d-a7fb-f2dccc600301 tempest-CreateVolumesFromImageTest-1947233898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-c776d5fb-dc0e-4bfb-beaa-1c87e8604d0c" returned: 0 in 0.780s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:07 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-19b343bc-b724-4c5d-a7fb-f2dccc600301 tempest-CreateVolumesFromImageTest-1947233898 None] Lock "cinder-quobyte-c776d5fb-dc0e-4bfb-beaa-1c87e8604d0c" released by "delete_volume" :: held 1.979s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:08:07 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-19b343bc-b724-4c5d-a7fb-f2dccc600301 tempest-CreateVolumesFromImageTest-1947233898 None] Created reservations ['b8e55f98-3569-46b8-85e0-a62da56efca0', '31471c3d-64a9-485f-8883-e05a791cb3f1', 'b06c8f63-3d79-4337-82c4-898a07bdc887', 'b5ea73dc-e449-4642-ab55-f98f47315d3a'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:08:07 devstack sudo[88444]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:07 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f6fed529-6b66-4c53-87d0-148fc2880bf2 tempest-GroupSnapshotsTest-1124623539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9ecc363c-d1c7-4c96-9459-b6296668afda.info" returned: 0 in 0.793s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:07 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f6fed529-6b66-4c53-87d0-148fc2880bf2 tempest-GroupSnapshotsTest-1124623539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.053s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:08:07 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-19b343bc-b724-4c5d-a7fb-f2dccc600301 tempest-CreateVolumesFromImageTest-1947233898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:08:07 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-19b343bc-b724-4c5d-a7fb-f2dccc600301 tempest-CreateVolumesFromImageTest-1947233898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:08:07 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-19b343bc-b724-4c5d-a7fb-f2dccc600301 tempest-CreateVolumesFromImageTest-1947233898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:08:07 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-19b343bc-b724-4c5d-a7fb-f2dccc600301 tempest-CreateVolumesFromImageTest-1947233898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:08:07 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-19b343bc-b724-4c5d-a7fb-f2dccc600301 tempest-CreateVolumesFromImageTest-1947233898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:08:07 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-19b343bc-b724-4c5d-a7fb-f2dccc600301 tempest-CreateVolumesFromImageTest-1947233898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:07 devstack sudo[88448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:08:07 devstack sudo[88448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:07 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-0667d2b8-3089-42b5-8239-25e74fc50f16 tempest-CreateVolumesFromImageTest-1947233898 None] Acquiring lock "cinder-6abd9c05-af76-4a9d-972b-75990911039b-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:08:07 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-0667d2b8-3089-42b5-8239-25e74fc50f16 tempest-CreateVolumesFromImageTest-1947233898 None] Lock "cinder-6abd9c05-af76-4a9d-972b-75990911039b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:08:07 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-f6fed529-6b66-4c53-87d0-148fc2880bf2 tempest-GroupSnapshotsTest-1124623539 None] group_snapshot b6c481c7-ec2e-4a80-bd94-fcd041c067a0: created successfully
Apr 28 22:08:07 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-0667d2b8-3089-42b5-8239-25e74fc50f16 tempest-CreateVolumesFromImageTest-1947233898 None] Acquiring lock "cinder-quobyte-6abd9c05-af76-4a9d-972b-75990911039b" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:08:07 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-0667d2b8-3089-42b5-8239-25e74fc50f16 tempest-CreateVolumesFromImageTest-1947233898 None] Lock "cinder-quobyte-6abd9c05-af76-4a9d-972b-75990911039b" acquired by "delete_volume" :: waited 0.021s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:08:07 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[db59ffba-0507-4c76-8573-55e652f00327]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:08:07 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-0667d2b8-3089-42b5-8239-25e74fc50f16 tempest-CreateVolumesFromImageTest-1947233898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6abd9c05-af76-4a9d-972b-75990911039b {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:07 devstack sudo[88450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6abd9c05-af76-4a9d-972b-75990911039b
Apr 28 22:08:07 devstack sudo[88450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:08 devstack sudo[88448]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:08 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-19b343bc-b724-4c5d-a7fb-f2dccc600301 tempest-CreateVolumesFromImageTest-1947233898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.721s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:08 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-19b343bc-b724-4c5d-a7fb-f2dccc600301 tempest-CreateVolumesFromImageTest-1947233898 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:08:08 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-19b343bc-b724-4c5d-a7fb-f2dccc600301 tempest-CreateVolumesFromImageTest-1947233898 None] Deleted volume successfully.
Apr 28 22:08:08 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-19b343bc-b724-4c5d-a7fb-f2dccc600301 tempest-CreateVolumesFromImageTest-1947233898 None] Lock "cinder-c776d5fb-dc0e-4bfb-beaa-1c87e8604d0c-delete_volume" released by "delete_volume" :: held 3.005s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:08:08 devstack sudo[88450]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:08 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-0667d2b8-3089-42b5-8239-25e74fc50f16 tempest-CreateVolumesFromImageTest-1947233898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6abd9c05-af76-4a9d-972b-75990911039b" returned: 0 in 0.907s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:08 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-0667d2b8-3089-42b5-8239-25e74fc50f16 tempest-CreateVolumesFromImageTest-1947233898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6abd9c05-af76-4a9d-972b-75990911039b {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:08 devstack sudo[88456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6abd9c05-af76-4a9d-972b-75990911039b
Apr 28 22:08:08 devstack sudo[88456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:09 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-53993c1c-8224-4506-8406-332fc187fc7b tempest-GroupSnapshotsTest-1124623539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:08:09 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-53993c1c-8224-4506-8406-332fc187fc7b tempest-GroupSnapshotsTest-1124623539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.003s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:08:09 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-53993c1c-8224-4506-8406-332fc187fc7b tempest-GroupSnapshotsTest-1124623539 None] Acquiring lock "cinder-quobyte-8400c8fd-2845-4708-aa62-70a1a5108be7-c53e4869-4a89-4379-b0f3-c34ddaebf32c" by "_create_volume_from_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:08:09 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-53993c1c-8224-4506-8406-332fc187fc7b tempest-GroupSnapshotsTest-1124623539 None] Lock "cinder-quobyte-8400c8fd-2845-4708-aa62-70a1a5108be7-c53e4869-4a89-4379-b0f3-c34ddaebf32c" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:08:09 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-53993c1c-8224-4506-8406-332fc187fc7b tempest-GroupSnapshotsTest-1124623539 None] Creating volume c53e4869-4a89-4379-b0f3-c34ddaebf32c from snapshot 8400c8fd-2845-4708-aa62-70a1a5108be7 {{(pid=83924) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 28 22:08:09 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-53993c1c-8224-4506-8406-332fc187fc7b tempest-GroupSnapshotsTest-1124623539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:08:09 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-53993c1c-8224-4506-8406-332fc187fc7b tempest-GroupSnapshotsTest-1124623539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:08:09 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-53993c1c-8224-4506-8406-332fc187fc7b tempest-GroupSnapshotsTest-1124623539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:08:09 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-53993c1c-8224-4506-8406-332fc187fc7b tempest-GroupSnapshotsTest-1124623539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:08:09 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-53993c1c-8224-4506-8406-332fc187fc7b tempest-GroupSnapshotsTest-1124623539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:08:09 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-53993c1c-8224-4506-8406-332fc187fc7b tempest-GroupSnapshotsTest-1124623539 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:08:09 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-53993c1c-8224-4506-8406-332fc187fc7b tempest-GroupSnapshotsTest-1124623539 None] Acquiring lock "cinder-quobyte-c53e4869-4a89-4379-b0f3-c34ddaebf32c" by "_copy_volume_from_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:08:09 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-53993c1c-8224-4506-8406-332fc187fc7b tempest-GroupSnapshotsTest-1124623539 None] Lock "cinder-quobyte-c53e4869-4a89-4379-b0f3-c34ddaebf32c" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:08:09 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-53993c1c-8224-4506-8406-332fc187fc7b tempest-GroupSnapshotsTest-1124623539 None] snapshot: 8400c8fd-2845-4708-aa62-70a1a5108be7, volume: c53e4869-4a89-4379-b0f3-c34ddaebf32c,  {{(pid=83924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 28 22:08:09 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-53993c1c-8224-4506-8406-332fc187fc7b tempest-GroupSnapshotsTest-1124623539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:08:09 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-53993c1c-8224-4506-8406-332fc187fc7b tempest-GroupSnapshotsTest-1124623539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:08:09 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-53993c1c-8224-4506-8406-332fc187fc7b tempest-GroupSnapshotsTest-1124623539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:08:09 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-53993c1c-8224-4506-8406-332fc187fc7b tempest-GroupSnapshotsTest-1124623539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:08:09 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-53993c1c-8224-4506-8406-332fc187fc7b tempest-GroupSnapshotsTest-1124623539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:08:09 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8bc4e51-e0c3-40bc-ac61-f405edcd6b75]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:08:09 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-53993c1c-8224-4506-8406-332fc187fc7b tempest-GroupSnapshotsTest-1124623539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9ecc363c-d1c7-4c96-9459-b6296668afda.8400c8fd-2845-4708-aa62-70a1a5108be7 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:09 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2c3399f-5a61-4ecf-8f37-213c72ec8084 tempest-VolumesCloneTest-1046112886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:08:09 devstack sudo[88456]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:09 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f2c3399f-5a61-4ecf-8f37-213c72ec8084 tempest-VolumesCloneTest-1046112886 None] Flow 'volume_create_manager' (debc7256-e180-4d65-acce-5636ba86f650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:08:09 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f2c3399f-5a61-4ecf-8f37-213c72ec8084 tempest-VolumesCloneTest-1046112886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb3aa483-4526-4a80-837a-848600716160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:08:09 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-0667d2b8-3089-42b5-8239-25e74fc50f16 tempest-CreateVolumesFromImageTest-1947233898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6abd9c05-af76-4a9d-972b-75990911039b" returned: 0 in 0.681s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:09 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f2c3399f-5a61-4ecf-8f37-213c72ec8084 tempest-VolumesCloneTest-1046112886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb3aa483-4526-4a80-837a-848600716160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:08:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-226902935',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dac2b42-bdc2-410d-b581-5868706cbbb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a2840073c5a4b9da3e493d087861658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:08:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:08:09Z,use_quota=True,user_id='7771d5ae4784410d94f397f684a96479',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:08:09 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f2c3399f-5a61-4ecf-8f37-213c72ec8084 tempest-VolumesCloneTest-1046112886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30b393d3-28f3-4ff2-8cd1-05654a99526a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:08:09 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f2c3399f-5a61-4ecf-8f37-213c72ec8084 tempest-VolumesCloneTest-1046112886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30b393d3-28f3-4ff2-8cd1-05654a99526a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:08:09 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f2c3399f-5a61-4ecf-8f37-213c72ec8084 tempest-VolumesCloneTest-1046112886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cec313b6-bedc-4b77-ac38-ccf1a2c17ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:08:09 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f2c3399f-5a61-4ecf-8f37-213c72ec8084 tempest-VolumesCloneTest-1046112886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cec313b6-bedc-4b77-ac38-ccf1a2c17ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dac2b42-bdc2-410d-b581-5868706cbbb5', 'volume_name': 'volume-6dac2b42-bdc2-410d-b581-5868706cbbb5', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:08:09 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f2c3399f-5a61-4ecf-8f37-213c72ec8084 tempest-VolumesCloneTest-1046112886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24b6e7d6-a240-4048-a4a2-ada3d82ea7a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:08:09 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f2c3399f-5a61-4ecf-8f37-213c72ec8084 tempest-VolumesCloneTest-1046112886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24b6e7d6-a240-4048-a4a2-ada3d82ea7a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:08:09 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f2c3399f-5a61-4ecf-8f37-213c72ec8084 tempest-VolumesCloneTest-1046112886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53c03040-f5c7-4cd8-a165-3757181adba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:08:09 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-f2c3399f-5a61-4ecf-8f37-213c72ec8084 tempest-VolumesCloneTest-1046112886 None] Volume 6dac2b42-bdc2-410d-b581-5868706cbbb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dac2b42-bdc2-410d-b581-5868706cbbb5', 'volume_size': 1}
Apr 28 22:08:09 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f2c3399f-5a61-4ecf-8f37-213c72ec8084 tempest-VolumesCloneTest-1046112886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:08:09 devstack sudo[88471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9ecc363c-d1c7-4c96-9459-b6296668afda.8400c8fd-2845-4708-aa62-70a1a5108be7
Apr 28 22:08:09 devstack sudo[88471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:09 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-0667d2b8-3089-42b5-8239-25e74fc50f16 tempest-CreateVolumesFromImageTest-1947233898 None] Lock "cinder-quobyte-6abd9c05-af76-4a9d-972b-75990911039b" released by "delete_volume" :: held 1.670s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:08:09 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-0667d2b8-3089-42b5-8239-25e74fc50f16 tempest-CreateVolumesFromImageTest-1947233898 None] Created reservations ['750f6955-c2d2-4a1f-947f-e87c89c3bf77', 'e98190c2-a047-4e77-acb0-47aab312f93c', '562f329b-9fca-41bf-8c74-b2472f3635f7', 'a50b1f59-f420-4619-84a5-e9a669bb6732'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:08:09 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-0667d2b8-3089-42b5-8239-25e74fc50f16 tempest-CreateVolumesFromImageTest-1947233898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:08:09 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-0667d2b8-3089-42b5-8239-25e74fc50f16 tempest-CreateVolumesFromImageTest-1947233898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:08:09 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-0667d2b8-3089-42b5-8239-25e74fc50f16 tempest-CreateVolumesFromImageTest-1947233898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:08:09 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-0667d2b8-3089-42b5-8239-25e74fc50f16 tempest-CreateVolumesFromImageTest-1947233898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:08:09 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-0667d2b8-3089-42b5-8239-25e74fc50f16 tempest-CreateVolumesFromImageTest-1947233898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:08:09 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-0667d2b8-3089-42b5-8239-25e74fc50f16 tempest-CreateVolumesFromImageTest-1947233898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:09 devstack sudo[88473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:08:09 devstack sudo[88473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:10 devstack sudo[88471]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:10 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-53993c1c-8224-4506-8406-332fc187fc7b tempest-GroupSnapshotsTest-1124623539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9ecc363c-d1c7-4c96-9459-b6296668afda.8400c8fd-2845-4708-aa62-70a1a5108be7" returned: 0 in 0.750s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:10 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-53993c1c-8224-4506-8406-332fc187fc7b tempest-GroupSnapshotsTest-1124623539 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ecc363c-d1c7-4c96-9459-b6296668afda(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 22:08:10 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-53993c1c-8224-4506-8406-332fc187fc7b tempest-GroupSnapshotsTest-1124623539 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9ecc363c-d1c7-4c96-9459-b6296668afda {{(pid=83924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 28 22:08:10 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-53993c1c-8224-4506-8406-332fc187fc7b tempest-GroupSnapshotsTest-1124623539 None] Creating direct copy from snapshot {{(pid=83924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 28 22:08:10 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc6c4da-7dab-4970-83bf-3183357065de]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:08:10 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-53993c1c-8224-4506-8406-332fc187fc7b tempest-GroupSnapshotsTest-1124623539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9ecc363c-d1c7-4c96-9459-b6296668afda {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:10 devstack sudo[88478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9ecc363c-d1c7-4c96-9459-b6296668afda
Apr 28 22:08:10 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-0667d2b8-3089-42b5-8239-25e74fc50f16 tempest-CreateVolumesFromImageTest-1947233898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.624s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:10 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-0667d2b8-3089-42b5-8239-25e74fc50f16 tempest-CreateVolumesFromImageTest-1947233898 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:08:10 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-0667d2b8-3089-42b5-8239-25e74fc50f16 tempest-CreateVolumesFromImageTest-1947233898 None] Deleted volume successfully.
Apr 28 22:08:10 devstack sudo[88478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:10 devstack sudo[88473]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:10 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-0667d2b8-3089-42b5-8239-25e74fc50f16 tempest-CreateVolumesFromImageTest-1947233898 None] Lock "cinder-6abd9c05-af76-4a9d-972b-75990911039b-delete_volume" released by "delete_volume" :: held 2.657s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:08:11 devstack sudo[88478]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:11 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-53993c1c-8224-4506-8406-332fc187fc7b tempest-GroupSnapshotsTest-1124623539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9ecc363c-d1c7-4c96-9459-b6296668afda" returned: 0 in 1.067s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:11 devstack cinder-volume[83924]: DEBUG cinder.utils [None req-53993c1c-8224-4506-8406-332fc187fc7b tempest-GroupSnapshotsTest-1124623539 None] Path /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-c53e4869-4a89-4379-b0f3-c34ddaebf32c not found in is_blk_device check {{(pid=83924) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 28 22:08:11 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-53993c1c-8224-4506-8406-332fc187fc7b tempest-GroupSnapshotsTest-1124623539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9ecc363c-d1c7-4c96-9459-b6296668afda /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-c53e4869-4a89-4379-b0f3-c34ddaebf32c {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:11 devstack sudo[88522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9ecc363c-d1c7-4c96-9459-b6296668afda /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-c53e4869-4a89-4379-b0f3-c34ddaebf32c
Apr 28 22:08:11 devstack sudo[88522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:18 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-3055e459-2bdb-4e0f-8521-1b4c409e42ac tempest-CreateVolumesFromSnapshotTest-85329515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:08:18 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3055e459-2bdb-4e0f-8521-1b4c409e42ac tempest-CreateVolumesFromSnapshotTest-85329515 None] Flow 'volume_create_manager' (048c729e-a10f-468b-95f6-0f0ca5f658d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:08:18 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3055e459-2bdb-4e0f-8521-1b4c409e42ac tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62ce68a8-e552-463e-a314-c78c0eee5687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:08:18 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3055e459-2bdb-4e0f-8521-1b4c409e42ac tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62ce68a8-e552-463e-a314-c78c0eee5687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:08:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1542187337',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb1cbeed-da05-4254-b527-a54975ee9f9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54fd118d8f134cc2bb3fab9132d5cf5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:08:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:08:18Z,use_quota=True,user_id='dbba665dba77489ba5b3b191f577183e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:08:18 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3055e459-2bdb-4e0f-8521-1b4c409e42ac tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de7085ab-4ea2-4106-816b-bba588b1c2db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:08:18 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3055e459-2bdb-4e0f-8521-1b4c409e42ac tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de7085ab-4ea2-4106-816b-bba588b1c2db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:08:18 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3055e459-2bdb-4e0f-8521-1b4c409e42ac tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67be3f3c-3b58-4954-af7c-c2a38e3bcc0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:08:18 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3055e459-2bdb-4e0f-8521-1b4c409e42ac tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67be3f3c-3b58-4954-af7c-c2a38e3bcc0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb1cbeed-da05-4254-b527-a54975ee9f9f', 'volume_name': 'volume-bb1cbeed-da05-4254-b527-a54975ee9f9f', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:08:18 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3055e459-2bdb-4e0f-8521-1b4c409e42ac tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cb129d1-9e06-4aa8-a3b7-6e98ef95cfbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:08:18 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3055e459-2bdb-4e0f-8521-1b4c409e42ac tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cb129d1-9e06-4aa8-a3b7-6e98ef95cfbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:08:18 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3055e459-2bdb-4e0f-8521-1b4c409e42ac tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a78bf4b5-4a3d-4794-ba6a-550dd7a23327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:08:18 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-3055e459-2bdb-4e0f-8521-1b4c409e42ac tempest-CreateVolumesFromSnapshotTest-85329515 None] Volume bb1cbeed-da05-4254-b527-a54975ee9f9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb1cbeed-da05-4254-b527-a54975ee9f9f', 'volume_size': 1}
Apr 28 22:08:18 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-3055e459-2bdb-4e0f-8521-1b4c409e42ac tempest-CreateVolumesFromSnapshotTest-85329515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:08:20 devstack sudo[88522]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-53993c1c-8224-4506-8406-332fc187fc7b tempest-GroupSnapshotsTest-1124623539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9ecc363c-d1c7-4c96-9459-b6296668afda /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-c53e4869-4a89-4379-b0f3-c34ddaebf32c" returned: 0 in 8.871s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:20 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[351d7678-c7d6-4420-b0f7-2f7e6566c6a2]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:08:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-53993c1c-8224-4506-8406-332fc187fc7b tempest-GroupSnapshotsTest-1124623539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9ecc363c-d1c7-4c96-9459-b6296668afda {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:20 devstack sudo[88620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9ecc363c-d1c7-4c96-9459-b6296668afda
Apr 28 22:08:20 devstack sudo[88620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:21 devstack sudo[88620]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:21 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-53993c1c-8224-4506-8406-332fc187fc7b tempest-GroupSnapshotsTest-1124623539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9ecc363c-d1c7-4c96-9459-b6296668afda" returned: 0 in 1.102s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:21 devstack cinder-volume[83924]: DEBUG cinder.image.image_utils [None req-53993c1c-8224-4506-8406-332fc187fc7b tempest-GroupSnapshotsTest-1124623539 None] Image conversion details: src /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9ecc363c-d1c7-4c96-9459-b6296668afda, size 1024.00 MB, duration 8.88 sec, destination /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-c53e4869-4a89-4379-b0f3-c34ddaebf32c {{(pid=83924) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 28 22:08:21 devstack cinder-volume[83924]: INFO cinder.image.image_utils [None req-53993c1c-8224-4506-8406-332fc187fc7b tempest-GroupSnapshotsTest-1124623539 None] Converted 1024.00 MB image at 115.37 MB/s
Apr 28 22:08:21 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-53993c1c-8224-4506-8406-332fc187fc7b tempest-GroupSnapshotsTest-1124623539 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-c53e4869-4a89-4379-b0f3-c34ddaebf32c is being set with open permissions: ugo+rw: NotImplementedError
Apr 28 22:08:21 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-53993c1c-8224-4506-8406-332fc187fc7b tempest-GroupSnapshotsTest-1124623539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-c53e4869-4a89-4379-b0f3-c34ddaebf32c {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:21 devstack sudo[88675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-c53e4869-4a89-4379-b0f3-c34ddaebf32c
Apr 28 22:08:21 devstack sudo[88675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:21 devstack sudo[88675]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:21 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-53993c1c-8224-4506-8406-332fc187fc7b tempest-GroupSnapshotsTest-1124623539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-c53e4869-4a89-4379-b0f3-c34ddaebf32c" returned: 0 in 0.761s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:21 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-53993c1c-8224-4506-8406-332fc187fc7b tempest-GroupSnapshotsTest-1124623539 None] Lock "cinder-quobyte-c53e4869-4a89-4379-b0f3-c34ddaebf32c" released by "_copy_volume_from_snapshot" :: held 12.717s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:08:21 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-53993c1c-8224-4506-8406-332fc187fc7b tempest-GroupSnapshotsTest-1124623539 None] Lock "cinder-quobyte-8400c8fd-2845-4708-aa62-70a1a5108be7-c53e4869-4a89-4379-b0f3-c34ddaebf32c" released by "_create_volume_from_snapshot" :: held 12.762s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:08:21 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-53993c1c-8224-4506-8406-332fc187fc7b tempest-GroupSnapshotsTest-1124623539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.788s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:08:21 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f2c3399f-5a61-4ecf-8f37-213c72ec8084 tempest-VolumesCloneTest-1046112886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.539s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:08:21 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-f2c3399f-5a61-4ecf-8f37-213c72ec8084 tempest-VolumesCloneTest-1046112886 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:08:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-226902935',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dac2b42-bdc2-410d-b581-5868706cbbb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a2840073c5a4b9da3e493d087861658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:08:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:08:09Z,use_quota=True,user_id='7771d5ae4784410d94f397f684a96479',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:08:21 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-f2c3399f-5a61-4ecf-8f37-213c72ec8084 tempest-VolumesCloneTest-1046112886 None] Creating volume 6dac2b42-bdc2-410d-b581-5868706cbbb5 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:08:21 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f2c3399f-5a61-4ecf-8f37-213c72ec8084 tempest-VolumesCloneTest-1046112886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:08:21 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f2c3399f-5a61-4ecf-8f37-213c72ec8084 tempest-VolumesCloneTest-1046112886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:08:21 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-f2c3399f-5a61-4ecf-8f37-213c72ec8084 tempest-VolumesCloneTest-1046112886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:08:21 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-f2c3399f-5a61-4ecf-8f37-213c72ec8084 tempest-VolumesCloneTest-1046112886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:08:21 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f2c3399f-5a61-4ecf-8f37-213c72ec8084 tempest-VolumesCloneTest-1046112886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:08:21 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-f2c3399f-5a61-4ecf-8f37-213c72ec8084 tempest-VolumesCloneTest-1046112886 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:08:21 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-f2c3399f-5a61-4ecf-8f37-213c72ec8084 tempest-VolumesCloneTest-1046112886 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:08:21 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f2c3399f-5a61-4ecf-8f37-213c72ec8084 tempest-VolumesCloneTest-1046112886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6dac2b42-bdc2-410d-b581-5868706cbbb5 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:22 devstack sudo[88683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6dac2b42-bdc2-410d-b581-5868706cbbb5 1073741824
Apr 28 22:08:22 devstack sudo[88683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:22 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-53993c1c-8224-4506-8406-332fc187fc7b tempest-GroupSnapshotsTest-1124623539 None] Create group from source-snapshot-b6c481c7-ec2e-4a80-bd94-fcd041c067a0 completed successfully.
Apr 28 22:08:23 devstack sudo[88683]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:23 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f2c3399f-5a61-4ecf-8f37-213c72ec8084 tempest-VolumesCloneTest-1046112886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6dac2b42-bdc2-410d-b581-5868706cbbb5 1073741824" returned: 0 in 1.340s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:23 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f2c3399f-5a61-4ecf-8f37-213c72ec8084 tempest-VolumesCloneTest-1046112886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6dac2b42-bdc2-410d-b581-5868706cbbb5 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:23 devstack sudo[88699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6dac2b42-bdc2-410d-b581-5868706cbbb5
Apr 28 22:08:23 devstack sudo[88699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:23 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-9d55b1d2-66d7-4ddc-be7e-960a5de4a458 tempest-GroupSnapshotsTest-1124623539 None] Acquiring lock "cinder-quobyte-c53e4869-4a89-4379-b0f3-c34ddaebf32c" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:08:23 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-9d55b1d2-66d7-4ddc-be7e-960a5de4a458 tempest-GroupSnapshotsTest-1124623539 None] Lock "cinder-quobyte-c53e4869-4a89-4379-b0f3-c34ddaebf32c" acquired by "delete_volume" :: waited 0.023s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:08:23 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0056e5dd-0524-45de-88a4-eb040a5b049a]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:08:23 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-9d55b1d2-66d7-4ddc-be7e-960a5de4a458 tempest-GroupSnapshotsTest-1124623539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-c53e4869-4a89-4379-b0f3-c34ddaebf32c {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:24 devstack sudo[88710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-c53e4869-4a89-4379-b0f3-c34ddaebf32c
Apr 28 22:08:24 devstack sudo[88710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:24 devstack sudo[88699]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:24 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f2c3399f-5a61-4ecf-8f37-213c72ec8084 tempest-VolumesCloneTest-1046112886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6dac2b42-bdc2-410d-b581-5868706cbbb5" returned: 0 in 1.058s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:24 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-f2c3399f-5a61-4ecf-8f37-213c72ec8084 tempest-VolumesCloneTest-1046112886 None] <== create_volume: return (2476ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:08:24 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f2c3399f-5a61-4ecf-8f37-213c72ec8084 tempest-VolumesCloneTest-1046112886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.480s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:08:24 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-3055e459-2bdb-4e0f-8521-1b4c409e42ac tempest-CreateVolumesFromSnapshotTest-85329515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.793s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:08:24 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-3055e459-2bdb-4e0f-8521-1b4c409e42ac tempest-CreateVolumesFromSnapshotTest-85329515 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:08:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1542187337',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb1cbeed-da05-4254-b527-a54975ee9f9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54fd118d8f134cc2bb3fab9132d5cf5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:08:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:08:18Z,use_quota=True,user_id='dbba665dba77489ba5b3b191f577183e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:08:24 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-3055e459-2bdb-4e0f-8521-1b4c409e42ac tempest-CreateVolumesFromSnapshotTest-85329515 None] Creating volume bb1cbeed-da05-4254-b527-a54975ee9f9f {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:08:24 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-3055e459-2bdb-4e0f-8521-1b4c409e42ac tempest-CreateVolumesFromSnapshotTest-85329515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:08:24 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-3055e459-2bdb-4e0f-8521-1b4c409e42ac tempest-CreateVolumesFromSnapshotTest-85329515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:08:24 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-3055e459-2bdb-4e0f-8521-1b4c409e42ac tempest-CreateVolumesFromSnapshotTest-85329515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:08:24 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-3055e459-2bdb-4e0f-8521-1b4c409e42ac tempest-CreateVolumesFromSnapshotTest-85329515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:08:24 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-3055e459-2bdb-4e0f-8521-1b4c409e42ac tempest-CreateVolumesFromSnapshotTest-85329515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:08:24 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-3055e459-2bdb-4e0f-8521-1b4c409e42ac tempest-CreateVolumesFromSnapshotTest-85329515 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:08:24 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-3055e459-2bdb-4e0f-8521-1b4c409e42ac tempest-CreateVolumesFromSnapshotTest-85329515 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:08:24 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-3055e459-2bdb-4e0f-8521-1b4c409e42ac tempest-CreateVolumesFromSnapshotTest-85329515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-bb1cbeed-da05-4254-b527-a54975ee9f9f 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:24 devstack sudo[88741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-bb1cbeed-da05-4254-b527-a54975ee9f9f 1073741824
Apr 28 22:08:24 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f2c3399f-5a61-4ecf-8f37-213c72ec8084 tempest-VolumesCloneTest-1046112886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53c03040-f5c7-4cd8-a165-3757181adba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dac2b42-bdc2-410d-b581-5868706cbbb5', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:08:24 devstack sudo[88741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:24 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f2c3399f-5a61-4ecf-8f37-213c72ec8084 tempest-VolumesCloneTest-1046112886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4744936-1a80-4b57-b376-111e33897b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:08:24 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-f2c3399f-5a61-4ecf-8f37-213c72ec8084 tempest-VolumesCloneTest-1046112886 None] Volume volume-6dac2b42-bdc2-410d-b581-5868706cbbb5 (6dac2b42-bdc2-410d-b581-5868706cbbb5): created successfully
Apr 28 22:08:24 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f2c3399f-5a61-4ecf-8f37-213c72ec8084 tempest-VolumesCloneTest-1046112886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4744936-1a80-4b57-b376-111e33897b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:08:24 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f2c3399f-5a61-4ecf-8f37-213c72ec8084 tempest-VolumesCloneTest-1046112886 None] Flow 'volume_create_manager' (debc7256-e180-4d65-acce-5636ba86f650) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:08:24 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-f2c3399f-5a61-4ecf-8f37-213c72ec8084 tempest-VolumesCloneTest-1046112886 None] Created volume successfully.
Apr 28 22:08:25 devstack sudo[88710]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:25 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-9d55b1d2-66d7-4ddc-be7e-960a5de4a458 tempest-GroupSnapshotsTest-1124623539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-c53e4869-4a89-4379-b0f3-c34ddaebf32c" returned: 0 in 1.289s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:25 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-9d55b1d2-66d7-4ddc-be7e-960a5de4a458 tempest-GroupSnapshotsTest-1124623539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-c53e4869-4a89-4379-b0f3-c34ddaebf32c {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:25 devstack sudo[88756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-c53e4869-4a89-4379-b0f3-c34ddaebf32c
Apr 28 22:08:25 devstack sudo[88756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:25 devstack sudo[88741]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:25 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-3055e459-2bdb-4e0f-8521-1b4c409e42ac tempest-CreateVolumesFromSnapshotTest-85329515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-bb1cbeed-da05-4254-b527-a54975ee9f9f 1073741824" returned: 0 in 1.182s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:25 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-3055e459-2bdb-4e0f-8521-1b4c409e42ac tempest-CreateVolumesFromSnapshotTest-85329515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-bb1cbeed-da05-4254-b527-a54975ee9f9f {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:25 devstack sudo[88763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-bb1cbeed-da05-4254-b527-a54975ee9f9f
Apr 28 22:08:25 devstack sudo[88763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:25 devstack sudo[88756]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:25 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-9d55b1d2-66d7-4ddc-be7e-960a5de4a458 tempest-GroupSnapshotsTest-1124623539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-c53e4869-4a89-4379-b0f3-c34ddaebf32c" returned: 0 in 0.692s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:25 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-9d55b1d2-66d7-4ddc-be7e-960a5de4a458 tempest-GroupSnapshotsTest-1124623539 None] Lock "cinder-quobyte-c53e4869-4a89-4379-b0f3-c34ddaebf32c" released by "delete_volume" :: held 2.049s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:08:26 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-9d55b1d2-66d7-4ddc-be7e-960a5de4a458 tempest-GroupSnapshotsTest-1124623539 None] Created reservations ['9e236598-672d-45c0-b952-78cbc6cf89b3'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:08:26 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:08:26 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] Flow 'volume_create_manager' (80317daf-9561-411e-96dc-3c13f1ee1423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:08:26 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af763dbf-7ec9-4241-9a24-af526af4d586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:08:26 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af763dbf-7ec9-4241-9a24-af526af4d586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:08:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-145004715',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=177e6f4b-f0e5-4249-a1f9-368e742a72fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a2840073c5a4b9da3e493d087861658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:08:26Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=6dac2b42-bdc2-410d-b581-5868706cbbb5,status='creating',terminated_at=None,updated_at=2026-04-28T20:08:26Z,use_quota=True,user_id='7771d5ae4784410d94f397f684a96479',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:08:26 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a205705-6868-4208-9ab9-cef2016680f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:08:26 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a205705-6868-4208-9ab9-cef2016680f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:08:26 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d6ff089-5242-41d8-8104-8d0d3c3ed287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:08:26 devstack cinder-volume[83924]: WARNING cinder.quota [None req-9d55b1d2-66d7-4ddc-be7e-960a5de4a458 tempest-GroupSnapshotsTest-1124623539 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-725616404 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-725616404, it is now deprecated. Please use the default quota class for default quota.
Apr 28 22:08:26 devstack cinder-volume[83924]: WARNING cinder.quota [None req-9d55b1d2-66d7-4ddc-be7e-960a5de4a458 tempest-GroupSnapshotsTest-1124623539 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-725616404 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-725616404, it is now deprecated. Please use the default quota class for default quota.
Apr 28 22:08:26 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d6ff089-5242-41d8-8104-8d0d3c3ed287) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '177e6f4b-f0e5-4249-a1f9-368e742a72fb', 'volume_name': 'volume-177e6f4b-f0e5-4249-a1f9-368e742a72fb', 'volume_size': 2, 'source_volid': '6dac2b42-bdc2-410d-b581-5868706cbbb5', 'source_volstatus': 'available'}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:08:26 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79992145-1f61-4ca0-9bd0-a075a9e19bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:08:26 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79992145-1f61-4ca0-9bd0-a075a9e19bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:08:26 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87caffc4-9c4c-4360-b3d8-4e2f8464d158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:08:26 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] Volume 177e6f4b-f0e5-4249-a1f9-368e742a72fb: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-177e6f4b-f0e5-4249-a1f9-368e742a72fb', 'volume_size': 2, 'source_volid': '6dac2b42-bdc2-410d-b581-5868706cbbb5', 'source_volstatus': 'available'}
Apr 28 22:08:26 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:08:26 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-9d55b1d2-66d7-4ddc-be7e-960a5de4a458 tempest-GroupSnapshotsTest-1124623539 None] Created reservations ['50c370f4-205f-4dff-9a34-1f9b06adbc57', '3c0b0f45-bdc3-420e-9191-12c2c429d68c', '0fb8a9d3-d92f-4e7b-8182-2a0051021317', '1e7dc981-684c-456f-abdd-1bd0658bfd3a'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:08:26 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-9d55b1d2-66d7-4ddc-be7e-960a5de4a458 tempest-GroupSnapshotsTest-1124623539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:08:26 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-9d55b1d2-66d7-4ddc-be7e-960a5de4a458 tempest-GroupSnapshotsTest-1124623539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:08:26 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-9d55b1d2-66d7-4ddc-be7e-960a5de4a458 tempest-GroupSnapshotsTest-1124623539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:08:26 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-9d55b1d2-66d7-4ddc-be7e-960a5de4a458 tempest-GroupSnapshotsTest-1124623539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:08:26 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-9d55b1d2-66d7-4ddc-be7e-960a5de4a458 tempest-GroupSnapshotsTest-1124623539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:08:26 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-9d55b1d2-66d7-4ddc-be7e-960a5de4a458 tempest-GroupSnapshotsTest-1124623539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:26 devstack sudo[88766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:08:26 devstack sudo[88766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:26 devstack sudo[88763]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:26 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-3055e459-2bdb-4e0f-8521-1b4c409e42ac tempest-CreateVolumesFromSnapshotTest-85329515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-bb1cbeed-da05-4254-b527-a54975ee9f9f" returned: 0 in 0.936s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:26 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-3055e459-2bdb-4e0f-8521-1b4c409e42ac tempest-CreateVolumesFromSnapshotTest-85329515 None] <== create_volume: return (2188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:08:26 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-3055e459-2bdb-4e0f-8521-1b4c409e42ac tempest-CreateVolumesFromSnapshotTest-85329515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.194s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:08:26 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.389s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:08:26 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] Cloning volume 6dac2b42-bdc2-410d-b581-5868706cbbb5 to volume 177e6f4b-f0e5-4249-a1f9-368e742a72fb
Apr 28 22:08:26 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3055e459-2bdb-4e0f-8521-1b4c409e42ac tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a78bf4b5-4a3d-4794-ba6a-550dd7a23327) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb1cbeed-da05-4254-b527-a54975ee9f9f', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:08:26 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3055e459-2bdb-4e0f-8521-1b4c409e42ac tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (456ce65a-9d89-4585-be78-ddacb3121ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:08:26 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-3055e459-2bdb-4e0f-8521-1b4c409e42ac tempest-CreateVolumesFromSnapshotTest-85329515 None] Volume volume-bb1cbeed-da05-4254-b527-a54975ee9f9f (bb1cbeed-da05-4254-b527-a54975ee9f9f): created successfully
Apr 28 22:08:26 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3055e459-2bdb-4e0f-8521-1b4c409e42ac tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (456ce65a-9d89-4585-be78-ddacb3121ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:08:26 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3055e459-2bdb-4e0f-8521-1b4c409e42ac tempest-CreateVolumesFromSnapshotTest-85329515 None] Flow 'volume_create_manager' (048c729e-a10f-468b-95f6-0f0ca5f658d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:08:26 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] Creating offline snapshot f2378ec4-f243-438b-957b-9b3073494b1d of volume 6dac2b42-bdc2-410d-b581-5868706cbbb5 {{(pid=83924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 22:08:26 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-3055e459-2bdb-4e0f-8521-1b4c409e42ac tempest-CreateVolumesFromSnapshotTest-85329515 None] Created volume successfully.
Apr 28 22:08:26 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e13022e-8a39-4dc8-ba76-ccb475ac7d54]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:08:26 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6dac2b42-bdc2-410d-b581-5868706cbbb5 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:26 devstack sudo[88770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6dac2b42-bdc2-410d-b581-5868706cbbb5
Apr 28 22:08:26 devstack sudo[88770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:27 devstack sudo[88766]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:27 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-9d55b1d2-66d7-4ddc-be7e-960a5de4a458 tempest-GroupSnapshotsTest-1124623539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.779s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:27 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-9d55b1d2-66d7-4ddc-be7e-960a5de4a458 tempest-GroupSnapshotsTest-1124623539 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:08:27 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-9d55b1d2-66d7-4ddc-be7e-960a5de4a458 tempest-GroupSnapshotsTest-1124623539 None] Delete group completed successfully.
Apr 28 22:08:27 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-cebee4cf-3210-4e9a-ba30-3a62e8b9ee3a tempest-CreateVolumesFromSnapshotTest-85329515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:08:27 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-b67acaa3-0f67-41bb-9051-9776278899ef tempest-GroupSnapshotsTest-1124623539 None] group_snapshot b6c481c7-ec2e-4a80-bd94-fcd041c067a0: deleting
Apr 28 22:08:27 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b67acaa3-0f67-41bb-9051-9776278899ef tempest-GroupSnapshotsTest-1124623539 None] group_snapshot b6c481c7-ec2e-4a80-bd94-fcd041c067a0: deleting {{(pid=83924) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 28 22:08:27 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-b67acaa3-0f67-41bb-9051-9776278899ef tempest-GroupSnapshotsTest-1124623539 None] Acquiring lock "cinder-quobyte-9ecc363c-d1c7-4c96-9459-b6296668afda" by "delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:08:27 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-b67acaa3-0f67-41bb-9051-9776278899ef tempest-GroupSnapshotsTest-1124623539 None] Lock "cinder-quobyte-9ecc363c-d1c7-4c96-9459-b6296668afda" acquired by "delete_snapshot" :: waited 0.027s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:08:27 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-b67acaa3-0f67-41bb-9051-9776278899ef tempest-GroupSnapshotsTest-1124623539 None] Acquiring lock "cinder-quobyte-8400c8fd-2845-4708-aa62-70a1a5108be7" by "_delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:08:27 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-b67acaa3-0f67-41bb-9051-9776278899ef tempest-GroupSnapshotsTest-1124623539 None] Lock "cinder-quobyte-8400c8fd-2845-4708-aa62-70a1a5108be7" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:08:27 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-b67acaa3-0f67-41bb-9051-9776278899ef tempest-GroupSnapshotsTest-1124623539 None] Deleting offline snapshot 8400c8fd-2845-4708-aa62-70a1a5108be7 of volume 9ecc363c-d1c7-4c96-9459-b6296668afda {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 22:08:27 devstack sudo[88770]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:27 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-b67acaa3-0f67-41bb-9051-9776278899ef tempest-GroupSnapshotsTest-1124623539 None] snapshot_file for this snap is: volume-9ecc363c-d1c7-4c96-9459-b6296668afda.8400c8fd-2845-4708-aa62-70a1a5108be7 {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 22:08:27 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6dac2b42-bdc2-410d-b581-5868706cbbb5" returned: 0 in 0.976s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:27 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6dac2b42-bdc2-410d-b581-5868706cbbb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6dac2b42-bdc2-410d-b581-5868706cbbb5.f2378ec4-f243-438b-957b-9b3073494b1d 1G {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:27 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8aa128-6756-4792-9f80-ff609275b6d0]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:08:27 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b67acaa3-0f67-41bb-9051-9776278899ef tempest-GroupSnapshotsTest-1124623539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9ecc363c-d1c7-4c96-9459-b6296668afda.8400c8fd-2845-4708-aa62-70a1a5108be7 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:27 devstack sudo[88776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6dac2b42-bdc2-410d-b581-5868706cbbb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6dac2b42-bdc2-410d-b581-5868706cbbb5.f2378ec4-f243-438b-957b-9b3073494b1d 1G
Apr 28 22:08:27 devstack sudo[88776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:27 devstack cinder-volume[83924]: INFO cinder.volume.manager [req-f0f939b7-8253-4eb9-8628-6b050bb8f801 req-44b75c18-c51b-4475-9ebd-46449d0e082e tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Terminate volume connection completed successfully.
Apr 28 22:08:27 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [req-f0f939b7-8253-4eb9-8628-6b050bb8f801 req-44b75c18-c51b-4475-9ebd-46449d0e082e tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Deleting attachment 57921aad-fe00-4cd3-84e0-a8d57d483ddf. {{(pid=83924) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 28 22:08:27 devstack sudo[88777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9ecc363c-d1c7-4c96-9459-b6296668afda.8400c8fd-2845-4708-aa62-70a1a5108be7
Apr 28 22:08:27 devstack sudo[88777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:28 devstack cinder-volume[83924]: DEBUG cinder.coordination [req-f0f939b7-8253-4eb9-8628-6b050bb8f801 req-4070ee43-e91d-4566-ae1c-19fa4b1e5b5c tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Acquiring lock "cinder-3ec3f721-0545-4552-add7-a099f022ffe2-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:08:28 devstack cinder-volume[83924]: DEBUG cinder.coordination [req-f0f939b7-8253-4eb9-8628-6b050bb8f801 req-4070ee43-e91d-4566-ae1c-19fa4b1e5b5c tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Lock "cinder-3ec3f721-0545-4552-add7-a099f022ffe2-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:08:28 devstack sudo[88777]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:28 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b67acaa3-0f67-41bb-9051-9776278899ef tempest-GroupSnapshotsTest-1124623539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9ecc363c-d1c7-4c96-9459-b6296668afda.8400c8fd-2845-4708-aa62-70a1a5108be7" returned: 0 in 0.753s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:28 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-b67acaa3-0f67-41bb-9051-9776278899ef tempest-GroupSnapshotsTest-1124623539 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ecc363c-d1c7-4c96-9459-b6296668afda(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 22:08:28 devstack cinder-volume[83924]: DEBUG cinder.coordination [req-f0f939b7-8253-4eb9-8628-6b050bb8f801 req-4070ee43-e91d-4566-ae1c-19fa4b1e5b5c tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Acquiring lock "cinder-quobyte-3ec3f721-0545-4552-add7-a099f022ffe2" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:08:28 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82380d6-c3d9-484b-8100-cdd61bfbbf63]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:08:28 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b67acaa3-0f67-41bb-9051-9776278899ef tempest-GroupSnapshotsTest-1124623539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9ecc363c-d1c7-4c96-9459-b6296668afda {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:28 devstack cinder-volume[83924]: DEBUG cinder.coordination [req-f0f939b7-8253-4eb9-8628-6b050bb8f801 req-4070ee43-e91d-4566-ae1c-19fa4b1e5b5c tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Lock "cinder-quobyte-3ec3f721-0545-4552-add7-a099f022ffe2" acquired by "delete_volume" :: waited 0.037s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:08:28 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e959c5-73b9-48be-8302-97b913796467]: (4, 'raw') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:08:28 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-f0f939b7-8253-4eb9-8628-6b050bb8f801 req-4070ee43-e91d-4566-ae1c-19fa4b1e5b5c tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3ec3f721-0545-4552-add7-a099f022ffe2 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:28 devstack sudo[88776]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:28 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6dac2b42-bdc2-410d-b581-5868706cbbb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6dac2b42-bdc2-410d-b581-5868706cbbb5.f2378ec4-f243-438b-957b-9b3073494b1d 1G" returned: 0 in 0.905s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:28 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dac2b42-bdc2-410d-b581-5868706cbbb5 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6dac2b42-bdc2-410d-b581-5868706cbbb5.f2378ec4-f243-438b-957b-9b3073494b1d {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:28 devstack sudo[88789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dac2b42-bdc2-410d-b581-5868706cbbb5 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6dac2b42-bdc2-410d-b581-5868706cbbb5.f2378ec4-f243-438b-957b-9b3073494b1d
Apr 28 22:08:28 devstack sudo[88789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:28 devstack sudo[88787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9ecc363c-d1c7-4c96-9459-b6296668afda
Apr 28 22:08:28 devstack sudo[88787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:28 devstack sudo[88788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3ec3f721-0545-4552-add7-a099f022ffe2
Apr 28 22:08:28 devstack sudo[88788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:29 devstack sudo[88787]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b67acaa3-0f67-41bb-9051-9776278899ef tempest-GroupSnapshotsTest-1124623539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9ecc363c-d1c7-4c96-9459-b6296668afda" returned: 0 in 0.880s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:29 devstack sudo[88788]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b67acaa3-0f67-41bb-9051-9776278899ef tempest-GroupSnapshotsTest-1124623539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9ecc363c-d1c7-4c96-9459-b6296668afda.8400c8fd-2845-4708-aa62-70a1a5108be7 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-f0f939b7-8253-4eb9-8628-6b050bb8f801 req-4070ee43-e91d-4566-ae1c-19fa4b1e5b5c tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3ec3f721-0545-4552-add7-a099f022ffe2" returned: 0 in 0.824s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-f0f939b7-8253-4eb9-8628-6b050bb8f801 req-4070ee43-e91d-4566-ae1c-19fa4b1e5b5c tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3ec3f721-0545-4552-add7-a099f022ffe2 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:29 devstack sudo[88789]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dac2b42-bdc2-410d-b581-5868706cbbb5 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6dac2b42-bdc2-410d-b581-5868706cbbb5.f2378ec4-f243-438b-957b-9b3073494b1d" returned: 0 in 0.819s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:29 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6dac2b42-bdc2-410d-b581-5868706cbbb5.f2378ec4-f243-438b-957b-9b3073494b1d is being set with open permissions: ugo+rw
Apr 28 22:08:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6dac2b42-bdc2-410d-b581-5868706cbbb5.f2378ec4-f243-438b-957b-9b3073494b1d {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:29 devstack sudo[88802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9ecc363c-d1c7-4c96-9459-b6296668afda.8400c8fd-2845-4708-aa62-70a1a5108be7
Apr 28 22:08:29 devstack sudo[88802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:29 devstack sudo[88805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6dac2b42-bdc2-410d-b581-5868706cbbb5.f2378ec4-f243-438b-957b-9b3073494b1d
Apr 28 22:08:29 devstack sudo[88805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:29 devstack sudo[88803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3ec3f721-0545-4552-add7-a099f022ffe2
Apr 28 22:08:29 devstack sudo[88803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:30 devstack sudo[88805]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:30 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6dac2b42-bdc2-410d-b581-5868706cbbb5.f2378ec4-f243-438b-957b-9b3073494b1d" returned: 0 in 0.710s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:30 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6dac2b42-bdc2-410d-b581-5868706cbbb5.info {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:30 devstack sudo[88815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6dac2b42-bdc2-410d-b581-5868706cbbb5.info
Apr 28 22:08:30 devstack sudo[88815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:30 devstack sudo[88803]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:30 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-f0f939b7-8253-4eb9-8628-6b050bb8f801 req-4070ee43-e91d-4566-ae1c-19fa4b1e5b5c tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3ec3f721-0545-4552-add7-a099f022ffe2" returned: 1 in 0.848s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:30 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-f0f939b7-8253-4eb9-8628-6b050bb8f801 req-4070ee43-e91d-4566-ae1c-19fa4b1e5b5c tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3ec3f721-0545-4552-add7-a099f022ffe2' failed. Not Retrying. {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 28 22:08:30 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-f0f939b7-8253-4eb9-8628-6b050bb8f801 req-4070ee43-e91d-4566-ae1c-19fa4b1e5b5c tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3ec3f721-0545-4552-add7-a099f022ffe2 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:30 devstack sudo[88802]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:30 devstack sudo[88817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3ec3f721-0545-4552-add7-a099f022ffe2
Apr 28 22:08:30 devstack sudo[88817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:30 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b67acaa3-0f67-41bb-9051-9776278899ef tempest-GroupSnapshotsTest-1124623539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9ecc363c-d1c7-4c96-9459-b6296668afda.8400c8fd-2845-4708-aa62-70a1a5108be7" returned: 0 in 0.890s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:30 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b67acaa3-0f67-41bb-9051-9776278899ef tempest-GroupSnapshotsTest-1124623539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9ecc363c-d1c7-4c96-9459-b6296668afda.8400c8fd-2845-4708-aa62-70a1a5108be7 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:30 devstack sudo[88819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9ecc363c-d1c7-4c96-9459-b6296668afda.8400c8fd-2845-4708-aa62-70a1a5108be7
Apr 28 22:08:30 devstack sudo[88819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:30 devstack sudo[88815]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:30 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6dac2b42-bdc2-410d-b581-5868706cbbb5.info" returned: 0 in 0.723s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:30 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6dac2b42-bdc2-410d-b581-5868706cbbb5.info is being set with open permissions: ugo+rw
Apr 28 22:08:30 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6dac2b42-bdc2-410d-b581-5868706cbbb5.info {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:30 devstack sudo[88824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6dac2b42-bdc2-410d-b581-5868706cbbb5.info
Apr 28 22:08:30 devstack sudo[88824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:31 devstack sudo[88817]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-f0f939b7-8253-4eb9-8628-6b050bb8f801 req-4070ee43-e91d-4566-ae1c-19fa4b1e5b5c tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3ec3f721-0545-4552-add7-a099f022ffe2" returned: 0 in 0.733s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:31 devstack sudo[88819]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b67acaa3-0f67-41bb-9051-9776278899ef tempest-GroupSnapshotsTest-1124623539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9ecc363c-d1c7-4c96-9459-b6296668afda.8400c8fd-2845-4708-aa62-70a1a5108be7" returned: 0 in 0.715s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:31 devstack cinder-volume[83924]: DEBUG cinder.coordination [req-f0f939b7-8253-4eb9-8628-6b050bb8f801 req-4070ee43-e91d-4566-ae1c-19fa4b1e5b5c tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Lock "cinder-quobyte-3ec3f721-0545-4552-add7-a099f022ffe2" released by "delete_volume" :: held 2.516s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:08:31 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-b67acaa3-0f67-41bb-9051-9776278899ef tempest-GroupSnapshotsTest-1124623539 None] Lock "cinder-quobyte-8400c8fd-2845-4708-aa62-70a1a5108be7" released by "_delete_snapshot" :: held 3.419s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:08:31 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-b67acaa3-0f67-41bb-9051-9776278899ef tempest-GroupSnapshotsTest-1124623539 None] Lock "cinder-quobyte-9ecc363c-d1c7-4c96-9459-b6296668afda" released by "delete_snapshot" :: held 3.470s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:08:31 devstack cinder-volume[83924]: DEBUG cinder.quota [req-f0f939b7-8253-4eb9-8628-6b050bb8f801 req-4070ee43-e91d-4566-ae1c-19fa4b1e5b5c tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Created reservations ['1a3d73e1-482f-4503-837b-2c78635dbaca', 'd7b2dd5f-289c-40a6-bdcc-b1b0f65b77ec', 'fe17fe25-e69d-4910-a10d-6ee5a1da51db', '0d39de87-1c5a-4770-9b08-5194cc2e5821'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:08:31 devstack cinder-volume[83924]: WARNING cinder.quota [None req-b67acaa3-0f67-41bb-9051-9776278899ef tempest-GroupSnapshotsTest-1124623539 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-725616404 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-725616404, it is now deprecated. Please use the default quota class for default quota.
Apr 28 22:08:31 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-b67acaa3-0f67-41bb-9051-9776278899ef tempest-GroupSnapshotsTest-1124623539 None] Created reservations ['c86074a3-c710-4bb9-8d89-65d6ec44d911', '24556dae-1756-4ab1-9db0-f5775a0af7b7', '3c638e54-16d4-4131-a982-77feb0600ec2', 'f0901ed8-91f4-476c-bd3f-1ab28aadb5f5'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:08:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [req-f0f939b7-8253-4eb9-8628-6b050bb8f801 req-4070ee43-e91d-4566-ae1c-19fa4b1e5b5c tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:08:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [req-f0f939b7-8253-4eb9-8628-6b050bb8f801 req-4070ee43-e91d-4566-ae1c-19fa4b1e5b5c tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:08:31 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [req-f0f939b7-8253-4eb9-8628-6b050bb8f801 req-4070ee43-e91d-4566-ae1c-19fa4b1e5b5c tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:08:31 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [req-f0f939b7-8253-4eb9-8628-6b050bb8f801 req-4070ee43-e91d-4566-ae1c-19fa4b1e5b5c tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:08:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [req-f0f939b7-8253-4eb9-8628-6b050bb8f801 req-4070ee43-e91d-4566-ae1c-19fa4b1e5b5c tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:08:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-f0f939b7-8253-4eb9-8628-6b050bb8f801 req-4070ee43-e91d-4566-ae1c-19fa4b1e5b5c tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:31 devstack sudo[88826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:08:31 devstack sudo[88826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:31 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-b67acaa3-0f67-41bb-9051-9776278899ef tempest-GroupSnapshotsTest-1124623539 None] group_snapshot b6c481c7-ec2e-4a80-bd94-fcd041c067a0: deleted successfully
Apr 28 22:08:31 devstack sudo[88824]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6dac2b42-bdc2-410d-b581-5868706cbbb5.info" returned: 0 in 0.850s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:31 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] Acquiring lock "cinder-quobyte-177e6f4b-f0e5-4249-a1f9-368e742a72fb" by "_copy_volume_from_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:08:31 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] Lock "cinder-quobyte-177e6f4b-f0e5-4249-a1f9-368e742a72fb" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:08:31 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] snapshot: f2378ec4-f243-438b-957b-9b3073494b1d, volume: 177e6f4b-f0e5-4249-a1f9-368e742a72fb,  {{(pid=83924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 28 22:08:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:08:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:08:31 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:08:31 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:08:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:08:31 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef13b807-4f72-45c4-b0e4-417e6cc87d83]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:08:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6dac2b42-bdc2-410d-b581-5868706cbbb5.f2378ec4-f243-438b-957b-9b3073494b1d {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:32 devstack sudo[88829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6dac2b42-bdc2-410d-b581-5868706cbbb5.f2378ec4-f243-438b-957b-9b3073494b1d
Apr 28 22:08:32 devstack sudo[88829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:32 devstack sudo[88826]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:32 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-f0f939b7-8253-4eb9-8628-6b050bb8f801 req-4070ee43-e91d-4566-ae1c-19fa4b1e5b5c tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.836s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:32 devstack cinder-volume[83924]: DEBUG cinder.manager [req-f0f939b7-8253-4eb9-8628-6b050bb8f801 req-4070ee43-e91d-4566-ae1c-19fa4b1e5b5c tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:08:32 devstack cinder-volume[83924]: INFO cinder.volume.manager [req-f0f939b7-8253-4eb9-8628-6b050bb8f801 req-4070ee43-e91d-4566-ae1c-19fa4b1e5b5c tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Deleted volume successfully.
Apr 28 22:08:32 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-5fa6a6da-a48c-425d-b8f3-578d940c968a tempest-GroupSnapshotsTest-1124623539 None] Acquiring lock "cinder-quobyte-9ecc363c-d1c7-4c96-9459-b6296668afda" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:08:32 devstack cinder-volume[83924]: DEBUG cinder.coordination [req-f0f939b7-8253-4eb9-8628-6b050bb8f801 req-4070ee43-e91d-4566-ae1c-19fa4b1e5b5c tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Lock "cinder-3ec3f721-0545-4552-add7-a099f022ffe2-delete_volume" released by "delete_volume" :: held 3.825s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:08:32 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-5fa6a6da-a48c-425d-b8f3-578d940c968a tempest-GroupSnapshotsTest-1124623539 None] Lock "cinder-quobyte-9ecc363c-d1c7-4c96-9459-b6296668afda" acquired by "delete_volume" :: waited 0.047s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:08:32 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c17a40f-a780-486f-a42c-39157541a7ec]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:08:32 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5fa6a6da-a48c-425d-b8f3-578d940c968a tempest-GroupSnapshotsTest-1124623539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9ecc363c-d1c7-4c96-9459-b6296668afda {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:32 devstack sudo[88833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9ecc363c-d1c7-4c96-9459-b6296668afda
Apr 28 22:08:32 devstack sudo[88833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:32 devstack sudo[88829]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:32 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6dac2b42-bdc2-410d-b581-5868706cbbb5.f2378ec4-f243-438b-957b-9b3073494b1d" returned: 0 in 0.879s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:32 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6dac2b42-bdc2-410d-b581-5868706cbbb5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 22:08:32 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6dac2b42-bdc2-410d-b581-5868706cbbb5 {{(pid=83924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 28 22:08:32 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] Creating direct copy from snapshot {{(pid=83924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 28 22:08:32 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a575db-5f23-45ca-9f7e-63cc1451a297]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:08:32 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6dac2b42-bdc2-410d-b581-5868706cbbb5 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:32 devstack sudo[88839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6dac2b42-bdc2-410d-b581-5868706cbbb5
Apr 28 22:08:32 devstack sudo[88839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:33 devstack sudo[88833]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:33 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5fa6a6da-a48c-425d-b8f3-578d940c968a tempest-GroupSnapshotsTest-1124623539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9ecc363c-d1c7-4c96-9459-b6296668afda" returned: 0 in 0.944s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:33 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5fa6a6da-a48c-425d-b8f3-578d940c968a tempest-GroupSnapshotsTest-1124623539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9ecc363c-d1c7-4c96-9459-b6296668afda {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:33 devstack sudo[88873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9ecc363c-d1c7-4c96-9459-b6296668afda
Apr 28 22:08:33 devstack sudo[88873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:33 devstack sudo[88839]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:33 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6dac2b42-bdc2-410d-b581-5868706cbbb5" returned: 0 in 1.013s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:33 devstack cinder-volume[83924]: DEBUG cinder.utils [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] Path /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-177e6f4b-f0e5-4249-a1f9-368e742a72fb not found in is_blk_device check {{(pid=83924) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 28 22:08:33 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6dac2b42-bdc2-410d-b581-5868706cbbb5 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-177e6f4b-f0e5-4249-a1f9-368e742a72fb {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:33 devstack sudo[88880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6dac2b42-bdc2-410d-b581-5868706cbbb5 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-177e6f4b-f0e5-4249-a1f9-368e742a72fb
Apr 28 22:08:33 devstack sudo[88880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:34 devstack sudo[88873]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:34 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5fa6a6da-a48c-425d-b8f3-578d940c968a tempest-GroupSnapshotsTest-1124623539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9ecc363c-d1c7-4c96-9459-b6296668afda" returned: 0 in 0.835s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:34 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-5fa6a6da-a48c-425d-b8f3-578d940c968a tempest-GroupSnapshotsTest-1124623539 None] Lock "cinder-quobyte-9ecc363c-d1c7-4c96-9459-b6296668afda" released by "delete_volume" :: held 1.864s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:08:34 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-5fa6a6da-a48c-425d-b8f3-578d940c968a tempest-GroupSnapshotsTest-1124623539 None] Created reservations ['cf688cc2-cff5-4c6d-9a63-c4fe6ccc0041'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:08:34 devstack cinder-volume[83924]: WARNING cinder.db.sqlalchemy.api [None req-5fa6a6da-a48c-425d-b8f3-578d940c968a tempest-GroupSnapshotsTest-1124623539 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-725616404']
Apr 28 22:08:34 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-5fa6a6da-a48c-425d-b8f3-578d940c968a tempest-GroupSnapshotsTest-1124623539 None] Created reservations ['69f4338e-9524-44dc-a9a9-650f8d792844', '20464acb-5989-4142-a00b-4a21abbe6719', 'eb0a63cc-e428-4fea-af62-ebf4160f3349', 'ab493e22-b119-4301-a256-516b8a6b1c8e'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:08:34 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-5fa6a6da-a48c-425d-b8f3-578d940c968a tempest-GroupSnapshotsTest-1124623539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:08:34 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-5fa6a6da-a48c-425d-b8f3-578d940c968a tempest-GroupSnapshotsTest-1124623539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:08:34 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-5fa6a6da-a48c-425d-b8f3-578d940c968a tempest-GroupSnapshotsTest-1124623539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:08:34 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-5fa6a6da-a48c-425d-b8f3-578d940c968a tempest-GroupSnapshotsTest-1124623539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:08:34 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-5fa6a6da-a48c-425d-b8f3-578d940c968a tempest-GroupSnapshotsTest-1124623539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:08:34 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5fa6a6da-a48c-425d-b8f3-578d940c968a tempest-GroupSnapshotsTest-1124623539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:34 devstack sudo[88889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:08:34 devstack sudo[88889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:36 devstack sudo[88889]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:36 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5fa6a6da-a48c-425d-b8f3-578d940c968a tempest-GroupSnapshotsTest-1124623539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 1.712s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:36 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-5fa6a6da-a48c-425d-b8f3-578d940c968a tempest-GroupSnapshotsTest-1124623539 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:08:36 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-5fa6a6da-a48c-425d-b8f3-578d940c968a tempest-GroupSnapshotsTest-1124623539 None] Delete group completed successfully.
Apr 28 22:08:36 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-7758469b-d52f-499d-a482-4564c36b6698 tempest-GroupSnapshotsTest-1124623539 None] Group tempest-GroupSnapshotsTest-Group-1151089784: creating
Apr 28 22:08:36 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-7758469b-d52f-499d-a482-4564c36b6698 tempest-GroupSnapshotsTest-1124623539 None] Group tempest-GroupSnapshotsTest-Group-1151089784: created successfully
Apr 28 22:08:36 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-7758469b-d52f-499d-a482-4564c36b6698 tempest-GroupSnapshotsTest-1124623539 None] Create group completed successfully.
Apr 28 22:08:38 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4c6fb13-f064-4b24-be47-6a6aec17b250 tempest-GroupSnapshotsTest-1124623539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:08:39 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a4c6fb13-f064-4b24-be47-6a6aec17b250 tempest-GroupSnapshotsTest-1124623539 None] Flow 'volume_create_manager' (e29e5cf3-ebdd-495b-a2e7-affbb46700a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:08:39 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a4c6fb13-f064-4b24-be47-6a6aec17b250 tempest-GroupSnapshotsTest-1124623539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5dcde79-daa3-449b-9c9a-c428a1d2ca35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:08:39 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a4c6fb13-f064-4b24-be47-6a6aec17b250 tempest-GroupSnapshotsTest-1124623539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5dcde79-daa3-449b-9c9a-c428a1d2ca35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:08:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2144716351',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=616968f3-5299-462d-8b78-9622730cfa5f,host='devstack@QuobyteHD#QuobyteHD',id=5a543d85-dde5-42ff-b2ad-33b0771e18d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29d2f5d38aff44ebb5481ff2a7413f6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:08:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:08:39Z,use_quota=True,user_id='6cc1cf2f2521481c81eae86959034746',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(88151e99-6fb7-4704-9991-9c633e8c2087),volume_type_id=88151e99-6fb7-4704-9991-9c633e8c2087)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:08:39 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a4c6fb13-f064-4b24-be47-6a6aec17b250 tempest-GroupSnapshotsTest-1124623539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39b50eea-a5c2-49cf-b2e4-ec820952538d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:08:39 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a4c6fb13-f064-4b24-be47-6a6aec17b250 tempest-GroupSnapshotsTest-1124623539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39b50eea-a5c2-49cf-b2e4-ec820952538d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:08:39 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a4c6fb13-f064-4b24-be47-6a6aec17b250 tempest-GroupSnapshotsTest-1124623539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f84b8c00-60d4-4183-b9a5-e67e75d1b54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:08:39 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a4c6fb13-f064-4b24-be47-6a6aec17b250 tempest-GroupSnapshotsTest-1124623539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f84b8c00-60d4-4183-b9a5-e67e75d1b54b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a543d85-dde5-42ff-b2ad-33b0771e18d9', 'volume_name': 'volume-5a543d85-dde5-42ff-b2ad-33b0771e18d9', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:08:39 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a4c6fb13-f064-4b24-be47-6a6aec17b250 tempest-GroupSnapshotsTest-1124623539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (167bc945-41ef-416e-941e-35a546132b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:08:39 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a4c6fb13-f064-4b24-be47-6a6aec17b250 tempest-GroupSnapshotsTest-1124623539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (167bc945-41ef-416e-941e-35a546132b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:08:39 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a4c6fb13-f064-4b24-be47-6a6aec17b250 tempest-GroupSnapshotsTest-1124623539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab1fb1f8-3687-4ba5-b1e6-10c90a223e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:08:39 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-a4c6fb13-f064-4b24-be47-6a6aec17b250 tempest-GroupSnapshotsTest-1124623539 None] Volume 5a543d85-dde5-42ff-b2ad-33b0771e18d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a543d85-dde5-42ff-b2ad-33b0771e18d9', 'volume_size': 1}
Apr 28 22:08:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-a4c6fb13-f064-4b24-be47-6a6aec17b250 tempest-GroupSnapshotsTest-1124623539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:08:39 devstack sudo[88880]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6dac2b42-bdc2-410d-b581-5868706cbbb5 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-177e6f4b-f0e5-4249-a1f9-368e742a72fb" returned: 0 in 5.667s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:39 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1220d925-f5d3-4963-8cd2-10c864337ea6]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:08:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6dac2b42-bdc2-410d-b581-5868706cbbb5 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:39 devstack sudo[88901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6dac2b42-bdc2-410d-b581-5868706cbbb5
Apr 28 22:08:39 devstack sudo[88901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:39 devstack cinder-volume[83924]: DEBUG oslo_service.periodic_task [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83924) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 28 22:08:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:08:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:08:39 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:08:39 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:08:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:08:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:39 devstack sudo[88903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:08:39 devstack sudo[88903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:40 devstack sudo[88903]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:40 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.667s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:40 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:08:40 devstack sudo[88901]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:40 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6dac2b42-bdc2-410d-b581-5868706cbbb5" returned: 0 in 0.947s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:40 devstack cinder-volume[83924]: DEBUG cinder.image.image_utils [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] Image conversion details: src /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6dac2b42-bdc2-410d-b581-5868706cbbb5, size 1024.00 MB, duration 5.67 sec, destination /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-177e6f4b-f0e5-4249-a1f9-368e742a72fb {{(pid=83924) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 28 22:08:40 devstack cinder-volume[83924]: INFO cinder.image.image_utils [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] Converted 1024.00 MB image at 180.67 MB/s
Apr 28 22:08:40 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-177e6f4b-f0e5-4249-a1f9-368e742a72fb is being set with open permissions: ugo+rw
Apr 28 22:08:40 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-177e6f4b-f0e5-4249-a1f9-368e742a72fb {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:40 devstack sudo[88909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-177e6f4b-f0e5-4249-a1f9-368e742a72fb
Apr 28 22:08:40 devstack sudo[88909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:41 devstack sudo[88909]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:41 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-177e6f4b-f0e5-4249-a1f9-368e742a72fb" returned: 0 in 0.684s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:41 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] Lock "cinder-quobyte-177e6f4b-f0e5-4249-a1f9-368e742a72fb" released by "_copy_volume_from_snapshot" :: held 9.316s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:08:41 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] Acquiring lock "cinder-quobyte-f2378ec4-f243-438b-957b-9b3073494b1d" by "_delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:08:41 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] Lock "cinder-quobyte-f2378ec4-f243-438b-957b-9b3073494b1d" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:08:41 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] Deleting offline snapshot f2378ec4-f243-438b-957b-9b3073494b1d of volume 6dac2b42-bdc2-410d-b581-5868706cbbb5 {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 22:08:41 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] snapshot_file for this snap is: volume-6dac2b42-bdc2-410d-b581-5868706cbbb5.f2378ec4-f243-438b-957b-9b3073494b1d {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 22:08:41 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f33f8e1-fd7f-485d-8280-11ec5490339c]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:08:41 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6dac2b42-bdc2-410d-b581-5868706cbbb5.f2378ec4-f243-438b-957b-9b3073494b1d {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:41 devstack sudo[88936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6dac2b42-bdc2-410d-b581-5868706cbbb5.f2378ec4-f243-438b-957b-9b3073494b1d
Apr 28 22:08:41 devstack sudo[88936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:42 devstack sudo[88936]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:42 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6dac2b42-bdc2-410d-b581-5868706cbbb5.f2378ec4-f243-438b-957b-9b3073494b1d" returned: 0 in 0.894s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:42 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6dac2b42-bdc2-410d-b581-5868706cbbb5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 22:08:42 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6a82e3-a91a-4084-a49c-4f7c97706880]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:08:42 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6dac2b42-bdc2-410d-b581-5868706cbbb5 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:42 devstack sudo[88950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6dac2b42-bdc2-410d-b581-5868706cbbb5
Apr 28 22:08:42 devstack sudo[88950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:43 devstack sudo[88950]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:43 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6dac2b42-bdc2-410d-b581-5868706cbbb5" returned: 0 in 0.829s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:43 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6dac2b42-bdc2-410d-b581-5868706cbbb5.f2378ec4-f243-438b-957b-9b3073494b1d {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:43 devstack sudo[88957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6dac2b42-bdc2-410d-b581-5868706cbbb5.f2378ec4-f243-438b-957b-9b3073494b1d
Apr 28 22:08:43 devstack sudo[88957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:43 devstack sudo[88957]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:43 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6dac2b42-bdc2-410d-b581-5868706cbbb5.f2378ec4-f243-438b-957b-9b3073494b1d" returned: 0 in 0.755s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:43 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6dac2b42-bdc2-410d-b581-5868706cbbb5.f2378ec4-f243-438b-957b-9b3073494b1d {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:43 devstack sudo[88963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6dac2b42-bdc2-410d-b581-5868706cbbb5.f2378ec4-f243-438b-957b-9b3073494b1d
Apr 28 22:08:43 devstack sudo[88963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:44 devstack cinder-volume[83924]: INFO cinder.volume.manager [req-d37a369d-e4f9-47ae-b7d5-7bfd5094049f req-5e77c799-f8ae-45ac-8a39-cb9b4a565ed4 tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Terminate volume connection completed successfully.
Apr 28 22:08:44 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [req-d37a369d-e4f9-47ae-b7d5-7bfd5094049f req-5e77c799-f8ae-45ac-8a39-cb9b4a565ed4 tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Deleting attachment 4dabfda4-2b34-4daa-b8aa-bbcf94620ef7. {{(pid=83924) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 28 22:08:44 devstack sudo[88963]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:44 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6dac2b42-bdc2-410d-b581-5868706cbbb5.f2378ec4-f243-438b-957b-9b3073494b1d" returned: 0 in 0.624s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:44 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] Lock "cinder-quobyte-f2378ec4-f243-438b-957b-9b3073494b1d" released by "_delete_snapshot" :: held 3.220s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:08:44 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.833s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:08:44 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-cebee4cf-3210-4e9a-ba30-3a62e8b9ee3a tempest-CreateVolumesFromSnapshotTest-85329515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 16.933s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:08:44 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-cebee4cf-3210-4e9a-ba30-3a62e8b9ee3a tempest-CreateVolumesFromSnapshotTest-85329515 None] Creating offline snapshot 0bd0d8c3-6de2-445a-908e-8f8e0a4bf49d of volume bb1cbeed-da05-4254-b527-a54975ee9f9f {{(pid=83924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 22:08:44 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87caffc4-9c4c-4360-b3d8-4e2f8464d158) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-177e6f4b-f0e5-4249-a1f9-368e742a72fb', 'volume_size': 2, 'source_volid': '6dac2b42-bdc2-410d-b581-5868706cbbb5', 'source_volstatus': 'available'}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:08:44 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1563ecc-fec8-4d82-91de-852a56d57984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:08:44 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a17fbe4-9fe3-4d78-b0e1-7bbc177be6c7]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:08:44 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-cebee4cf-3210-4e9a-ba30-3a62e8b9ee3a tempest-CreateVolumesFromSnapshotTest-85329515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-bb1cbeed-da05-4254-b527-a54975ee9f9f {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:44 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] Volume volume-177e6f4b-f0e5-4249-a1f9-368e742a72fb (177e6f4b-f0e5-4249-a1f9-368e742a72fb): created successfully
Apr 28 22:08:44 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1563ecc-fec8-4d82-91de-852a56d57984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:08:44 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] Flow 'volume_create_manager' (80317daf-9561-411e-96dc-3c13f1ee1423) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:08:44 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-76922d94-6f44-4679-8de7-7074ff3c9f46 tempest-VolumesCloneTest-1046112886 None] Created volume successfully.
Apr 28 22:08:44 devstack sudo[88966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-bb1cbeed-da05-4254-b527-a54975ee9f9f
Apr 28 22:08:44 devstack sudo[88966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:44 devstack cinder-volume[83924]: DEBUG cinder.coordination [req-d37a369d-e4f9-47ae-b7d5-7bfd5094049f req-68ce428b-89ae-4a0c-9eca-efbd18d0a5de tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Acquiring lock "cinder-0a122e8c-02e6-47d9-9335-2d8152235f47-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:08:44 devstack cinder-volume[83924]: DEBUG cinder.coordination [req-d37a369d-e4f9-47ae-b7d5-7bfd5094049f req-68ce428b-89ae-4a0c-9eca-efbd18d0a5de tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Lock "cinder-0a122e8c-02e6-47d9-9335-2d8152235f47-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:08:44 devstack cinder-volume[83924]: DEBUG cinder.coordination [req-d37a369d-e4f9-47ae-b7d5-7bfd5094049f req-68ce428b-89ae-4a0c-9eca-efbd18d0a5de tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Acquiring lock "cinder-quobyte-0a122e8c-02e6-47d9-9335-2d8152235f47" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:08:44 devstack cinder-volume[83924]: DEBUG cinder.coordination [req-d37a369d-e4f9-47ae-b7d5-7bfd5094049f req-68ce428b-89ae-4a0c-9eca-efbd18d0a5de tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Lock "cinder-quobyte-0a122e8c-02e6-47d9-9335-2d8152235f47" acquired by "delete_volume" :: waited 0.024s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:08:44 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b244b0-8634-4d17-8226-498f2c149f72]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:08:44 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-d37a369d-e4f9-47ae-b7d5-7bfd5094049f req-68ce428b-89ae-4a0c-9eca-efbd18d0a5de tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-0a122e8c-02e6-47d9-9335-2d8152235f47 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:44 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-f1dc9e8e-9f37-4d24-8f98-df62b6c127bb tempest-VolumesCloneTest-1046112886 None] Acquiring lock "cinder-177e6f4b-f0e5-4249-a1f9-368e742a72fb-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:08:44 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-f1dc9e8e-9f37-4d24-8f98-df62b6c127bb tempest-VolumesCloneTest-1046112886 None] Lock "cinder-177e6f4b-f0e5-4249-a1f9-368e742a72fb-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:08:44 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-f1dc9e8e-9f37-4d24-8f98-df62b6c127bb tempest-VolumesCloneTest-1046112886 None] Acquiring lock "cinder-quobyte-177e6f4b-f0e5-4249-a1f9-368e742a72fb" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:08:44 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-f1dc9e8e-9f37-4d24-8f98-df62b6c127bb tempest-VolumesCloneTest-1046112886 None] Lock "cinder-quobyte-177e6f4b-f0e5-4249-a1f9-368e742a72fb" acquired by "delete_volume" :: waited 0.016s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:08:45 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29d4799-e790-48e6-bb2f-904545ef273c]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:08:45 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f1dc9e8e-9f37-4d24-8f98-df62b6c127bb tempest-VolumesCloneTest-1046112886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-177e6f4b-f0e5-4249-a1f9-368e742a72fb {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:45 devstack sudo[88968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-0a122e8c-02e6-47d9-9335-2d8152235f47
Apr 28 22:08:45 devstack sudo[88968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:45 devstack sudo[88970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-177e6f4b-f0e5-4249-a1f9-368e742a72fb
Apr 28 22:08:45 devstack sudo[88970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:45 devstack sudo[88966]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:45 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-cebee4cf-3210-4e9a-ba30-3a62e8b9ee3a tempest-CreateVolumesFromSnapshotTest-85329515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-bb1cbeed-da05-4254-b527-a54975ee9f9f" returned: 0 in 0.927s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:45 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-cebee4cf-3210-4e9a-ba30-3a62e8b9ee3a tempest-CreateVolumesFromSnapshotTest-85329515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-bb1cbeed-da05-4254-b527-a54975ee9f9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-bb1cbeed-da05-4254-b527-a54975ee9f9f.0bd0d8c3-6de2-445a-908e-8f8e0a4bf49d 1G {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:45 devstack sudo[88975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-bb1cbeed-da05-4254-b527-a54975ee9f9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-bb1cbeed-da05-4254-b527-a54975ee9f9f.0bd0d8c3-6de2-445a-908e-8f8e0a4bf49d 1G
Apr 28 22:08:45 devstack sudo[88975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:45 devstack sudo[88968]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:45 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-d37a369d-e4f9-47ae-b7d5-7bfd5094049f req-68ce428b-89ae-4a0c-9eca-efbd18d0a5de tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-0a122e8c-02e6-47d9-9335-2d8152235f47" returned: 0 in 0.846s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:45 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-d37a369d-e4f9-47ae-b7d5-7bfd5094049f req-68ce428b-89ae-4a0c-9eca-efbd18d0a5de tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-0a122e8c-02e6-47d9-9335-2d8152235f47 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:45 devstack sudo[88983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-0a122e8c-02e6-47d9-9335-2d8152235f47
Apr 28 22:08:45 devstack sudo[88983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:45 devstack sudo[88970]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:45 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f1dc9e8e-9f37-4d24-8f98-df62b6c127bb tempest-VolumesCloneTest-1046112886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-177e6f4b-f0e5-4249-a1f9-368e742a72fb" returned: 0 in 0.770s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:45 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f1dc9e8e-9f37-4d24-8f98-df62b6c127bb tempest-VolumesCloneTest-1046112886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-177e6f4b-f0e5-4249-a1f9-368e742a72fb {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:45 devstack sudo[88985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-177e6f4b-f0e5-4249-a1f9-368e742a72fb
Apr 28 22:08:45 devstack sudo[88985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:46 devstack sudo[88975]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-cebee4cf-3210-4e9a-ba30-3a62e8b9ee3a tempest-CreateVolumesFromSnapshotTest-85329515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-bb1cbeed-da05-4254-b527-a54975ee9f9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-bb1cbeed-da05-4254-b527-a54975ee9f9f.0bd0d8c3-6de2-445a-908e-8f8e0a4bf49d 1G" returned: 0 in 0.859s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-cebee4cf-3210-4e9a-ba30-3a62e8b9ee3a tempest-CreateVolumesFromSnapshotTest-85329515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb1cbeed-da05-4254-b527-a54975ee9f9f -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-bb1cbeed-da05-4254-b527-a54975ee9f9f.0bd0d8c3-6de2-445a-908e-8f8e0a4bf49d {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:46 devstack sudo[88991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb1cbeed-da05-4254-b527-a54975ee9f9f -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-bb1cbeed-da05-4254-b527-a54975ee9f9f.0bd0d8c3-6de2-445a-908e-8f8e0a4bf49d
Apr 28 22:08:46 devstack sudo[88991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:46 devstack sudo[88983]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-d37a369d-e4f9-47ae-b7d5-7bfd5094049f req-68ce428b-89ae-4a0c-9eca-efbd18d0a5de tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-0a122e8c-02e6-47d9-9335-2d8152235f47" returned: 0 in 0.655s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:46 devstack cinder-volume[83924]: DEBUG cinder.coordination [req-d37a369d-e4f9-47ae-b7d5-7bfd5094049f req-68ce428b-89ae-4a0c-9eca-efbd18d0a5de tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Lock "cinder-quobyte-0a122e8c-02e6-47d9-9335-2d8152235f47" released by "delete_volume" :: held 1.555s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:08:46 devstack cinder-volume[83924]: DEBUG cinder.quota [req-d37a369d-e4f9-47ae-b7d5-7bfd5094049f req-68ce428b-89ae-4a0c-9eca-efbd18d0a5de tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Created reservations ['735aa539-2216-48c6-ac93-51a8822946c5', 'c0f65137-34da-4ec6-b45e-5ae063f9e054', 'b63b679a-eaa9-40dd-80ad-4078f73575c0', '0334b974-539b-4652-a6d0-c33fb9e717c3'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:08:46 devstack sudo[88985]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f1dc9e8e-9f37-4d24-8f98-df62b6c127bb tempest-VolumesCloneTest-1046112886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-177e6f4b-f0e5-4249-a1f9-368e742a72fb" returned: 0 in 0.706s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:46 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-f1dc9e8e-9f37-4d24-8f98-df62b6c127bb tempest-VolumesCloneTest-1046112886 None] Lock "cinder-quobyte-177e6f4b-f0e5-4249-a1f9-368e742a72fb" released by "delete_volume" :: held 1.530s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:08:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [req-d37a369d-e4f9-47ae-b7d5-7bfd5094049f req-68ce428b-89ae-4a0c-9eca-efbd18d0a5de tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:08:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [req-d37a369d-e4f9-47ae-b7d5-7bfd5094049f req-68ce428b-89ae-4a0c-9eca-efbd18d0a5de tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:08:46 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [req-d37a369d-e4f9-47ae-b7d5-7bfd5094049f req-68ce428b-89ae-4a0c-9eca-efbd18d0a5de tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:08:46 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [req-d37a369d-e4f9-47ae-b7d5-7bfd5094049f req-68ce428b-89ae-4a0c-9eca-efbd18d0a5de tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:08:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [req-d37a369d-e4f9-47ae-b7d5-7bfd5094049f req-68ce428b-89ae-4a0c-9eca-efbd18d0a5de tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:08:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-d37a369d-e4f9-47ae-b7d5-7bfd5094049f req-68ce428b-89ae-4a0c-9eca-efbd18d0a5de tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:46 devstack sudo[88994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:08:46 devstack sudo[88994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:46 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-f1dc9e8e-9f37-4d24-8f98-df62b6c127bb tempest-VolumesCloneTest-1046112886 None] Created reservations ['c5557104-71bd-4aa2-8e4e-9477fb02b297', 'ddec91fa-c2b5-42e8-a3c8-36d628342fa1', '4579df68-aaef-457d-ae93-584415a8ce32', 'a71c7c37-360d-4c51-9851-e0f385711193'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:08:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f1dc9e8e-9f37-4d24-8f98-df62b6c127bb tempest-VolumesCloneTest-1046112886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:08:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f1dc9e8e-9f37-4d24-8f98-df62b6c127bb tempest-VolumesCloneTest-1046112886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:08:46 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-f1dc9e8e-9f37-4d24-8f98-df62b6c127bb tempest-VolumesCloneTest-1046112886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:08:46 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-f1dc9e8e-9f37-4d24-8f98-df62b6c127bb tempest-VolumesCloneTest-1046112886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:08:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f1dc9e8e-9f37-4d24-8f98-df62b6c127bb tempest-VolumesCloneTest-1046112886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:08:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f1dc9e8e-9f37-4d24-8f98-df62b6c127bb tempest-VolumesCloneTest-1046112886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:46 devstack sudo[88996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:08:46 devstack sudo[88996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:47 devstack sudo[88991]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:47 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-cebee4cf-3210-4e9a-ba30-3a62e8b9ee3a tempest-CreateVolumesFromSnapshotTest-85329515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb1cbeed-da05-4254-b527-a54975ee9f9f -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-bb1cbeed-da05-4254-b527-a54975ee9f9f.0bd0d8c3-6de2-445a-908e-8f8e0a4bf49d" returned: 0 in 0.835s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:47 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-cebee4cf-3210-4e9a-ba30-3a62e8b9ee3a tempest-CreateVolumesFromSnapshotTest-85329515 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-bb1cbeed-da05-4254-b527-a54975ee9f9f.0bd0d8c3-6de2-445a-908e-8f8e0a4bf49d is being set with open permissions: ugo+rw
Apr 28 22:08:47 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-cebee4cf-3210-4e9a-ba30-3a62e8b9ee3a tempest-CreateVolumesFromSnapshotTest-85329515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-bb1cbeed-da05-4254-b527-a54975ee9f9f.0bd0d8c3-6de2-445a-908e-8f8e0a4bf49d {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:47 devstack sudo[89002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-bb1cbeed-da05-4254-b527-a54975ee9f9f.0bd0d8c3-6de2-445a-908e-8f8e0a4bf49d
Apr 28 22:08:47 devstack sudo[89002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:47 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-684e7384-eec7-4c91-9a6b-d4c9f382ade3 tempest-VolumesCloneTest-1046112886 None] Acquiring lock "cinder-6dac2b42-bdc2-410d-b581-5868706cbbb5-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:08:47 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-684e7384-eec7-4c91-9a6b-d4c9f382ade3 tempest-VolumesCloneTest-1046112886 None] Lock "cinder-6dac2b42-bdc2-410d-b581-5868706cbbb5-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:08:47 devstack sudo[88994]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:47 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-d37a369d-e4f9-47ae-b7d5-7bfd5094049f req-68ce428b-89ae-4a0c-9eca-efbd18d0a5de tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.703s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:47 devstack cinder-volume[83924]: DEBUG cinder.manager [req-d37a369d-e4f9-47ae-b7d5-7bfd5094049f req-68ce428b-89ae-4a0c-9eca-efbd18d0a5de tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:08:47 devstack cinder-volume[83924]: INFO cinder.volume.manager [req-d37a369d-e4f9-47ae-b7d5-7bfd5094049f req-68ce428b-89ae-4a0c-9eca-efbd18d0a5de tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Deleted volume successfully.
Apr 28 22:08:47 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-684e7384-eec7-4c91-9a6b-d4c9f382ade3 tempest-VolumesCloneTest-1046112886 None] Acquiring lock "cinder-quobyte-6dac2b42-bdc2-410d-b581-5868706cbbb5" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:08:47 devstack cinder-volume[83924]: DEBUG cinder.coordination [req-d37a369d-e4f9-47ae-b7d5-7bfd5094049f req-68ce428b-89ae-4a0c-9eca-efbd18d0a5de tempest-ServerBootFromVolumeStableRescueTest-1310033218 None] Lock "cinder-0a122e8c-02e6-47d9-9335-2d8152235f47-delete_volume" released by "delete_volume" :: held 2.599s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:08:47 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-684e7384-eec7-4c91-9a6b-d4c9f382ade3 tempest-VolumesCloneTest-1046112886 None] Lock "cinder-quobyte-6dac2b42-bdc2-410d-b581-5868706cbbb5" acquired by "delete_volume" :: waited 0.019s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:08:47 devstack sudo[88996]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:47 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f1dc9e8e-9f37-4d24-8f98-df62b6c127bb tempest-VolumesCloneTest-1046112886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.654s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:47 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-f1dc9e8e-9f37-4d24-8f98-df62b6c127bb tempest-VolumesCloneTest-1046112886 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:08:47 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-f1dc9e8e-9f37-4d24-8f98-df62b6c127bb tempest-VolumesCloneTest-1046112886 None] Deleted volume successfully.
Apr 28 22:08:47 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6cc3532-3043-4d56-966b-3a0780e60117]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:08:47 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-684e7384-eec7-4c91-9a6b-d4c9f382ade3 tempest-VolumesCloneTest-1046112886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6dac2b42-bdc2-410d-b581-5868706cbbb5 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:47 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-f1dc9e8e-9f37-4d24-8f98-df62b6c127bb tempest-VolumesCloneTest-1046112886 None] Lock "cinder-177e6f4b-f0e5-4249-a1f9-368e742a72fb-delete_volume" released by "delete_volume" :: held 2.514s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:08:47 devstack sudo[89006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6dac2b42-bdc2-410d-b581-5868706cbbb5
Apr 28 22:08:47 devstack sudo[89006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:47 devstack sudo[89002]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:47 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-cebee4cf-3210-4e9a-ba30-3a62e8b9ee3a tempest-CreateVolumesFromSnapshotTest-85329515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-bb1cbeed-da05-4254-b527-a54975ee9f9f.0bd0d8c3-6de2-445a-908e-8f8e0a4bf49d" returned: 0 in 0.687s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:47 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-cebee4cf-3210-4e9a-ba30-3a62e8b9ee3a tempest-CreateVolumesFromSnapshotTest-85329515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-bb1cbeed-da05-4254-b527-a54975ee9f9f.info {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:47 devstack sudo[89009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-bb1cbeed-da05-4254-b527-a54975ee9f9f.info
Apr 28 22:08:47 devstack sudo[89009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:48 devstack sudo[89006]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:48 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-684e7384-eec7-4c91-9a6b-d4c9f382ade3 tempest-VolumesCloneTest-1046112886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6dac2b42-bdc2-410d-b581-5868706cbbb5" returned: 0 in 0.823s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:48 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-684e7384-eec7-4c91-9a6b-d4c9f382ade3 tempest-VolumesCloneTest-1046112886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6dac2b42-bdc2-410d-b581-5868706cbbb5 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:48 devstack sudo[89014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6dac2b42-bdc2-410d-b581-5868706cbbb5
Apr 28 22:08:48 devstack sudo[89014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:48 devstack sudo[89009]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:48 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-cebee4cf-3210-4e9a-ba30-3a62e8b9ee3a tempest-CreateVolumesFromSnapshotTest-85329515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-bb1cbeed-da05-4254-b527-a54975ee9f9f.info" returned: 0 in 0.681s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:48 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-cebee4cf-3210-4e9a-ba30-3a62e8b9ee3a tempest-CreateVolumesFromSnapshotTest-85329515 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-bb1cbeed-da05-4254-b527-a54975ee9f9f.info is being set with open permissions: ugo+rw
Apr 28 22:08:48 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-cebee4cf-3210-4e9a-ba30-3a62e8b9ee3a tempest-CreateVolumesFromSnapshotTest-85329515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-bb1cbeed-da05-4254-b527-a54975ee9f9f.info {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:48 devstack sudo[89017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-bb1cbeed-da05-4254-b527-a54975ee9f9f.info
Apr 28 22:08:48 devstack sudo[89017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:48 devstack sudo[89014]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:48 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-684e7384-eec7-4c91-9a6b-d4c9f382ade3 tempest-VolumesCloneTest-1046112886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6dac2b42-bdc2-410d-b581-5868706cbbb5" returned: 0 in 0.633s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:48 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-684e7384-eec7-4c91-9a6b-d4c9f382ade3 tempest-VolumesCloneTest-1046112886 None] Lock "cinder-quobyte-6dac2b42-bdc2-410d-b581-5868706cbbb5" released by "delete_volume" :: held 1.541s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:08:48 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-684e7384-eec7-4c91-9a6b-d4c9f382ade3 tempest-VolumesCloneTest-1046112886 None] Created reservations ['f6ed67a0-9b3d-491c-ad42-576d686e40c7', '905715c8-fc8e-4a9d-8bf3-bdda4d12fa0f', '95774665-5502-440a-874b-81280a6dcf2f', 'ea03be81-4fcc-4a0b-aa54-8f7f44693fd6'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:08:49 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-684e7384-eec7-4c91-9a6b-d4c9f382ade3 tempest-VolumesCloneTest-1046112886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:08:49 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-684e7384-eec7-4c91-9a6b-d4c9f382ade3 tempest-VolumesCloneTest-1046112886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:08:49 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-684e7384-eec7-4c91-9a6b-d4c9f382ade3 tempest-VolumesCloneTest-1046112886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:08:49 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-684e7384-eec7-4c91-9a6b-d4c9f382ade3 tempest-VolumesCloneTest-1046112886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:08:49 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-684e7384-eec7-4c91-9a6b-d4c9f382ade3 tempest-VolumesCloneTest-1046112886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:08:49 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-684e7384-eec7-4c91-9a6b-d4c9f382ade3 tempest-VolumesCloneTest-1046112886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:49 devstack sudo[89020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:08:49 devstack sudo[89020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:49 devstack sudo[89017]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:49 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-cebee4cf-3210-4e9a-ba30-3a62e8b9ee3a tempest-CreateVolumesFromSnapshotTest-85329515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-bb1cbeed-da05-4254-b527-a54975ee9f9f.info" returned: 0 in 0.646s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:49 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-cebee4cf-3210-4e9a-ba30-3a62e8b9ee3a tempest-CreateVolumesFromSnapshotTest-85329515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.743s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:08:49 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-a4c6fb13-f064-4b24-be47-6a6aec17b250 tempest-GroupSnapshotsTest-1124623539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.057s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:08:49 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-a4c6fb13-f064-4b24-be47-6a6aec17b250 tempest-GroupSnapshotsTest-1124623539 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=616968f3-5299-462d-8b78-9622730cfa5f,created_at=2026-04-28T20:08:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2144716351',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=616968f3-5299-462d-8b78-9622730cfa5f,host='devstack@QuobyteHD#QuobyteHD',id=5a543d85-dde5-42ff-b2ad-33b0771e18d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29d2f5d38aff44ebb5481ff2a7413f6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:08:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:08:39Z,use_quota=True,user_id='6cc1cf2f2521481c81eae86959034746',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(88151e99-6fb7-4704-9991-9c633e8c2087),volume_type_id=88151e99-6fb7-4704-9991-9c633e8c2087)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:08:49 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-a4c6fb13-f064-4b24-be47-6a6aec17b250 tempest-GroupSnapshotsTest-1124623539 None] Creating volume 5a543d85-dde5-42ff-b2ad-33b0771e18d9 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:08:49 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-a4c6fb13-f064-4b24-be47-6a6aec17b250 tempest-GroupSnapshotsTest-1124623539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:08:49 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-a4c6fb13-f064-4b24-be47-6a6aec17b250 tempest-GroupSnapshotsTest-1124623539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:08:49 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-a4c6fb13-f064-4b24-be47-6a6aec17b250 tempest-GroupSnapshotsTest-1124623539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:08:49 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-a4c6fb13-f064-4b24-be47-6a6aec17b250 tempest-GroupSnapshotsTest-1124623539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:08:49 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-a4c6fb13-f064-4b24-be47-6a6aec17b250 tempest-GroupSnapshotsTest-1124623539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:08:49 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-a4c6fb13-f064-4b24-be47-6a6aec17b250 tempest-GroupSnapshotsTest-1124623539 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:08:49 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-a4c6fb13-f064-4b24-be47-6a6aec17b250 tempest-GroupSnapshotsTest-1124623539 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:08:49 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a4c6fb13-f064-4b24-be47-6a6aec17b250 tempest-GroupSnapshotsTest-1124623539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-5a543d85-dde5-42ff-b2ad-33b0771e18d9 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:49 devstack sudo[89023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-5a543d85-dde5-42ff-b2ad-33b0771e18d9 1073741824
Apr 28 22:08:49 devstack sudo[89023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:49 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-cebee4cf-3210-4e9a-ba30-3a62e8b9ee3a tempest-CreateVolumesFromSnapshotTest-85329515 None] Create snapshot completed successfully
Apr 28 22:08:50 devstack sudo[89020]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:50 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-684e7384-eec7-4c91-9a6b-d4c9f382ade3 tempest-VolumesCloneTest-1046112886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 1.050s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:50 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-684e7384-eec7-4c91-9a6b-d4c9f382ade3 tempest-VolumesCloneTest-1046112886 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:08:50 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-684e7384-eec7-4c91-9a6b-d4c9f382ade3 tempest-VolumesCloneTest-1046112886 None] Deleted volume successfully.
Apr 28 22:08:50 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-684e7384-eec7-4c91-9a6b-d4c9f382ade3 tempest-VolumesCloneTest-1046112886 None] Lock "cinder-6dac2b42-bdc2-410d-b581-5868706cbbb5-delete_volume" released by "delete_volume" :: held 2.859s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:08:50 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f249369-156c-4655-a10c-743685399065 tempest-CreateVolumesFromSnapshotTest-85329515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:08:50 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-4f249369-156c-4655-a10c-743685399065 tempest-CreateVolumesFromSnapshotTest-85329515 None] Flow 'volume_create_manager' (f5957a52-1f5d-46b6-8004-b58ed8b377d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:08:50 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-4f249369-156c-4655-a10c-743685399065 tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f606243-b44a-4fbf-bc31-443b4439dfbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:08:50 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-4f249369-156c-4655-a10c-743685399065 tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f606243-b44a-4fbf-bc31-443b4439dfbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:08:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1064005802',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb4b9bf3-299a-4b10-9dce-d56254d7d406,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54fd118d8f134cc2bb3fab9132d5cf5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:08:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:08:50Z,use_quota=True,user_id='dbba665dba77489ba5b3b191f577183e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:08:50 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-4f249369-156c-4655-a10c-743685399065 tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adf7168a-d302-40d2-89bb-1208f9755694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:08:50 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-4f249369-156c-4655-a10c-743685399065 tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adf7168a-d302-40d2-89bb-1208f9755694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:08:50 devstack sudo[89023]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:50 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-4f249369-156c-4655-a10c-743685399065 tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f40f6c3-3c36-478d-b66b-e12c9c40d356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:08:50 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-4f249369-156c-4655-a10c-743685399065 tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f40f6c3-3c36-478d-b66b-e12c9c40d356) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb4b9bf3-299a-4b10-9dce-d56254d7d406', 'volume_name': 'volume-eb4b9bf3-299a-4b10-9dce-d56254d7d406', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:08:50 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-4f249369-156c-4655-a10c-743685399065 tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (775d2e73-513c-449a-bba6-779a16f6491d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:08:50 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-4f249369-156c-4655-a10c-743685399065 tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (775d2e73-513c-449a-bba6-779a16f6491d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:08:50 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-4f249369-156c-4655-a10c-743685399065 tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f407f2ad-f3cb-4dac-9547-bac48ade9fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:08:50 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-4f249369-156c-4655-a10c-743685399065 tempest-CreateVolumesFromSnapshotTest-85329515 None] Volume eb4b9bf3-299a-4b10-9dce-d56254d7d406: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb4b9bf3-299a-4b10-9dce-d56254d7d406', 'volume_size': 1}
Apr 28 22:08:50 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-4f249369-156c-4655-a10c-743685399065 tempest-CreateVolumesFromSnapshotTest-85329515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:08:50 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a4c6fb13-f064-4b24-be47-6a6aec17b250 tempest-GroupSnapshotsTest-1124623539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-5a543d85-dde5-42ff-b2ad-33b0771e18d9 1073741824" returned: 0 in 1.378s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:50 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a4c6fb13-f064-4b24-be47-6a6aec17b250 tempest-GroupSnapshotsTest-1124623539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-5a543d85-dde5-42ff-b2ad-33b0771e18d9 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:50 devstack sudo[89070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-5a543d85-dde5-42ff-b2ad-33b0771e18d9
Apr 28 22:08:50 devstack sudo[89070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:51 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cad5666-2283-403a-bd84-3e04fddbe3d6 tempest-CreateVolumesFromSnapshotTest-85329515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:08:51 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-4cad5666-2283-403a-bd84-3e04fddbe3d6 tempest-CreateVolumesFromSnapshotTest-85329515 None] Flow 'volume_create_manager' (3f72843b-2a1f-4492-9644-a01159dda029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:08:51 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-4cad5666-2283-403a-bd84-3e04fddbe3d6 tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff0c753e-7821-4676-96a3-fba2dd00ce64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:08:51 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-4cad5666-2283-403a-bd84-3e04fddbe3d6 tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff0c753e-7821-4676-96a3-fba2dd00ce64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-854213799',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca01f749-1625-436b-ac91-bfcc1efdde89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54fd118d8f134cc2bb3fab9132d5cf5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:08:51Z,use_quota=True,user_id='dbba665dba77489ba5b3b191f577183e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:08:51 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-4cad5666-2283-403a-bd84-3e04fddbe3d6 tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ddd9ccf-f633-4150-8d4f-a63470600f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:08:51 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-4cad5666-2283-403a-bd84-3e04fddbe3d6 tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ddd9ccf-f633-4150-8d4f-a63470600f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:08:51 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-4cad5666-2283-403a-bd84-3e04fddbe3d6 tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed17e885-7ebb-4ff2-b683-9208f2b5f47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:08:51 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-4cad5666-2283-403a-bd84-3e04fddbe3d6 tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed17e885-7ebb-4ff2-b683-9208f2b5f47a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca01f749-1625-436b-ac91-bfcc1efdde89', 'volume_name': 'volume-ca01f749-1625-436b-ac91-bfcc1efdde89', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:08:51 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-4cad5666-2283-403a-bd84-3e04fddbe3d6 tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5402fc1-cacb-4583-90e6-6446b5e84e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:08:51 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-4cad5666-2283-403a-bd84-3e04fddbe3d6 tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5402fc1-cacb-4583-90e6-6446b5e84e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:08:51 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-4cad5666-2283-403a-bd84-3e04fddbe3d6 tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb70af57-fa0b-4f99-a2a7-0a9333670d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:08:51 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-4cad5666-2283-403a-bd84-3e04fddbe3d6 tempest-CreateVolumesFromSnapshotTest-85329515 None] Volume ca01f749-1625-436b-ac91-bfcc1efdde89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca01f749-1625-436b-ac91-bfcc1efdde89', 'volume_size': 1}
Apr 28 22:08:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-4cad5666-2283-403a-bd84-3e04fddbe3d6 tempest-CreateVolumesFromSnapshotTest-85329515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:08:51 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-88801485-95a4-406a-8995-83922426ab50 tempest-CreateVolumesFromSnapshotTest-85329515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:08:51 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-88801485-95a4-406a-8995-83922426ab50 tempest-CreateVolumesFromSnapshotTest-85329515 None] Flow 'volume_create_manager' (2e30e0fe-a45e-4808-8835-b5d233051c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:08:51 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-88801485-95a4-406a-8995-83922426ab50 tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67d37880-eb24-4a59-889d-8d85ac7a1905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:08:51 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-88801485-95a4-406a-8995-83922426ab50 tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67d37880-eb24-4a59-889d-8d85ac7a1905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-802974826',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22042486-089a-4e58-8d17-91d0e4991998,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54fd118d8f134cc2bb3fab9132d5cf5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:08:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:08:52Z,use_quota=True,user_id='dbba665dba77489ba5b3b191f577183e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:08:51 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-88801485-95a4-406a-8995-83922426ab50 tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a895c0a-79d6-49c8-b15f-caabaeb76c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:08:51 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-88801485-95a4-406a-8995-83922426ab50 tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a895c0a-79d6-49c8-b15f-caabaeb76c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:08:51 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-88801485-95a4-406a-8995-83922426ab50 tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a2094c7-753c-4459-aaff-37cffc8bfdfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:08:51 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-88801485-95a4-406a-8995-83922426ab50 tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a2094c7-753c-4459-aaff-37cffc8bfdfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22042486-089a-4e58-8d17-91d0e4991998', 'volume_name': 'volume-22042486-089a-4e58-8d17-91d0e4991998', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:08:51 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-88801485-95a4-406a-8995-83922426ab50 tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b4edfa3-b6ec-4e21-b95a-19833284046f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:08:51 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-88801485-95a4-406a-8995-83922426ab50 tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b4edfa3-b6ec-4e21-b95a-19833284046f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:08:51 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-88801485-95a4-406a-8995-83922426ab50 tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a22a75c-d039-4ac5-9fb2-8b80f9a93c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:08:51 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-88801485-95a4-406a-8995-83922426ab50 tempest-CreateVolumesFromSnapshotTest-85329515 None] Volume 22042486-089a-4e58-8d17-91d0e4991998: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22042486-089a-4e58-8d17-91d0e4991998', 'volume_size': 1}
Apr 28 22:08:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-88801485-95a4-406a-8995-83922426ab50 tempest-CreateVolumesFromSnapshotTest-85329515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:08:51 devstack sudo[89070]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a4c6fb13-f064-4b24-be47-6a6aec17b250 tempest-GroupSnapshotsTest-1124623539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-5a543d85-dde5-42ff-b2ad-33b0771e18d9" returned: 0 in 0.956s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:51 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-a4c6fb13-f064-4b24-be47-6a6aec17b250 tempest-GroupSnapshotsTest-1124623539 None] <== create_volume: return (2566ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:08:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-a4c6fb13-f064-4b24-be47-6a6aec17b250 tempest-GroupSnapshotsTest-1124623539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.570s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:08:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-4f249369-156c-4655-a10c-743685399065 tempest-CreateVolumesFromSnapshotTest-85329515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.186s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:08:51 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-4f249369-156c-4655-a10c-743685399065 tempest-CreateVolumesFromSnapshotTest-85329515 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:08:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1064005802',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb4b9bf3-299a-4b10-9dce-d56254d7d406,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54fd118d8f134cc2bb3fab9132d5cf5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:08:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:08:50Z,use_quota=True,user_id='dbba665dba77489ba5b3b191f577183e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:08:51 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-4f249369-156c-4655-a10c-743685399065 tempest-CreateVolumesFromSnapshotTest-85329515 None] Creating volume eb4b9bf3-299a-4b10-9dce-d56254d7d406 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:08:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-4f249369-156c-4655-a10c-743685399065 tempest-CreateVolumesFromSnapshotTest-85329515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:08:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-4f249369-156c-4655-a10c-743685399065 tempest-CreateVolumesFromSnapshotTest-85329515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:08:51 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-4f249369-156c-4655-a10c-743685399065 tempest-CreateVolumesFromSnapshotTest-85329515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:08:51 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-4f249369-156c-4655-a10c-743685399065 tempest-CreateVolumesFromSnapshotTest-85329515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:08:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-4f249369-156c-4655-a10c-743685399065 tempest-CreateVolumesFromSnapshotTest-85329515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:08:51 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-4f249369-156c-4655-a10c-743685399065 tempest-CreateVolumesFromSnapshotTest-85329515 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:08:51 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-4f249369-156c-4655-a10c-743685399065 tempest-CreateVolumesFromSnapshotTest-85329515 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:08:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4f249369-156c-4655-a10c-743685399065 tempest-CreateVolumesFromSnapshotTest-85329515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-eb4b9bf3-299a-4b10-9dce-d56254d7d406 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:51 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a4c6fb13-f064-4b24-be47-6a6aec17b250 tempest-GroupSnapshotsTest-1124623539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab1fb1f8-3687-4ba5-b1e6-10c90a223e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a543d85-dde5-42ff-b2ad-33b0771e18d9', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:08:51 devstack sudo[89074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-eb4b9bf3-299a-4b10-9dce-d56254d7d406 1073741824
Apr 28 22:08:51 devstack sudo[89074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:51 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a4c6fb13-f064-4b24-be47-6a6aec17b250 tempest-GroupSnapshotsTest-1124623539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b54f5245-30db-4c38-bd68-184ba14b511e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:08:51 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-a4c6fb13-f064-4b24-be47-6a6aec17b250 tempest-GroupSnapshotsTest-1124623539 None] Volume volume-5a543d85-dde5-42ff-b2ad-33b0771e18d9 (5a543d85-dde5-42ff-b2ad-33b0771e18d9): created successfully
Apr 28 22:08:51 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a4c6fb13-f064-4b24-be47-6a6aec17b250 tempest-GroupSnapshotsTest-1124623539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b54f5245-30db-4c38-bd68-184ba14b511e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:08:51 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a4c6fb13-f064-4b24-be47-6a6aec17b250 tempest-GroupSnapshotsTest-1124623539 None] Flow 'volume_create_manager' (e29e5cf3-ebdd-495b-a2e7-affbb46700a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:08:51 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-a4c6fb13-f064-4b24-be47-6a6aec17b250 tempest-GroupSnapshotsTest-1124623539 None] Created volume successfully.
Apr 28 22:08:52 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa849ef0-241c-4724-86a4-b66c0ddc8bda tempest-CreateVolumesFromSnapshotTest-85329515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:08:52 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-fa849ef0-241c-4724-86a4-b66c0ddc8bda tempest-CreateVolumesFromSnapshotTest-85329515 None] Flow 'volume_create_manager' (4b8ba694-5ec5-464f-a8b4-b9846c33cbd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:08:52 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-fa849ef0-241c-4724-86a4-b66c0ddc8bda tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0df371c-e7fa-4fe2-a814-5f49f3097779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:08:52 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-fa849ef0-241c-4724-86a4-b66c0ddc8bda tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0df371c-e7fa-4fe2-a814-5f49f3097779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:08:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1919209212',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3db0ed2e-f79e-485f-8f27-6b95993b5041,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54fd118d8f134cc2bb3fab9132d5cf5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:08:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:08:52Z,use_quota=True,user_id='dbba665dba77489ba5b3b191f577183e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:08:52 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-fa849ef0-241c-4724-86a4-b66c0ddc8bda tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffeb54a8-17e0-44d1-b7cb-99d0eaeb2f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:08:52 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-fa849ef0-241c-4724-86a4-b66c0ddc8bda tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffeb54a8-17e0-44d1-b7cb-99d0eaeb2f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:08:52 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-fa849ef0-241c-4724-86a4-b66c0ddc8bda tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59a3e176-a6f9-464b-a88c-b6d268f90424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:08:52 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-fa849ef0-241c-4724-86a4-b66c0ddc8bda tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59a3e176-a6f9-464b-a88c-b6d268f90424) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3db0ed2e-f79e-485f-8f27-6b95993b5041', 'volume_name': 'volume-3db0ed2e-f79e-485f-8f27-6b95993b5041', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:08:52 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-fa849ef0-241c-4724-86a4-b66c0ddc8bda tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faf093f5-3f72-48e9-adae-7294e314a9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:08:52 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-fa849ef0-241c-4724-86a4-b66c0ddc8bda tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faf093f5-3f72-48e9-adae-7294e314a9e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:08:52 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-fa849ef0-241c-4724-86a4-b66c0ddc8bda tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0635fa5d-f714-4f55-a8de-eeeb834cdb05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:08:52 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-fa849ef0-241c-4724-86a4-b66c0ddc8bda tempest-CreateVolumesFromSnapshotTest-85329515 None] Volume 3db0ed2e-f79e-485f-8f27-6b95993b5041: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3db0ed2e-f79e-485f-8f27-6b95993b5041', 'volume_size': 1}
Apr 28 22:08:52 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-fa849ef0-241c-4724-86a4-b66c0ddc8bda tempest-CreateVolumesFromSnapshotTest-85329515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:08:52 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1a59e2c-3fd9-42f9-8f22-b87f7c436975 tempest-CreateVolumesFromSnapshotTest-85329515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:08:52 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-d1a59e2c-3fd9-42f9-8f22-b87f7c436975 tempest-CreateVolumesFromSnapshotTest-85329515 None] Flow 'volume_create_manager' (dd899464-5328-4e26-a19a-598a47ebe334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:08:52 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-d1a59e2c-3fd9-42f9-8f22-b87f7c436975 tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56afcade-803d-4692-a146-fbd6b5c82974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:08:52 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-d1a59e2c-3fd9-42f9-8f22-b87f7c436975 tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56afcade-803d-4692-a146-fbd6b5c82974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:08:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1656299418',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bf93b63-3b7f-4e36-9d77-5c4350bed1e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54fd118d8f134cc2bb3fab9132d5cf5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:08:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:08:52Z,use_quota=True,user_id='dbba665dba77489ba5b3b191f577183e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:08:52 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-d1a59e2c-3fd9-42f9-8f22-b87f7c436975 tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db052c07-6d95-49b1-9281-8d912791f17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:08:52 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-d1a59e2c-3fd9-42f9-8f22-b87f7c436975 tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db052c07-6d95-49b1-9281-8d912791f17c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:08:52 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-d1a59e2c-3fd9-42f9-8f22-b87f7c436975 tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b534f56-64de-44bb-bb24-add640cf0f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:08:52 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-d1a59e2c-3fd9-42f9-8f22-b87f7c436975 tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b534f56-64de-44bb-bb24-add640cf0f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bf93b63-3b7f-4e36-9d77-5c4350bed1e2', 'volume_name': 'volume-6bf93b63-3b7f-4e36-9d77-5c4350bed1e2', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:08:52 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-d1a59e2c-3fd9-42f9-8f22-b87f7c436975 tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f01b5cfb-bc9f-4106-857d-b8583405413f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:08:52 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-d1a59e2c-3fd9-42f9-8f22-b87f7c436975 tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f01b5cfb-bc9f-4106-857d-b8583405413f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:08:52 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-d1a59e2c-3fd9-42f9-8f22-b87f7c436975 tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d71bdf1-036b-4285-bf61-a806e3d88e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:08:52 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-d1a59e2c-3fd9-42f9-8f22-b87f7c436975 tempest-CreateVolumesFromSnapshotTest-85329515 None] Volume 6bf93b63-3b7f-4e36-9d77-5c4350bed1e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bf93b63-3b7f-4e36-9d77-5c4350bed1e2', 'volume_size': 1}
Apr 28 22:08:52 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-d1a59e2c-3fd9-42f9-8f22-b87f7c436975 tempest-CreateVolumesFromSnapshotTest-85329515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:08:53 devstack sudo[89074]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:53 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4f249369-156c-4655-a10c-743685399065 tempest-CreateVolumesFromSnapshotTest-85329515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-eb4b9bf3-299a-4b10-9dce-d56254d7d406 1073741824" returned: 0 in 1.188s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:53 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dbb1569-2ef1-4161-a134-898263ce3a4e tempest-GroupSnapshotsTest-1124623539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:08:53 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3dbb1569-2ef1-4161-a134-898263ce3a4e tempest-GroupSnapshotsTest-1124623539 None] Flow 'volume_create_manager' (3d46a610-d17c-4330-99f6-23eaccc02a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:08:53 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3dbb1569-2ef1-4161-a134-898263ce3a4e tempest-GroupSnapshotsTest-1124623539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf6d5950-f3f1-4d40-957f-cf7e85210a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:08:53 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4f249369-156c-4655-a10c-743685399065 tempest-CreateVolumesFromSnapshotTest-85329515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-eb4b9bf3-299a-4b10-9dce-d56254d7d406 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:53 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3dbb1569-2ef1-4161-a134-898263ce3a4e tempest-GroupSnapshotsTest-1124623539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf6d5950-f3f1-4d40-957f-cf7e85210a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2052445047',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=616968f3-5299-462d-8b78-9622730cfa5f,host='devstack@QuobyteHD#QuobyteHD',id=df7dbed6-75ba-459e-abf4-58d8eca356b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29d2f5d38aff44ebb5481ff2a7413f6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:08:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:08:53Z,use_quota=True,user_id='6cc1cf2f2521481c81eae86959034746',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(88151e99-6fb7-4704-9991-9c633e8c2087),volume_type_id=88151e99-6fb7-4704-9991-9c633e8c2087)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:08:53 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3dbb1569-2ef1-4161-a134-898263ce3a4e tempest-GroupSnapshotsTest-1124623539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75e16975-9900-4daa-b1cc-072d6b328bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:08:53 devstack sudo[89081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-eb4b9bf3-299a-4b10-9dce-d56254d7d406
Apr 28 22:08:53 devstack sudo[89081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:53 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3dbb1569-2ef1-4161-a134-898263ce3a4e tempest-GroupSnapshotsTest-1124623539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75e16975-9900-4daa-b1cc-072d6b328bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:08:53 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3dbb1569-2ef1-4161-a134-898263ce3a4e tempest-GroupSnapshotsTest-1124623539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36e35fc2-6bca-4150-8cc0-18e4a7183349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:08:53 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3dbb1569-2ef1-4161-a134-898263ce3a4e tempest-GroupSnapshotsTest-1124623539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36e35fc2-6bca-4150-8cc0-18e4a7183349) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df7dbed6-75ba-459e-abf4-58d8eca356b9', 'volume_name': 'volume-df7dbed6-75ba-459e-abf4-58d8eca356b9', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:08:53 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3dbb1569-2ef1-4161-a134-898263ce3a4e tempest-GroupSnapshotsTest-1124623539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (830ad84a-0e24-41eb-ada3-00fa715d9b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:08:53 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3dbb1569-2ef1-4161-a134-898263ce3a4e tempest-GroupSnapshotsTest-1124623539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (830ad84a-0e24-41eb-ada3-00fa715d9b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:08:53 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3dbb1569-2ef1-4161-a134-898263ce3a4e tempest-GroupSnapshotsTest-1124623539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfca5c5c-5c27-4e3e-8493-b27ca3a9bb00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:08:53 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-3dbb1569-2ef1-4161-a134-898263ce3a4e tempest-GroupSnapshotsTest-1124623539 None] Volume df7dbed6-75ba-459e-abf4-58d8eca356b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df7dbed6-75ba-459e-abf4-58d8eca356b9', 'volume_size': 1}
Apr 28 22:08:53 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-3dbb1569-2ef1-4161-a134-898263ce3a4e tempest-GroupSnapshotsTest-1124623539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:08:53 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-a094c136-0472-4a6f-9d2e-ad72044355f1 tempest-VolumesNegativeTest-2135850914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:08:53 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a094c136-0472-4a6f-9d2e-ad72044355f1 tempest-VolumesNegativeTest-2135850914 None] Flow 'volume_create_manager' (51427141-6491-461f-b907-09d78033685f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:08:53 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a094c136-0472-4a6f-9d2e-ad72044355f1 tempest-VolumesNegativeTest-2135850914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d39a0648-dd09-48f3-a06e-da35e5c02c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:08:53 devstack sudo[89081]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:53 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4f249369-156c-4655-a10c-743685399065 tempest-CreateVolumesFromSnapshotTest-85329515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-eb4b9bf3-299a-4b10-9dce-d56254d7d406" returned: 0 in 0.686s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:53 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-4f249369-156c-4655-a10c-743685399065 tempest-CreateVolumesFromSnapshotTest-85329515 None] <== create_volume: return (1988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:08:53 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-4f249369-156c-4655-a10c-743685399065 tempest-CreateVolumesFromSnapshotTest-85329515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.992s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:08:53 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-4cad5666-2283-403a-bd84-3e04fddbe3d6 tempest-CreateVolumesFromSnapshotTest-85329515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.498s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:08:53 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-4cad5666-2283-403a-bd84-3e04fddbe3d6 tempest-CreateVolumesFromSnapshotTest-85329515 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-854213799',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca01f749-1625-436b-ac91-bfcc1efdde89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54fd118d8f134cc2bb3fab9132d5cf5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:08:51Z,use_quota=True,user_id='dbba665dba77489ba5b3b191f577183e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:08:53 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-4cad5666-2283-403a-bd84-3e04fddbe3d6 tempest-CreateVolumesFromSnapshotTest-85329515 None] Creating volume ca01f749-1625-436b-ac91-bfcc1efdde89 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:08:53 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-4cad5666-2283-403a-bd84-3e04fddbe3d6 tempest-CreateVolumesFromSnapshotTest-85329515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:08:53 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-4cad5666-2283-403a-bd84-3e04fddbe3d6 tempest-CreateVolumesFromSnapshotTest-85329515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:08:53 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-4cad5666-2283-403a-bd84-3e04fddbe3d6 tempest-CreateVolumesFromSnapshotTest-85329515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:08:53 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-4cad5666-2283-403a-bd84-3e04fddbe3d6 tempest-CreateVolumesFromSnapshotTest-85329515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:08:53 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-4cad5666-2283-403a-bd84-3e04fddbe3d6 tempest-CreateVolumesFromSnapshotTest-85329515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:08:53 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-4cad5666-2283-403a-bd84-3e04fddbe3d6 tempest-CreateVolumesFromSnapshotTest-85329515 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:08:53 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-4cad5666-2283-403a-bd84-3e04fddbe3d6 tempest-CreateVolumesFromSnapshotTest-85329515 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:08:53 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4cad5666-2283-403a-bd84-3e04fddbe3d6 tempest-CreateVolumesFromSnapshotTest-85329515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ca01f749-1625-436b-ac91-bfcc1efdde89 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:53 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a094c136-0472-4a6f-9d2e-ad72044355f1 tempest-VolumesNegativeTest-2135850914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d39a0648-dd09-48f3-a06e-da35e5c02c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1211224510',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a25a468-d4f0-4138-b7bf-67cc2af32574,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b9a79f6c9874ba896a8e78c9867fb75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:08:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:08:54Z,use_quota=True,user_id='9bbdec8b1d2e4e1583f38c627f236fee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:08:53 devstack sudo[89084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ca01f749-1625-436b-ac91-bfcc1efdde89 1073741824
Apr 28 22:08:53 devstack sudo[89084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:53 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a094c136-0472-4a6f-9d2e-ad72044355f1 tempest-VolumesNegativeTest-2135850914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3f4dd84-92a3-42a2-8392-85d387dfedd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:08:53 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a094c136-0472-4a6f-9d2e-ad72044355f1 tempest-VolumesNegativeTest-2135850914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3f4dd84-92a3-42a2-8392-85d387dfedd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:08:53 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a094c136-0472-4a6f-9d2e-ad72044355f1 tempest-VolumesNegativeTest-2135850914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f20eddd-d8ec-43d3-9629-50fc0c2fbff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:08:53 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a094c136-0472-4a6f-9d2e-ad72044355f1 tempest-VolumesNegativeTest-2135850914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f20eddd-d8ec-43d3-9629-50fc0c2fbff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a25a468-d4f0-4138-b7bf-67cc2af32574', 'volume_name': 'volume-8a25a468-d4f0-4138-b7bf-67cc2af32574', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:08:53 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a094c136-0472-4a6f-9d2e-ad72044355f1 tempest-VolumesNegativeTest-2135850914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5baeb24-17d1-4867-931b-a887afd19d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:08:53 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a094c136-0472-4a6f-9d2e-ad72044355f1 tempest-VolumesNegativeTest-2135850914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5baeb24-17d1-4867-931b-a887afd19d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:08:53 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a094c136-0472-4a6f-9d2e-ad72044355f1 tempest-VolumesNegativeTest-2135850914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c129699d-03dc-48ab-8de5-03f9f271f09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:08:53 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-a094c136-0472-4a6f-9d2e-ad72044355f1 tempest-VolumesNegativeTest-2135850914 None] Volume 8a25a468-d4f0-4138-b7bf-67cc2af32574: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a25a468-d4f0-4138-b7bf-67cc2af32574', 'volume_size': 1}
Apr 28 22:08:53 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-a094c136-0472-4a6f-9d2e-ad72044355f1 tempest-VolumesNegativeTest-2135850914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:08:53 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-4f249369-156c-4655-a10c-743685399065 tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f407f2ad-f3cb-4dac-9547-bac48ade9fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb4b9bf3-299a-4b10-9dce-d56254d7d406', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:08:53 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-4f249369-156c-4655-a10c-743685399065 tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6670b6dc-2b91-4ffa-bdcd-858671019bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:08:53 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-4f249369-156c-4655-a10c-743685399065 tempest-CreateVolumesFromSnapshotTest-85329515 None] Volume volume-eb4b9bf3-299a-4b10-9dce-d56254d7d406 (eb4b9bf3-299a-4b10-9dce-d56254d7d406): created successfully
Apr 28 22:08:53 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-4f249369-156c-4655-a10c-743685399065 tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6670b6dc-2b91-4ffa-bdcd-858671019bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:08:53 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-4f249369-156c-4655-a10c-743685399065 tempest-CreateVolumesFromSnapshotTest-85329515 None] Flow 'volume_create_manager' (f5957a52-1f5d-46b6-8004-b58ed8b377d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:08:53 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-4f249369-156c-4655-a10c-743685399065 tempest-CreateVolumesFromSnapshotTest-85329515 None] Created volume successfully.
Apr 28 22:08:54 devstack sudo[89084]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:54 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4cad5666-2283-403a-bd84-3e04fddbe3d6 tempest-CreateVolumesFromSnapshotTest-85329515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ca01f749-1625-436b-ac91-bfcc1efdde89 1073741824" returned: 0 in 0.802s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:54 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4cad5666-2283-403a-bd84-3e04fddbe3d6 tempest-CreateVolumesFromSnapshotTest-85329515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ca01f749-1625-436b-ac91-bfcc1efdde89 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:54 devstack sudo[89090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ca01f749-1625-436b-ac91-bfcc1efdde89
Apr 28 22:08:54 devstack sudo[89090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:55 devstack sudo[89090]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:55 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4cad5666-2283-403a-bd84-3e04fddbe3d6 tempest-CreateVolumesFromSnapshotTest-85329515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ca01f749-1625-436b-ac91-bfcc1efdde89" returned: 0 in 0.628s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:55 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-4cad5666-2283-403a-bd84-3e04fddbe3d6 tempest-CreateVolumesFromSnapshotTest-85329515 None] <== create_volume: return (1471ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:08:55 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-4cad5666-2283-403a-bd84-3e04fddbe3d6 tempest-CreateVolumesFromSnapshotTest-85329515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.475s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:08:55 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-88801485-95a4-406a-8995-83922426ab50 tempest-CreateVolumesFromSnapshotTest-85329515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.517s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:08:55 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-88801485-95a4-406a-8995-83922426ab50 tempest-CreateVolumesFromSnapshotTest-85329515 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-802974826',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22042486-089a-4e58-8d17-91d0e4991998,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54fd118d8f134cc2bb3fab9132d5cf5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:08:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:08:52Z,use_quota=True,user_id='dbba665dba77489ba5b3b191f577183e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:08:55 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-88801485-95a4-406a-8995-83922426ab50 tempest-CreateVolumesFromSnapshotTest-85329515 None] Creating volume 22042486-089a-4e58-8d17-91d0e4991998 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:08:55 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-88801485-95a4-406a-8995-83922426ab50 tempest-CreateVolumesFromSnapshotTest-85329515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:08:55 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-88801485-95a4-406a-8995-83922426ab50 tempest-CreateVolumesFromSnapshotTest-85329515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:08:55 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-88801485-95a4-406a-8995-83922426ab50 tempest-CreateVolumesFromSnapshotTest-85329515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:08:55 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-88801485-95a4-406a-8995-83922426ab50 tempest-CreateVolumesFromSnapshotTest-85329515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:08:55 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-88801485-95a4-406a-8995-83922426ab50 tempest-CreateVolumesFromSnapshotTest-85329515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:08:55 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-88801485-95a4-406a-8995-83922426ab50 tempest-CreateVolumesFromSnapshotTest-85329515 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:08:55 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-88801485-95a4-406a-8995-83922426ab50 tempest-CreateVolumesFromSnapshotTest-85329515 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:08:55 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-88801485-95a4-406a-8995-83922426ab50 tempest-CreateVolumesFromSnapshotTest-85329515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-22042486-089a-4e58-8d17-91d0e4991998 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:55 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-4cad5666-2283-403a-bd84-3e04fddbe3d6 tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb70af57-fa0b-4f99-a2a7-0a9333670d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca01f749-1625-436b-ac91-bfcc1efdde89', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:08:55 devstack sudo[89093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-22042486-089a-4e58-8d17-91d0e4991998 1073741824
Apr 28 22:08:55 devstack sudo[89093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:55 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-4cad5666-2283-403a-bd84-3e04fddbe3d6 tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5327b51f-0793-474f-b351-c69115975d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:08:55 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-4cad5666-2283-403a-bd84-3e04fddbe3d6 tempest-CreateVolumesFromSnapshotTest-85329515 None] Volume volume-ca01f749-1625-436b-ac91-bfcc1efdde89 (ca01f749-1625-436b-ac91-bfcc1efdde89): created successfully
Apr 28 22:08:55 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-4cad5666-2283-403a-bd84-3e04fddbe3d6 tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5327b51f-0793-474f-b351-c69115975d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:08:55 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-4cad5666-2283-403a-bd84-3e04fddbe3d6 tempest-CreateVolumesFromSnapshotTest-85329515 None] Flow 'volume_create_manager' (3f72843b-2a1f-4492-9644-a01159dda029) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:08:55 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-4cad5666-2283-403a-bd84-3e04fddbe3d6 tempest-CreateVolumesFromSnapshotTest-85329515 None] Created volume successfully.
Apr 28 22:08:56 devstack sudo[89093]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:56 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-88801485-95a4-406a-8995-83922426ab50 tempest-CreateVolumesFromSnapshotTest-85329515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-22042486-089a-4e58-8d17-91d0e4991998 1073741824" returned: 0 in 0.851s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:56 devstack cinder-volume[83924]: DEBUG dbcounter [-] [83924] Writing DB stats cinder:SELECT=126,cinder:INSERT=30,cinder:UPDATE=126,cinder:DELETE=9 {{(pid=83924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 28 22:08:56 devstack cinder-volume[83924]: DEBUG dbcounter [-] [83924] Writing DB stats cinder:SELECT=110,cinder:UPDATE=158,cinder:INSERT=36,cinder:DELETE=10 {{(pid=83924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 28 22:08:56 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-88801485-95a4-406a-8995-83922426ab50 tempest-CreateVolumesFromSnapshotTest-85329515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-22042486-089a-4e58-8d17-91d0e4991998 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:56 devstack sudo[89100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-22042486-089a-4e58-8d17-91d0e4991998
Apr 28 22:08:56 devstack sudo[89100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:56 devstack sudo[89100]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:56 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-88801485-95a4-406a-8995-83922426ab50 tempest-CreateVolumesFromSnapshotTest-85329515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-22042486-089a-4e58-8d17-91d0e4991998" returned: 0 in 0.606s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:56 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-88801485-95a4-406a-8995-83922426ab50 tempest-CreateVolumesFromSnapshotTest-85329515 None] <== create_volume: return (1513ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:08:56 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-88801485-95a4-406a-8995-83922426ab50 tempest-CreateVolumesFromSnapshotTest-85329515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.515s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:08:56 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-fa849ef0-241c-4724-86a4-b66c0ddc8bda tempest-CreateVolumesFromSnapshotTest-85329515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.613s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:08:56 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-fa849ef0-241c-4724-86a4-b66c0ddc8bda tempest-CreateVolumesFromSnapshotTest-85329515 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:08:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1919209212',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3db0ed2e-f79e-485f-8f27-6b95993b5041,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54fd118d8f134cc2bb3fab9132d5cf5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:08:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:08:52Z,use_quota=True,user_id='dbba665dba77489ba5b3b191f577183e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:08:56 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-fa849ef0-241c-4724-86a4-b66c0ddc8bda tempest-CreateVolumesFromSnapshotTest-85329515 None] Creating volume 3db0ed2e-f79e-485f-8f27-6b95993b5041 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:08:56 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-fa849ef0-241c-4724-86a4-b66c0ddc8bda tempest-CreateVolumesFromSnapshotTest-85329515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:08:56 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-fa849ef0-241c-4724-86a4-b66c0ddc8bda tempest-CreateVolumesFromSnapshotTest-85329515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:08:56 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-fa849ef0-241c-4724-86a4-b66c0ddc8bda tempest-CreateVolumesFromSnapshotTest-85329515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:08:56 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-fa849ef0-241c-4724-86a4-b66c0ddc8bda tempest-CreateVolumesFromSnapshotTest-85329515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:08:56 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-fa849ef0-241c-4724-86a4-b66c0ddc8bda tempest-CreateVolumesFromSnapshotTest-85329515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:08:56 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-fa849ef0-241c-4724-86a4-b66c0ddc8bda tempest-CreateVolumesFromSnapshotTest-85329515 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:08:56 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-fa849ef0-241c-4724-86a4-b66c0ddc8bda tempest-CreateVolumesFromSnapshotTest-85329515 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:08:56 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-fa849ef0-241c-4724-86a4-b66c0ddc8bda tempest-CreateVolumesFromSnapshotTest-85329515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3db0ed2e-f79e-485f-8f27-6b95993b5041 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:56 devstack sudo[89104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3db0ed2e-f79e-485f-8f27-6b95993b5041 1073741824
Apr 28 22:08:56 devstack sudo[89104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:56 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-88801485-95a4-406a-8995-83922426ab50 tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a22a75c-d039-4ac5-9fb2-8b80f9a93c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22042486-089a-4e58-8d17-91d0e4991998', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:08:56 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-88801485-95a4-406a-8995-83922426ab50 tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (736f147d-8230-43ea-af51-9459680f42d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:08:56 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-88801485-95a4-406a-8995-83922426ab50 tempest-CreateVolumesFromSnapshotTest-85329515 None] Volume volume-22042486-089a-4e58-8d17-91d0e4991998 (22042486-089a-4e58-8d17-91d0e4991998): created successfully
Apr 28 22:08:56 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-88801485-95a4-406a-8995-83922426ab50 tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (736f147d-8230-43ea-af51-9459680f42d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:08:56 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-88801485-95a4-406a-8995-83922426ab50 tempest-CreateVolumesFromSnapshotTest-85329515 None] Flow 'volume_create_manager' (2e30e0fe-a45e-4808-8835-b5d233051c85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:08:56 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-88801485-95a4-406a-8995-83922426ab50 tempest-CreateVolumesFromSnapshotTest-85329515 None] Created volume successfully.
Apr 28 22:08:57 devstack sudo[89104]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:57 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-fa849ef0-241c-4724-86a4-b66c0ddc8bda tempest-CreateVolumesFromSnapshotTest-85329515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3db0ed2e-f79e-485f-8f27-6b95993b5041 1073741824" returned: 0 in 0.820s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:57 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-fa849ef0-241c-4724-86a4-b66c0ddc8bda tempest-CreateVolumesFromSnapshotTest-85329515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3db0ed2e-f79e-485f-8f27-6b95993b5041 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:57 devstack sudo[89110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3db0ed2e-f79e-485f-8f27-6b95993b5041
Apr 28 22:08:57 devstack sudo[89110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:58 devstack sudo[89110]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:58 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-fa849ef0-241c-4724-86a4-b66c0ddc8bda tempest-CreateVolumesFromSnapshotTest-85329515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3db0ed2e-f79e-485f-8f27-6b95993b5041" returned: 0 in 0.676s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:58 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-fa849ef0-241c-4724-86a4-b66c0ddc8bda tempest-CreateVolumesFromSnapshotTest-85329515 None] <== create_volume: return (1549ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:08:58 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-fa849ef0-241c-4724-86a4-b66c0ddc8bda tempest-CreateVolumesFromSnapshotTest-85329515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.556s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:08:58 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-d1a59e2c-3fd9-42f9-8f22-b87f7c436975 tempest-CreateVolumesFromSnapshotTest-85329515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.732s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:08:58 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-d1a59e2c-3fd9-42f9-8f22-b87f7c436975 tempest-CreateVolumesFromSnapshotTest-85329515 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:08:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1656299418',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bf93b63-3b7f-4e36-9d77-5c4350bed1e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54fd118d8f134cc2bb3fab9132d5cf5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:08:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:08:52Z,use_quota=True,user_id='dbba665dba77489ba5b3b191f577183e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:08:58 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-d1a59e2c-3fd9-42f9-8f22-b87f7c436975 tempest-CreateVolumesFromSnapshotTest-85329515 None] Creating volume 6bf93b63-3b7f-4e36-9d77-5c4350bed1e2 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:08:58 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-d1a59e2c-3fd9-42f9-8f22-b87f7c436975 tempest-CreateVolumesFromSnapshotTest-85329515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:08:58 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-d1a59e2c-3fd9-42f9-8f22-b87f7c436975 tempest-CreateVolumesFromSnapshotTest-85329515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:08:58 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-d1a59e2c-3fd9-42f9-8f22-b87f7c436975 tempest-CreateVolumesFromSnapshotTest-85329515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:08:58 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-d1a59e2c-3fd9-42f9-8f22-b87f7c436975 tempest-CreateVolumesFromSnapshotTest-85329515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:08:58 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-d1a59e2c-3fd9-42f9-8f22-b87f7c436975 tempest-CreateVolumesFromSnapshotTest-85329515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:08:58 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-d1a59e2c-3fd9-42f9-8f22-b87f7c436975 tempest-CreateVolumesFromSnapshotTest-85329515 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:08:58 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-d1a59e2c-3fd9-42f9-8f22-b87f7c436975 tempest-CreateVolumesFromSnapshotTest-85329515 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:08:58 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-d1a59e2c-3fd9-42f9-8f22-b87f7c436975 tempest-CreateVolumesFromSnapshotTest-85329515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6bf93b63-3b7f-4e36-9d77-5c4350bed1e2 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:58 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-fa849ef0-241c-4724-86a4-b66c0ddc8bda tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0635fa5d-f714-4f55-a8de-eeeb834cdb05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3db0ed2e-f79e-485f-8f27-6b95993b5041', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:08:58 devstack sudo[89113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6bf93b63-3b7f-4e36-9d77-5c4350bed1e2 1073741824
Apr 28 22:08:58 devstack sudo[89113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:58 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-fa849ef0-241c-4724-86a4-b66c0ddc8bda tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d393d1d3-15b1-481b-87e8-679398c03361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:08:58 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-fa849ef0-241c-4724-86a4-b66c0ddc8bda tempest-CreateVolumesFromSnapshotTest-85329515 None] Volume volume-3db0ed2e-f79e-485f-8f27-6b95993b5041 (3db0ed2e-f79e-485f-8f27-6b95993b5041): created successfully
Apr 28 22:08:58 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-fa849ef0-241c-4724-86a4-b66c0ddc8bda tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d393d1d3-15b1-481b-87e8-679398c03361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:08:58 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-fa849ef0-241c-4724-86a4-b66c0ddc8bda tempest-CreateVolumesFromSnapshotTest-85329515 None] Flow 'volume_create_manager' (4b8ba694-5ec5-464f-a8b4-b9846c33cbd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:08:58 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-fa849ef0-241c-4724-86a4-b66c0ddc8bda tempest-CreateVolumesFromSnapshotTest-85329515 None] Created volume successfully.
Apr 28 22:08:59 devstack sudo[89113]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:59 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-d1a59e2c-3fd9-42f9-8f22-b87f7c436975 tempest-CreateVolumesFromSnapshotTest-85329515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6bf93b63-3b7f-4e36-9d77-5c4350bed1e2 1073741824" returned: 0 in 0.906s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:59 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-d1a59e2c-3fd9-42f9-8f22-b87f7c436975 tempest-CreateVolumesFromSnapshotTest-85329515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6bf93b63-3b7f-4e36-9d77-5c4350bed1e2 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:08:59 devstack sudo[89121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6bf93b63-3b7f-4e36-9d77-5c4350bed1e2
Apr 28 22:08:59 devstack sudo[89121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:08:59 devstack sudo[89121]: pam_unix(sudo:session): session closed for user root
Apr 28 22:08:59 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-d1a59e2c-3fd9-42f9-8f22-b87f7c436975 tempest-CreateVolumesFromSnapshotTest-85329515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6bf93b63-3b7f-4e36-9d77-5c4350bed1e2" returned: 0 in 0.662s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:08:59 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-d1a59e2c-3fd9-42f9-8f22-b87f7c436975 tempest-CreateVolumesFromSnapshotTest-85329515 None] <== create_volume: return (1614ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:08:59 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-d1a59e2c-3fd9-42f9-8f22-b87f7c436975 tempest-CreateVolumesFromSnapshotTest-85329515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.618s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:08:59 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-3dbb1569-2ef1-4161-a134-898263ce3a4e tempest-GroupSnapshotsTest-1124623539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.830s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:08:59 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-3dbb1569-2ef1-4161-a134-898263ce3a4e tempest-GroupSnapshotsTest-1124623539 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=616968f3-5299-462d-8b78-9622730cfa5f,created_at=2026-04-28T20:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2052445047',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=616968f3-5299-462d-8b78-9622730cfa5f,host='devstack@QuobyteHD#QuobyteHD',id=df7dbed6-75ba-459e-abf4-58d8eca356b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29d2f5d38aff44ebb5481ff2a7413f6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:08:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:08:53Z,use_quota=True,user_id='6cc1cf2f2521481c81eae86959034746',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(88151e99-6fb7-4704-9991-9c633e8c2087),volume_type_id=88151e99-6fb7-4704-9991-9c633e8c2087)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:08:59 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-3dbb1569-2ef1-4161-a134-898263ce3a4e tempest-GroupSnapshotsTest-1124623539 None] Creating volume df7dbed6-75ba-459e-abf4-58d8eca356b9 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:08:59 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-3dbb1569-2ef1-4161-a134-898263ce3a4e tempest-GroupSnapshotsTest-1124623539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:08:59 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-3dbb1569-2ef1-4161-a134-898263ce3a4e tempest-GroupSnapshotsTest-1124623539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:08:59 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-3dbb1569-2ef1-4161-a134-898263ce3a4e tempest-GroupSnapshotsTest-1124623539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:08:59 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-3dbb1569-2ef1-4161-a134-898263ce3a4e tempest-GroupSnapshotsTest-1124623539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:08:59 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-3dbb1569-2ef1-4161-a134-898263ce3a4e tempest-GroupSnapshotsTest-1124623539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:08:59 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-3dbb1569-2ef1-4161-a134-898263ce3a4e tempest-GroupSnapshotsTest-1124623539 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:08:59 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-3dbb1569-2ef1-4161-a134-898263ce3a4e tempest-GroupSnapshotsTest-1124623539 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:08:59 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-3dbb1569-2ef1-4161-a134-898263ce3a4e tempest-GroupSnapshotsTest-1124623539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-df7dbed6-75ba-459e-abf4-58d8eca356b9 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:00 devstack sudo[89124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-df7dbed6-75ba-459e-abf4-58d8eca356b9 1073741824
Apr 28 22:09:00 devstack sudo[89124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:00 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-d1a59e2c-3fd9-42f9-8f22-b87f7c436975 tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d71bdf1-036b-4285-bf61-a806e3d88e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bf93b63-3b7f-4e36-9d77-5c4350bed1e2', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:09:00 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-d1a59e2c-3fd9-42f9-8f22-b87f7c436975 tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e899ae3d-de75-4817-a66c-8da99efd3368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:09:00 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-d1a59e2c-3fd9-42f9-8f22-b87f7c436975 tempest-CreateVolumesFromSnapshotTest-85329515 None] Volume volume-6bf93b63-3b7f-4e36-9d77-5c4350bed1e2 (6bf93b63-3b7f-4e36-9d77-5c4350bed1e2): created successfully
Apr 28 22:09:00 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-d1a59e2c-3fd9-42f9-8f22-b87f7c436975 tempest-CreateVolumesFromSnapshotTest-85329515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e899ae3d-de75-4817-a66c-8da99efd3368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:09:00 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-d1a59e2c-3fd9-42f9-8f22-b87f7c436975 tempest-CreateVolumesFromSnapshotTest-85329515 None] Flow 'volume_create_manager' (dd899464-5328-4e26-a19a-598a47ebe334) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:09:00 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-d1a59e2c-3fd9-42f9-8f22-b87f7c436975 tempest-CreateVolumesFromSnapshotTest-85329515 None] Created volume successfully.
Apr 28 22:09:00 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-f78f062c-20cb-4e19-bc3a-2b93caa8c3ae tempest-CreateVolumesFromSnapshotTest-85329515 None] Acquiring lock "cinder-6bf93b63-3b7f-4e36-9d77-5c4350bed1e2-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:09:00 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-f78f062c-20cb-4e19-bc3a-2b93caa8c3ae tempest-CreateVolumesFromSnapshotTest-85329515 None] Lock "cinder-6bf93b63-3b7f-4e36-9d77-5c4350bed1e2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:09:00 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-f78f062c-20cb-4e19-bc3a-2b93caa8c3ae tempest-CreateVolumesFromSnapshotTest-85329515 None] Acquiring lock "cinder-quobyte-6bf93b63-3b7f-4e36-9d77-5c4350bed1e2" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:09:00 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-f78f062c-20cb-4e19-bc3a-2b93caa8c3ae tempest-CreateVolumesFromSnapshotTest-85329515 None] Lock "cinder-quobyte-6bf93b63-3b7f-4e36-9d77-5c4350bed1e2" acquired by "delete_volume" :: waited 0.030s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:09:00 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1035b5-7548-40ab-b31f-eded10a3f5a0]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:09:00 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f78f062c-20cb-4e19-bc3a-2b93caa8c3ae tempest-CreateVolumesFromSnapshotTest-85329515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6bf93b63-3b7f-4e36-9d77-5c4350bed1e2 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:00 devstack sudo[89126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6bf93b63-3b7f-4e36-9d77-5c4350bed1e2
Apr 28 22:09:00 devstack sudo[89126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:01 devstack sudo[89124]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:01 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-3dbb1569-2ef1-4161-a134-898263ce3a4e tempest-GroupSnapshotsTest-1124623539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-df7dbed6-75ba-459e-abf4-58d8eca356b9 1073741824" returned: 0 in 1.113s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:01 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-3dbb1569-2ef1-4161-a134-898263ce3a4e tempest-GroupSnapshotsTest-1124623539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-df7dbed6-75ba-459e-abf4-58d8eca356b9 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:01 devstack sudo[89131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-df7dbed6-75ba-459e-abf4-58d8eca356b9
Apr 28 22:09:01 devstack sudo[89131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:01 devstack sudo[89126]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:01 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f78f062c-20cb-4e19-bc3a-2b93caa8c3ae tempest-CreateVolumesFromSnapshotTest-85329515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6bf93b63-3b7f-4e36-9d77-5c4350bed1e2" returned: 0 in 0.921s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:01 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f78f062c-20cb-4e19-bc3a-2b93caa8c3ae tempest-CreateVolumesFromSnapshotTest-85329515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6bf93b63-3b7f-4e36-9d77-5c4350bed1e2 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:01 devstack sudo[89136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6bf93b63-3b7f-4e36-9d77-5c4350bed1e2
Apr 28 22:09:01 devstack sudo[89136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:01 devstack sudo[89131]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:01 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-3dbb1569-2ef1-4161-a134-898263ce3a4e tempest-GroupSnapshotsTest-1124623539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-df7dbed6-75ba-459e-abf4-58d8eca356b9" returned: 0 in 0.718s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:01 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-3dbb1569-2ef1-4161-a134-898263ce3a4e tempest-GroupSnapshotsTest-1124623539 None] <== create_volume: return (1880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:09:01 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-3dbb1569-2ef1-4161-a134-898263ce3a4e tempest-GroupSnapshotsTest-1124623539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.883s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:09:01 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-a094c136-0472-4a6f-9d2e-ad72044355f1 tempest-VolumesNegativeTest-2135850914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.009s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:09:01 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-a094c136-0472-4a6f-9d2e-ad72044355f1 tempest-VolumesNegativeTest-2135850914 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1211224510',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a25a468-d4f0-4138-b7bf-67cc2af32574,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b9a79f6c9874ba896a8e78c9867fb75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:08:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:08:54Z,use_quota=True,user_id='9bbdec8b1d2e4e1583f38c627f236fee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:09:01 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-a094c136-0472-4a6f-9d2e-ad72044355f1 tempest-VolumesNegativeTest-2135850914 None] Creating volume 8a25a468-d4f0-4138-b7bf-67cc2af32574 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:09:01 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-a094c136-0472-4a6f-9d2e-ad72044355f1 tempest-VolumesNegativeTest-2135850914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:09:01 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-a094c136-0472-4a6f-9d2e-ad72044355f1 tempest-VolumesNegativeTest-2135850914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:09:01 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-a094c136-0472-4a6f-9d2e-ad72044355f1 tempest-VolumesNegativeTest-2135850914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:09:01 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-a094c136-0472-4a6f-9d2e-ad72044355f1 tempest-VolumesNegativeTest-2135850914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:09:01 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-a094c136-0472-4a6f-9d2e-ad72044355f1 tempest-VolumesNegativeTest-2135850914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:09:01 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-a094c136-0472-4a6f-9d2e-ad72044355f1 tempest-VolumesNegativeTest-2135850914 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:09:01 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-a094c136-0472-4a6f-9d2e-ad72044355f1 tempest-VolumesNegativeTest-2135850914 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:09:01 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a094c136-0472-4a6f-9d2e-ad72044355f1 tempest-VolumesNegativeTest-2135850914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8a25a468-d4f0-4138-b7bf-67cc2af32574 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:01 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3dbb1569-2ef1-4161-a134-898263ce3a4e tempest-GroupSnapshotsTest-1124623539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfca5c5c-5c27-4e3e-8493-b27ca3a9bb00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df7dbed6-75ba-459e-abf4-58d8eca356b9', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:09:01 devstack sudo[89139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8a25a468-d4f0-4138-b7bf-67cc2af32574 1073741824
Apr 28 22:09:01 devstack sudo[89139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:01 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3dbb1569-2ef1-4161-a134-898263ce3a4e tempest-GroupSnapshotsTest-1124623539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5cd4ce5-7608-4127-8901-0ebd90d3ce25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:09:01 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-3dbb1569-2ef1-4161-a134-898263ce3a4e tempest-GroupSnapshotsTest-1124623539 None] Volume volume-df7dbed6-75ba-459e-abf4-58d8eca356b9 (df7dbed6-75ba-459e-abf4-58d8eca356b9): created successfully
Apr 28 22:09:01 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3dbb1569-2ef1-4161-a134-898263ce3a4e tempest-GroupSnapshotsTest-1124623539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5cd4ce5-7608-4127-8901-0ebd90d3ce25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:09:01 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3dbb1569-2ef1-4161-a134-898263ce3a4e tempest-GroupSnapshotsTest-1124623539 None] Flow 'volume_create_manager' (3d46a610-d17c-4330-99f6-23eaccc02a1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:09:01 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-3dbb1569-2ef1-4161-a134-898263ce3a4e tempest-GroupSnapshotsTest-1124623539 None] Created volume successfully.
Apr 28 22:09:02 devstack sudo[89136]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:02 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f78f062c-20cb-4e19-bc3a-2b93caa8c3ae tempest-CreateVolumesFromSnapshotTest-85329515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6bf93b63-3b7f-4e36-9d77-5c4350bed1e2" returned: 0 in 0.661s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:02 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-f78f062c-20cb-4e19-bc3a-2b93caa8c3ae tempest-CreateVolumesFromSnapshotTest-85329515 None] Lock "cinder-quobyte-6bf93b63-3b7f-4e36-9d77-5c4350bed1e2" released by "delete_volume" :: held 1.651s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:09:02 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-f78f062c-20cb-4e19-bc3a-2b93caa8c3ae tempest-CreateVolumesFromSnapshotTest-85329515 None] Created reservations ['65bf39e7-8b31-4387-af18-d1857d93efc5', '2f8f5a0a-9dc5-4759-8444-5f4e55625086', '1b22b5b4-ccfc-40b0-a7b9-b8bc7706d120', '3fa903aa-ac7c-4209-9873-4b8ab4a24754'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:09:02 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f78f062c-20cb-4e19-bc3a-2b93caa8c3ae tempest-CreateVolumesFromSnapshotTest-85329515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:09:02 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f78f062c-20cb-4e19-bc3a-2b93caa8c3ae tempest-CreateVolumesFromSnapshotTest-85329515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:09:02 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-f78f062c-20cb-4e19-bc3a-2b93caa8c3ae tempest-CreateVolumesFromSnapshotTest-85329515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:09:02 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-f78f062c-20cb-4e19-bc3a-2b93caa8c3ae tempest-CreateVolumesFromSnapshotTest-85329515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:09:02 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f78f062c-20cb-4e19-bc3a-2b93caa8c3ae tempest-CreateVolumesFromSnapshotTest-85329515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:09:02 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f78f062c-20cb-4e19-bc3a-2b93caa8c3ae tempest-CreateVolumesFromSnapshotTest-85329515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:02 devstack sudo[89142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:09:02 devstack sudo[89142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:02 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-e7206281-d3dd-4a3b-b157-91906f1b27c9 tempest-CreateVolumesFromSnapshotTest-85329515 None] Acquiring lock "cinder-3db0ed2e-f79e-485f-8f27-6b95993b5041-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:09:02 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-e7206281-d3dd-4a3b-b157-91906f1b27c9 tempest-CreateVolumesFromSnapshotTest-85329515 None] Lock "cinder-3db0ed2e-f79e-485f-8f27-6b95993b5041-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:09:02 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-e7206281-d3dd-4a3b-b157-91906f1b27c9 tempest-CreateVolumesFromSnapshotTest-85329515 None] Acquiring lock "cinder-quobyte-3db0ed2e-f79e-485f-8f27-6b95993b5041" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:09:02 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [req-02148c47-f12e-4af7-9d6b-20e44acf80b6 req-59d126eb-61e6-4ab8-91c9-4dcff63c4658 tempest-VolumesGetTestJSON-1105456292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:09:02 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [req-02148c47-f12e-4af7-9d6b-20e44acf80b6 req-59d126eb-61e6-4ab8-91c9-4dcff63c4658 tempest-VolumesGetTestJSON-1105456292 None] Flow 'volume_create_manager' (9b2add66-eb97-4ed8-89fb-263914a02461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:09:02 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [req-02148c47-f12e-4af7-9d6b-20e44acf80b6 req-59d126eb-61e6-4ab8-91c9-4dcff63c4658 tempest-VolumesGetTestJSON-1105456292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28c330d6-6b70-422a-8e78-c6f15da36130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:09:02 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-e7206281-d3dd-4a3b-b157-91906f1b27c9 tempest-CreateVolumesFromSnapshotTest-85329515 None] Lock "cinder-quobyte-3db0ed2e-f79e-485f-8f27-6b95993b5041" acquired by "delete_volume" :: waited 0.056s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:09:02 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [req-02148c47-f12e-4af7-9d6b-20e44acf80b6 req-59d126eb-61e6-4ab8-91c9-4dcff63c4658 tempest-VolumesGetTestJSON-1105456292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28c330d6-6b70-422a-8e78-c6f15da36130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:09:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2106064065',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d99014de-3b66-4262-a932-031c77d0e0b9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7b03435149ad4bbd9a103265edd66169',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:09:03Z,use_quota=True,user_id='5fb42851fbe34710b5814d6b6f05d471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:09:02 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [req-02148c47-f12e-4af7-9d6b-20e44acf80b6 req-59d126eb-61e6-4ab8-91c9-4dcff63c4658 tempest-VolumesGetTestJSON-1105456292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (437f741b-c938-4655-9428-0af0e7bb4838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:09:02 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [req-02148c47-f12e-4af7-9d6b-20e44acf80b6 req-59d126eb-61e6-4ab8-91c9-4dcff63c4658 tempest-VolumesGetTestJSON-1105456292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (437f741b-c938-4655-9428-0af0e7bb4838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:09:02 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [req-02148c47-f12e-4af7-9d6b-20e44acf80b6 req-59d126eb-61e6-4ab8-91c9-4dcff63c4658 tempest-VolumesGetTestJSON-1105456292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ddeab10-f322-4c7b-a52e-c88b4a077b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:09:02 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [req-02148c47-f12e-4af7-9d6b-20e44acf80b6 req-59d126eb-61e6-4ab8-91c9-4dcff63c4658 tempest-VolumesGetTestJSON-1105456292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ddeab10-f322-4c7b-a52e-c88b4a077b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd99014de-3b66-4262-a932-031c77d0e0b9', 'volume_name': 'volume-d99014de-3b66-4262-a932-031c77d0e0b9', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:09:02 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [req-02148c47-f12e-4af7-9d6b-20e44acf80b6 req-59d126eb-61e6-4ab8-91c9-4dcff63c4658 tempest-VolumesGetTestJSON-1105456292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (412496f6-4675-4698-b016-f33eb6e6d78b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:09:02 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [req-02148c47-f12e-4af7-9d6b-20e44acf80b6 req-59d126eb-61e6-4ab8-91c9-4dcff63c4658 tempest-VolumesGetTestJSON-1105456292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (412496f6-4675-4698-b016-f33eb6e6d78b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:09:02 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [req-02148c47-f12e-4af7-9d6b-20e44acf80b6 req-59d126eb-61e6-4ab8-91c9-4dcff63c4658 tempest-VolumesGetTestJSON-1105456292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edcc4196-4016-4db9-a7e5-ace4df48ec73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:09:02 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [req-02148c47-f12e-4af7-9d6b-20e44acf80b6 req-59d126eb-61e6-4ab8-91c9-4dcff63c4658 tempest-VolumesGetTestJSON-1105456292 None] Volume d99014de-3b66-4262-a932-031c77d0e0b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d99014de-3b66-4262-a932-031c77d0e0b9', 'volume_size': 1}
Apr 28 22:09:02 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [req-02148c47-f12e-4af7-9d6b-20e44acf80b6 req-59d126eb-61e6-4ab8-91c9-4dcff63c4658 tempest-VolumesGetTestJSON-1105456292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:09:02 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[3532b1b6-1759-4106-830f-db978220ae21]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:09:02 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e7206281-d3dd-4a3b-b157-91906f1b27c9 tempest-CreateVolumesFromSnapshotTest-85329515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3db0ed2e-f79e-485f-8f27-6b95993b5041 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:02 devstack sudo[89139]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:02 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a094c136-0472-4a6f-9d2e-ad72044355f1 tempest-VolumesNegativeTest-2135850914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8a25a468-d4f0-4138-b7bf-67cc2af32574 1073741824" returned: 0 in 1.097s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:03 devstack sudo[89142]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:03 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f78f062c-20cb-4e19-bc3a-2b93caa8c3ae tempest-CreateVolumesFromSnapshotTest-85329515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.798s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:03 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-f78f062c-20cb-4e19-bc3a-2b93caa8c3ae tempest-CreateVolumesFromSnapshotTest-85329515 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:09:03 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-f78f062c-20cb-4e19-bc3a-2b93caa8c3ae tempest-CreateVolumesFromSnapshotTest-85329515 None] Deleted volume successfully.
Apr 28 22:09:03 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a094c136-0472-4a6f-9d2e-ad72044355f1 tempest-VolumesNegativeTest-2135850914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8a25a468-d4f0-4138-b7bf-67cc2af32574 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:03 devstack sudo[89151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8a25a468-d4f0-4138-b7bf-67cc2af32574
Apr 28 22:09:03 devstack sudo[89151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:03 devstack sudo[89149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3db0ed2e-f79e-485f-8f27-6b95993b5041
Apr 28 22:09:03 devstack sudo[89149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:03 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-f78f062c-20cb-4e19-bc3a-2b93caa8c3ae tempest-CreateVolumesFromSnapshotTest-85329515 None] Lock "cinder-6bf93b63-3b7f-4e36-9d77-5c4350bed1e2-delete_volume" released by "delete_volume" :: held 2.711s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:09:03 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-4d47de50-3172-4269-8803-ec7577e7f0c5 tempest-GroupSnapshotsTest-1124623539 None] Update group completed successfully.
Apr 28 22:09:03 devstack sudo[89151]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:03 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a094c136-0472-4a6f-9d2e-ad72044355f1 tempest-VolumesNegativeTest-2135850914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8a25a468-d4f0-4138-b7bf-67cc2af32574" returned: 0 in 0.612s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:03 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-a094c136-0472-4a6f-9d2e-ad72044355f1 tempest-VolumesNegativeTest-2135850914 None] <== create_volume: return (1782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:09:03 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-a094c136-0472-4a6f-9d2e-ad72044355f1 tempest-VolumesNegativeTest-2135850914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.785s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:09:03 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [req-02148c47-f12e-4af7-9d6b-20e44acf80b6 req-59d126eb-61e6-4ab8-91c9-4dcff63c4658 tempest-VolumesGetTestJSON-1105456292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.747s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:09:03 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [req-02148c47-f12e-4af7-9d6b-20e44acf80b6 req-59d126eb-61e6-4ab8-91c9-4dcff63c4658 tempest-VolumesGetTestJSON-1105456292 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:09:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2106064065',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d99014de-3b66-4262-a932-031c77d0e0b9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7b03435149ad4bbd9a103265edd66169',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:09:03Z,use_quota=True,user_id='5fb42851fbe34710b5814d6b6f05d471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:09:03 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [req-02148c47-f12e-4af7-9d6b-20e44acf80b6 req-59d126eb-61e6-4ab8-91c9-4dcff63c4658 tempest-VolumesGetTestJSON-1105456292 None] Creating volume d99014de-3b66-4262-a932-031c77d0e0b9 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:09:03 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [req-02148c47-f12e-4af7-9d6b-20e44acf80b6 req-59d126eb-61e6-4ab8-91c9-4dcff63c4658 tempest-VolumesGetTestJSON-1105456292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:09:03 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [req-02148c47-f12e-4af7-9d6b-20e44acf80b6 req-59d126eb-61e6-4ab8-91c9-4dcff63c4658 tempest-VolumesGetTestJSON-1105456292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:09:03 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [req-02148c47-f12e-4af7-9d6b-20e44acf80b6 req-59d126eb-61e6-4ab8-91c9-4dcff63c4658 tempest-VolumesGetTestJSON-1105456292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:09:03 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [req-02148c47-f12e-4af7-9d6b-20e44acf80b6 req-59d126eb-61e6-4ab8-91c9-4dcff63c4658 tempest-VolumesGetTestJSON-1105456292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:09:03 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [req-02148c47-f12e-4af7-9d6b-20e44acf80b6 req-59d126eb-61e6-4ab8-91c9-4dcff63c4658 tempest-VolumesGetTestJSON-1105456292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:09:03 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [req-02148c47-f12e-4af7-9d6b-20e44acf80b6 req-59d126eb-61e6-4ab8-91c9-4dcff63c4658 tempest-VolumesGetTestJSON-1105456292 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:09:03 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [req-02148c47-f12e-4af7-9d6b-20e44acf80b6 req-59d126eb-61e6-4ab8-91c9-4dcff63c4658 tempest-VolumesGetTestJSON-1105456292 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:09:03 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-02148c47-f12e-4af7-9d6b-20e44acf80b6 req-59d126eb-61e6-4ab8-91c9-4dcff63c4658 tempest-VolumesGetTestJSON-1105456292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-d99014de-3b66-4262-a932-031c77d0e0b9 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:03 devstack sudo[89149]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:03 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e7206281-d3dd-4a3b-b157-91906f1b27c9 tempest-CreateVolumesFromSnapshotTest-85329515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3db0ed2e-f79e-485f-8f27-6b95993b5041" returned: 0 in 0.771s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:03 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e7206281-d3dd-4a3b-b157-91906f1b27c9 tempest-CreateVolumesFromSnapshotTest-85329515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3db0ed2e-f79e-485f-8f27-6b95993b5041 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:03 devstack sudo[89158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-d99014de-3b66-4262-a932-031c77d0e0b9 1073741824
Apr 28 22:09:03 devstack sudo[89158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:03 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a094c136-0472-4a6f-9d2e-ad72044355f1 tempest-VolumesNegativeTest-2135850914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c129699d-03dc-48ab-8de5-03f9f271f09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a25a468-d4f0-4138-b7bf-67cc2af32574', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:09:03 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a094c136-0472-4a6f-9d2e-ad72044355f1 tempest-VolumesNegativeTest-2135850914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c160a57-40b8-45f5-b636-fcfff59e488b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:09:03 devstack sudo[89159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3db0ed2e-f79e-485f-8f27-6b95993b5041
Apr 28 22:09:03 devstack sudo[89159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:03 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-a094c136-0472-4a6f-9d2e-ad72044355f1 tempest-VolumesNegativeTest-2135850914 None] Volume volume-8a25a468-d4f0-4138-b7bf-67cc2af32574 (8a25a468-d4f0-4138-b7bf-67cc2af32574): created successfully
Apr 28 22:09:03 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a094c136-0472-4a6f-9d2e-ad72044355f1 tempest-VolumesNegativeTest-2135850914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c160a57-40b8-45f5-b636-fcfff59e488b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:09:03 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a094c136-0472-4a6f-9d2e-ad72044355f1 tempest-VolumesNegativeTest-2135850914 None] Flow 'volume_create_manager' (51427141-6491-461f-b907-09d78033685f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:09:03 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-a094c136-0472-4a6f-9d2e-ad72044355f1 tempest-VolumesNegativeTest-2135850914 None] Created volume successfully.
Apr 28 22:09:04 devstack sudo[89159]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:04 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e7206281-d3dd-4a3b-b157-91906f1b27c9 tempest-CreateVolumesFromSnapshotTest-85329515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3db0ed2e-f79e-485f-8f27-6b95993b5041" returned: 0 in 0.610s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:04 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-e7206281-d3dd-4a3b-b157-91906f1b27c9 tempest-CreateVolumesFromSnapshotTest-85329515 None] Lock "cinder-quobyte-3db0ed2e-f79e-485f-8f27-6b95993b5041" released by "delete_volume" :: held 1.484s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:09:04 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-16a4f605-bddf-4b36-9f62-12505f7d9b94 tempest-GroupSnapshotsTest-1124623539 None] Update group completed successfully.
Apr 28 22:09:04 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-e7206281-d3dd-4a3b-b157-91906f1b27c9 tempest-CreateVolumesFromSnapshotTest-85329515 None] Created reservations ['8b0f5eb2-419e-4193-b7c3-834e2270dbff', '5f269aef-f0d5-4dd0-9269-a053107eebc9', '954a3080-ff56-4098-a8ed-c98ed437e907', '5116b842-467f-4109-9fef-09173e020ade'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:09:04 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-e7206281-d3dd-4a3b-b157-91906f1b27c9 tempest-CreateVolumesFromSnapshotTest-85329515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:09:04 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-e7206281-d3dd-4a3b-b157-91906f1b27c9 tempest-CreateVolumesFromSnapshotTest-85329515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:09:04 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-e7206281-d3dd-4a3b-b157-91906f1b27c9 tempest-CreateVolumesFromSnapshotTest-85329515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:09:04 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-e7206281-d3dd-4a3b-b157-91906f1b27c9 tempest-CreateVolumesFromSnapshotTest-85329515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:09:04 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-e7206281-d3dd-4a3b-b157-91906f1b27c9 tempest-CreateVolumesFromSnapshotTest-85329515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:09:04 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e7206281-d3dd-4a3b-b157-91906f1b27c9 tempest-CreateVolumesFromSnapshotTest-85329515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:04 devstack sudo[89167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:09:04 devstack sudo[89167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:04 devstack sudo[89158]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:04 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-02148c47-f12e-4af7-9d6b-20e44acf80b6 req-59d126eb-61e6-4ab8-91c9-4dcff63c4658 tempest-VolumesGetTestJSON-1105456292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-d99014de-3b66-4262-a932-031c77d0e0b9 1073741824" returned: 0 in 0.842s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:04 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-02148c47-f12e-4af7-9d6b-20e44acf80b6 req-59d126eb-61e6-4ab8-91c9-4dcff63c4658 tempest-VolumesGetTestJSON-1105456292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-d99014de-3b66-4262-a932-031c77d0e0b9 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:04 devstack sudo[89169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-d99014de-3b66-4262-a932-031c77d0e0b9
Apr 28 22:09:04 devstack sudo[89169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:04 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-e716e2e7-8ca4-400a-b474-e2a3a5821db2 tempest-CreateVolumesFromSnapshotTest-85329515 None] Acquiring lock "cinder-22042486-089a-4e58-8d17-91d0e4991998-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:09:04 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-e716e2e7-8ca4-400a-b474-e2a3a5821db2 tempest-CreateVolumesFromSnapshotTest-85329515 None] Lock "cinder-22042486-089a-4e58-8d17-91d0e4991998-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:09:05 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-e716e2e7-8ca4-400a-b474-e2a3a5821db2 tempest-CreateVolumesFromSnapshotTest-85329515 None] Acquiring lock "cinder-quobyte-22042486-089a-4e58-8d17-91d0e4991998" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:09:05 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-e716e2e7-8ca4-400a-b474-e2a3a5821db2 tempest-CreateVolumesFromSnapshotTest-85329515 None] Lock "cinder-quobyte-22042486-089a-4e58-8d17-91d0e4991998" acquired by "delete_volume" :: waited 0.025s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:09:05 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e9ff48-3be6-4ac0-a97d-7da4dc552d86]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:09:05 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e716e2e7-8ca4-400a-b474-e2a3a5821db2 tempest-CreateVolumesFromSnapshotTest-85329515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-22042486-089a-4e58-8d17-91d0e4991998 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:05 devstack sudo[89169]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:05 devstack sudo[89167]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:05 devstack sudo[89171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-22042486-089a-4e58-8d17-91d0e4991998
Apr 28 22:09:05 devstack sudo[89171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:05 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e7206281-d3dd-4a3b-b157-91906f1b27c9 tempest-CreateVolumesFromSnapshotTest-85329515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.822s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:05 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-02148c47-f12e-4af7-9d6b-20e44acf80b6 req-59d126eb-61e6-4ab8-91c9-4dcff63c4658 tempest-VolumesGetTestJSON-1105456292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-d99014de-3b66-4262-a932-031c77d0e0b9" returned: 0 in 0.705s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:05 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-e7206281-d3dd-4a3b-b157-91906f1b27c9 tempest-CreateVolumesFromSnapshotTest-85329515 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:09:05 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [req-02148c47-f12e-4af7-9d6b-20e44acf80b6 req-59d126eb-61e6-4ab8-91c9-4dcff63c4658 tempest-VolumesGetTestJSON-1105456292 None] <== create_volume: return (1605ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:09:05 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [req-02148c47-f12e-4af7-9d6b-20e44acf80b6 req-59d126eb-61e6-4ab8-91c9-4dcff63c4658 tempest-VolumesGetTestJSON-1105456292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.607s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:09:05 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-e7206281-d3dd-4a3b-b157-91906f1b27c9 tempest-CreateVolumesFromSnapshotTest-85329515 None] Deleted volume successfully.
Apr 28 22:09:05 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [req-02148c47-f12e-4af7-9d6b-20e44acf80b6 req-59d126eb-61e6-4ab8-91c9-4dcff63c4658 tempest-VolumesGetTestJSON-1105456292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edcc4196-4016-4db9-a7e5-ace4df48ec73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d99014de-3b66-4262-a932-031c77d0e0b9', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:09:05 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [req-02148c47-f12e-4af7-9d6b-20e44acf80b6 req-59d126eb-61e6-4ab8-91c9-4dcff63c4658 tempest-VolumesGetTestJSON-1105456292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f70c282d-a427-4329-9545-7d3e6f6510af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:09:05 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-e7206281-d3dd-4a3b-b157-91906f1b27c9 tempest-CreateVolumesFromSnapshotTest-85329515 None] Lock "cinder-3db0ed2e-f79e-485f-8f27-6b95993b5041-delete_volume" released by "delete_volume" :: held 2.644s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:09:05 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [req-02148c47-f12e-4af7-9d6b-20e44acf80b6 req-59d126eb-61e6-4ab8-91c9-4dcff63c4658 tempest-VolumesGetTestJSON-1105456292 None] Volume volume-d99014de-3b66-4262-a932-031c77d0e0b9 (d99014de-3b66-4262-a932-031c77d0e0b9): created successfully
Apr 28 22:09:05 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [req-02148c47-f12e-4af7-9d6b-20e44acf80b6 req-59d126eb-61e6-4ab8-91c9-4dcff63c4658 tempest-VolumesGetTestJSON-1105456292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f70c282d-a427-4329-9545-7d3e6f6510af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:09:05 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [req-02148c47-f12e-4af7-9d6b-20e44acf80b6 req-59d126eb-61e6-4ab8-91c9-4dcff63c4658 tempest-VolumesGetTestJSON-1105456292 None] Flow 'volume_create_manager' (9b2add66-eb97-4ed8-89fb-263914a02461) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:09:05 devstack cinder-volume[83924]: INFO cinder.volume.manager [req-02148c47-f12e-4af7-9d6b-20e44acf80b6 req-59d126eb-61e6-4ab8-91c9-4dcff63c4658 tempest-VolumesGetTestJSON-1105456292 None] Created volume successfully.
Apr 28 22:09:05 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-098eb727-bfa5-4584-ba07-fc0b6c477ecb tempest-GroupSnapshotsTest-1124623539 None] Update group completed successfully.
Apr 28 22:09:05 devstack sudo[89171]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:05 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e716e2e7-8ca4-400a-b474-e2a3a5821db2 tempest-CreateVolumesFromSnapshotTest-85329515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-22042486-089a-4e58-8d17-91d0e4991998" returned: 0 in 0.802s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:05 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e716e2e7-8ca4-400a-b474-e2a3a5821db2 tempest-CreateVolumesFromSnapshotTest-85329515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-22042486-089a-4e58-8d17-91d0e4991998 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:05 devstack sudo[89180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-22042486-089a-4e58-8d17-91d0e4991998
Apr 28 22:09:05 devstack sudo[89180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:06 devstack cinder-volume[83924]: DEBUG cinder.coordination [req-1ffc03d9-76e8-4409-9149-f24bae725e4f req-1cc6a834-3118-49da-99ad-7ec8829ba22b tempest-VolumesGetTestJSON-1105456292 None] Acquiring lock "cinder-d99014de-3b66-4262-a932-031c77d0e0b9-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:09:06 devstack cinder-volume[83924]: DEBUG cinder.coordination [req-1ffc03d9-76e8-4409-9149-f24bae725e4f req-1cc6a834-3118-49da-99ad-7ec8829ba22b tempest-VolumesGetTestJSON-1105456292 None] Lock "cinder-d99014de-3b66-4262-a932-031c77d0e0b9-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:09:06 devstack cinder-volume[83924]: DEBUG cinder.coordination [req-1ffc03d9-76e8-4409-9149-f24bae725e4f req-1cc6a834-3118-49da-99ad-7ec8829ba22b tempest-VolumesGetTestJSON-1105456292 None] Acquiring lock "cinder-quobyte-d99014de-3b66-4262-a932-031c77d0e0b9" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:09:06 devstack cinder-volume[83924]: DEBUG cinder.coordination [req-1ffc03d9-76e8-4409-9149-f24bae725e4f req-1cc6a834-3118-49da-99ad-7ec8829ba22b tempest-VolumesGetTestJSON-1105456292 None] Lock "cinder-quobyte-d99014de-3b66-4262-a932-031c77d0e0b9" acquired by "delete_volume" :: waited 0.021s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:09:06 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5426ae6-7cb1-4d3f-9503-b63c1bc55cfd]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:09:06 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-1ffc03d9-76e8-4409-9149-f24bae725e4f req-1cc6a834-3118-49da-99ad-7ec8829ba22b tempest-VolumesGetTestJSON-1105456292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-d99014de-3b66-4262-a932-031c77d0e0b9 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:06 devstack sudo[89180]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:06 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e716e2e7-8ca4-400a-b474-e2a3a5821db2 tempest-CreateVolumesFromSnapshotTest-85329515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-22042486-089a-4e58-8d17-91d0e4991998" returned: 0 in 0.666s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:06 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-e716e2e7-8ca4-400a-b474-e2a3a5821db2 tempest-CreateVolumesFromSnapshotTest-85329515 None] Lock "cinder-quobyte-22042486-089a-4e58-8d17-91d0e4991998" released by "delete_volume" :: held 1.541s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:09:06 devstack sudo[89183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-d99014de-3b66-4262-a932-031c77d0e0b9
Apr 28 22:09:06 devstack sudo[89183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:06 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-e716e2e7-8ca4-400a-b474-e2a3a5821db2 tempest-CreateVolumesFromSnapshotTest-85329515 None] Created reservations ['3ce182a5-0faf-4066-8329-4dfebaa750c7', '2e01a0ee-f2e4-4af9-a8b1-d5a694e5feb7', 'f9b64cb2-ae71-4f01-a381-3c88a1024149', '00455099-c4b9-4c9f-8a97-b9f657a877d2'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:09:06 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-e716e2e7-8ca4-400a-b474-e2a3a5821db2 tempest-CreateVolumesFromSnapshotTest-85329515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:09:06 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-e716e2e7-8ca4-400a-b474-e2a3a5821db2 tempest-CreateVolumesFromSnapshotTest-85329515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:09:06 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-e716e2e7-8ca4-400a-b474-e2a3a5821db2 tempest-CreateVolumesFromSnapshotTest-85329515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:09:06 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-e716e2e7-8ca4-400a-b474-e2a3a5821db2 tempest-CreateVolumesFromSnapshotTest-85329515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:09:06 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-e716e2e7-8ca4-400a-b474-e2a3a5821db2 tempest-CreateVolumesFromSnapshotTest-85329515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:09:06 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e716e2e7-8ca4-400a-b474-e2a3a5821db2 tempest-CreateVolumesFromSnapshotTest-85329515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:06 devstack sudo[89185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:09:06 devstack sudo[89185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:06 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-62e127a3-4ae2-4dc4-b9db-d206e361645f tempest-GroupSnapshotsTest-1124623539 None] Update group completed successfully.
Apr 28 22:09:07 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-57c59b80-ec0c-4f6d-838a-c5714fe29d40 tempest-CreateVolumesFromSnapshotTest-85329515 None] Acquiring lock "cinder-ca01f749-1625-436b-ac91-bfcc1efdde89-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:09:07 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-57c59b80-ec0c-4f6d-838a-c5714fe29d40 tempest-CreateVolumesFromSnapshotTest-85329515 None] Lock "cinder-ca01f749-1625-436b-ac91-bfcc1efdde89-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:09:07 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-57c59b80-ec0c-4f6d-838a-c5714fe29d40 tempest-CreateVolumesFromSnapshotTest-85329515 None] Acquiring lock "cinder-quobyte-ca01f749-1625-436b-ac91-bfcc1efdde89" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:09:07 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-57c59b80-ec0c-4f6d-838a-c5714fe29d40 tempest-CreateVolumesFromSnapshotTest-85329515 None] Lock "cinder-quobyte-ca01f749-1625-436b-ac91-bfcc1efdde89" acquired by "delete_volume" :: waited 0.017s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:09:07 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9995220b-788a-4d30-94a2-6abfe3369ae6]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:09:07 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-57c59b80-ec0c-4f6d-838a-c5714fe29d40 tempest-CreateVolumesFromSnapshotTest-85329515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ca01f749-1625-436b-ac91-bfcc1efdde89 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:07 devstack sudo[89183]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:07 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-1ffc03d9-76e8-4409-9149-f24bae725e4f req-1cc6a834-3118-49da-99ad-7ec8829ba22b tempest-VolumesGetTestJSON-1105456292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-d99014de-3b66-4262-a932-031c77d0e0b9" returned: 0 in 0.821s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:07 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-1ffc03d9-76e8-4409-9149-f24bae725e4f req-1cc6a834-3118-49da-99ad-7ec8829ba22b tempest-VolumesGetTestJSON-1105456292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-d99014de-3b66-4262-a932-031c77d0e0b9 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:07 devstack sudo[89191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-d99014de-3b66-4262-a932-031c77d0e0b9
Apr 28 22:09:07 devstack sudo[89191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:07 devstack sudo[89190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ca01f749-1625-436b-ac91-bfcc1efdde89
Apr 28 22:09:07 devstack sudo[89190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:07 devstack sudo[89185]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:07 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e716e2e7-8ca4-400a-b474-e2a3a5821db2 tempest-CreateVolumesFromSnapshotTest-85329515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.668s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:07 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-e716e2e7-8ca4-400a-b474-e2a3a5821db2 tempest-CreateVolumesFromSnapshotTest-85329515 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:09:07 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-e716e2e7-8ca4-400a-b474-e2a3a5821db2 tempest-CreateVolumesFromSnapshotTest-85329515 None] Deleted volume successfully.
Apr 28 22:09:07 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-e716e2e7-8ca4-400a-b474-e2a3a5821db2 tempest-CreateVolumesFromSnapshotTest-85329515 None] Lock "cinder-22042486-089a-4e58-8d17-91d0e4991998-delete_volume" released by "delete_volume" :: held 2.544s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:09:07 devstack sudo[89191]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:07 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-1ffc03d9-76e8-4409-9149-f24bae725e4f req-1cc6a834-3118-49da-99ad-7ec8829ba22b tempest-VolumesGetTestJSON-1105456292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-d99014de-3b66-4262-a932-031c77d0e0b9" returned: 0 in 0.654s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:07 devstack cinder-volume[83924]: DEBUG cinder.coordination [req-1ffc03d9-76e8-4409-9149-f24bae725e4f req-1cc6a834-3118-49da-99ad-7ec8829ba22b tempest-VolumesGetTestJSON-1105456292 None] Lock "cinder-quobyte-d99014de-3b66-4262-a932-031c77d0e0b9" released by "delete_volume" :: held 1.532s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:09:08 devstack cinder-volume[83924]: DEBUG cinder.quota [req-1ffc03d9-76e8-4409-9149-f24bae725e4f req-1cc6a834-3118-49da-99ad-7ec8829ba22b tempest-VolumesGetTestJSON-1105456292 None] Created reservations ['4ca87cf6-13f0-4c44-9f6a-5f0c5bd83062', '2efb6b50-7da4-469b-b26b-48e4332ae881', 'e4ec3592-f775-492e-8dc5-ba23f48defb3', 'bdb8f194-fffc-4811-bdd6-173f664c513e'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:09:08 devstack sudo[89190]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:08 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-57c59b80-ec0c-4f6d-838a-c5714fe29d40 tempest-CreateVolumesFromSnapshotTest-85329515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ca01f749-1625-436b-ac91-bfcc1efdde89" returned: 0 in 0.802s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:08 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-57c59b80-ec0c-4f6d-838a-c5714fe29d40 tempest-CreateVolumesFromSnapshotTest-85329515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ca01f749-1625-436b-ac91-bfcc1efdde89 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:08 devstack sudo[89199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ca01f749-1625-436b-ac91-bfcc1efdde89
Apr 28 22:09:08 devstack sudo[89199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:08 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [req-1ffc03d9-76e8-4409-9149-f24bae725e4f req-1cc6a834-3118-49da-99ad-7ec8829ba22b tempest-VolumesGetTestJSON-1105456292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:09:08 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [req-1ffc03d9-76e8-4409-9149-f24bae725e4f req-1cc6a834-3118-49da-99ad-7ec8829ba22b tempest-VolumesGetTestJSON-1105456292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:09:08 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [req-1ffc03d9-76e8-4409-9149-f24bae725e4f req-1cc6a834-3118-49da-99ad-7ec8829ba22b tempest-VolumesGetTestJSON-1105456292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:09:08 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [req-1ffc03d9-76e8-4409-9149-f24bae725e4f req-1cc6a834-3118-49da-99ad-7ec8829ba22b tempest-VolumesGetTestJSON-1105456292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:09:08 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [req-1ffc03d9-76e8-4409-9149-f24bae725e4f req-1cc6a834-3118-49da-99ad-7ec8829ba22b tempest-VolumesGetTestJSON-1105456292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:09:08 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-1ffc03d9-76e8-4409-9149-f24bae725e4f req-1cc6a834-3118-49da-99ad-7ec8829ba22b tempest-VolumesGetTestJSON-1105456292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:08 devstack sudo[89201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:09:08 devstack sudo[89201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:08 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-1eab8769-8d4f-4d49-a934-f9234dedc6ca tempest-GroupSnapshotsTest-1124623539 None] GroupSnapshot 5a74552b-862f-4311-934f-a4322429ce81: creating.
Apr 28 22:09:08 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-1eab8769-8d4f-4d49-a934-f9234dedc6ca tempest-GroupSnapshotsTest-1124623539 None] Group snapshot 5a74552b-862f-4311-934f-a4322429ce81: creating. {{(pid=83924) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 28 22:09:08 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-1eab8769-8d4f-4d49-a934-f9234dedc6ca tempest-GroupSnapshotsTest-1124623539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:09:08 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-1eab8769-8d4f-4d49-a934-f9234dedc6ca tempest-GroupSnapshotsTest-1124623539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:09:08 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-1eab8769-8d4f-4d49-a934-f9234dedc6ca tempest-GroupSnapshotsTest-1124623539 None] Creating offline snapshot 29098727-1769-486f-adbb-446ebd611d27 of volume 5a543d85-dde5-42ff-b2ad-33b0771e18d9 {{(pid=83924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 22:09:08 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6c3edd-0058-453b-b584-ce9bbdf05b57]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:09:08 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-1eab8769-8d4f-4d49-a934-f9234dedc6ca tempest-GroupSnapshotsTest-1124623539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-5a543d85-dde5-42ff-b2ad-33b0771e18d9 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:08 devstack sudo[89203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-5a543d85-dde5-42ff-b2ad-33b0771e18d9
Apr 28 22:09:08 devstack sudo[89203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:08 devstack sudo[89199]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:08 devstack sudo[89201]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:08 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-57c59b80-ec0c-4f6d-838a-c5714fe29d40 tempest-CreateVolumesFromSnapshotTest-85329515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ca01f749-1625-436b-ac91-bfcc1efdde89" returned: 0 in 0.747s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:08 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [req-1ffc03d9-76e8-4409-9149-f24bae725e4f req-1cc6a834-3118-49da-99ad-7ec8829ba22b tempest-VolumesGetTestJSON-1105456292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.714s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:08 devstack cinder-volume[83924]: DEBUG cinder.manager [req-1ffc03d9-76e8-4409-9149-f24bae725e4f req-1cc6a834-3118-49da-99ad-7ec8829ba22b tempest-VolumesGetTestJSON-1105456292 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:09:08 devstack cinder-volume[83924]: INFO cinder.volume.manager [req-1ffc03d9-76e8-4409-9149-f24bae725e4f req-1cc6a834-3118-49da-99ad-7ec8829ba22b tempest-VolumesGetTestJSON-1105456292 None] Deleted volume successfully.
Apr 28 22:09:08 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-57c59b80-ec0c-4f6d-838a-c5714fe29d40 tempest-CreateVolumesFromSnapshotTest-85329515 None] Lock "cinder-quobyte-ca01f749-1625-436b-ac91-bfcc1efdde89" released by "delete_volume" :: held 1.609s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:09:08 devstack cinder-volume[83924]: DEBUG cinder.coordination [req-1ffc03d9-76e8-4409-9149-f24bae725e4f req-1cc6a834-3118-49da-99ad-7ec8829ba22b tempest-VolumesGetTestJSON-1105456292 None] Lock "cinder-d99014de-3b66-4262-a932-031c77d0e0b9-delete_volume" released by "delete_volume" :: held 2.518s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:09:08 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-57c59b80-ec0c-4f6d-838a-c5714fe29d40 tempest-CreateVolumesFromSnapshotTest-85329515 None] Created reservations ['9308fc92-7b65-4685-b756-2f57cd7b47fe', 'aa9f1554-b26d-408c-93e9-37f045b708c6', '66effe2e-d121-47bb-8c49-3c9b218761e8', '428e057e-d636-4339-ad9d-ae679aef7cdc'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:09:09 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-57c59b80-ec0c-4f6d-838a-c5714fe29d40 tempest-CreateVolumesFromSnapshotTest-85329515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:09:09 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-57c59b80-ec0c-4f6d-838a-c5714fe29d40 tempest-CreateVolumesFromSnapshotTest-85329515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:09:09 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-57c59b80-ec0c-4f6d-838a-c5714fe29d40 tempest-CreateVolumesFromSnapshotTest-85329515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:09:09 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-57c59b80-ec0c-4f6d-838a-c5714fe29d40 tempest-CreateVolumesFromSnapshotTest-85329515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:09:09 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-57c59b80-ec0c-4f6d-838a-c5714fe29d40 tempest-CreateVolumesFromSnapshotTest-85329515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:09:09 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-57c59b80-ec0c-4f6d-838a-c5714fe29d40 tempest-CreateVolumesFromSnapshotTest-85329515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:09 devstack sudo[89210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:09:09 devstack sudo[89210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:09 devstack sudo[89203]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:09 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-1eab8769-8d4f-4d49-a934-f9234dedc6ca tempest-GroupSnapshotsTest-1124623539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-5a543d85-dde5-42ff-b2ad-33b0771e18d9" returned: 0 in 0.824s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:09 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-1eab8769-8d4f-4d49-a934-f9234dedc6ca tempest-GroupSnapshotsTest-1124623539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-5a543d85-dde5-42ff-b2ad-33b0771e18d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-5a543d85-dde5-42ff-b2ad-33b0771e18d9.29098727-1769-486f-adbb-446ebd611d27 1G {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:09 devstack sudo[89212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-5a543d85-dde5-42ff-b2ad-33b0771e18d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-5a543d85-dde5-42ff-b2ad-33b0771e18d9.29098727-1769-486f-adbb-446ebd611d27 1G
Apr 28 22:09:09 devstack sudo[89212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:09 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-fe0f7a07-dfac-4a0a-b7a8-a15847815b0c tempest-CreateVolumesFromSnapshotTest-85329515 None] Acquiring lock "cinder-eb4b9bf3-299a-4b10-9dce-d56254d7d406-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:09:09 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-fe0f7a07-dfac-4a0a-b7a8-a15847815b0c tempest-CreateVolumesFromSnapshotTest-85329515 None] Lock "cinder-eb4b9bf3-299a-4b10-9dce-d56254d7d406-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:09:09 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-fe0f7a07-dfac-4a0a-b7a8-a15847815b0c tempest-CreateVolumesFromSnapshotTest-85329515 None] Acquiring lock "cinder-quobyte-eb4b9bf3-299a-4b10-9dce-d56254d7d406" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:09:09 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-fe0f7a07-dfac-4a0a-b7a8-a15847815b0c tempest-CreateVolumesFromSnapshotTest-85329515 None] Lock "cinder-quobyte-eb4b9bf3-299a-4b10-9dce-d56254d7d406" acquired by "delete_volume" :: waited 0.022s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:09:09 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[589bfefc-680c-402f-bb74-b6303db58fd4]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:09:09 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-fe0f7a07-dfac-4a0a-b7a8-a15847815b0c tempest-CreateVolumesFromSnapshotTest-85329515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-eb4b9bf3-299a-4b10-9dce-d56254d7d406 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:09 devstack sudo[89210]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:09 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-57c59b80-ec0c-4f6d-838a-c5714fe29d40 tempest-CreateVolumesFromSnapshotTest-85329515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.691s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:09 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-57c59b80-ec0c-4f6d-838a-c5714fe29d40 tempest-CreateVolumesFromSnapshotTest-85329515 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:09:09 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-57c59b80-ec0c-4f6d-838a-c5714fe29d40 tempest-CreateVolumesFromSnapshotTest-85329515 None] Deleted volume successfully.
Apr 28 22:09:09 devstack sudo[89215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-eb4b9bf3-299a-4b10-9dce-d56254d7d406
Apr 28 22:09:09 devstack sudo[89215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:09 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-57c59b80-ec0c-4f6d-838a-c5714fe29d40 tempest-CreateVolumesFromSnapshotTest-85329515 None] Lock "cinder-ca01f749-1625-436b-ac91-bfcc1efdde89-delete_volume" released by "delete_volume" :: held 2.542s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:09:10 devstack sudo[89212]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:10 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-1eab8769-8d4f-4d49-a934-f9234dedc6ca tempest-GroupSnapshotsTest-1124623539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-5a543d85-dde5-42ff-b2ad-33b0771e18d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-5a543d85-dde5-42ff-b2ad-33b0771e18d9.29098727-1769-486f-adbb-446ebd611d27 1G" returned: 0 in 1.047s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:10 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-1eab8769-8d4f-4d49-a934-f9234dedc6ca tempest-GroupSnapshotsTest-1124623539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a543d85-dde5-42ff-b2ad-33b0771e18d9 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-5a543d85-dde5-42ff-b2ad-33b0771e18d9.29098727-1769-486f-adbb-446ebd611d27 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:10 devstack sudo[89220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a543d85-dde5-42ff-b2ad-33b0771e18d9 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-5a543d85-dde5-42ff-b2ad-33b0771e18d9.29098727-1769-486f-adbb-446ebd611d27
Apr 28 22:09:10 devstack sudo[89220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:10 devstack sudo[89215]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:10 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-fe0f7a07-dfac-4a0a-b7a8-a15847815b0c tempest-CreateVolumesFromSnapshotTest-85329515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-eb4b9bf3-299a-4b10-9dce-d56254d7d406" returned: 0 in 0.921s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:10 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-fe0f7a07-dfac-4a0a-b7a8-a15847815b0c tempest-CreateVolumesFromSnapshotTest-85329515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-eb4b9bf3-299a-4b10-9dce-d56254d7d406 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:10 devstack sudo[89225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-eb4b9bf3-299a-4b10-9dce-d56254d7d406
Apr 28 22:09:10 devstack sudo[89225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:11 devstack sudo[89220]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:11 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-1eab8769-8d4f-4d49-a934-f9234dedc6ca tempest-GroupSnapshotsTest-1124623539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a543d85-dde5-42ff-b2ad-33b0771e18d9 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-5a543d85-dde5-42ff-b2ad-33b0771e18d9.29098727-1769-486f-adbb-446ebd611d27" returned: 0 in 0.864s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:11 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-1eab8769-8d4f-4d49-a934-f9234dedc6ca tempest-GroupSnapshotsTest-1124623539 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-5a543d85-dde5-42ff-b2ad-33b0771e18d9.29098727-1769-486f-adbb-446ebd611d27 is being set with open permissions: ugo+rw: NotImplementedError
Apr 28 22:09:11 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-1eab8769-8d4f-4d49-a934-f9234dedc6ca tempest-GroupSnapshotsTest-1124623539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-5a543d85-dde5-42ff-b2ad-33b0771e18d9.29098727-1769-486f-adbb-446ebd611d27 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:11 devstack sudo[89231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-5a543d85-dde5-42ff-b2ad-33b0771e18d9.29098727-1769-486f-adbb-446ebd611d27
Apr 28 22:09:11 devstack sudo[89231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:11 devstack sudo[89225]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:11 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-fe0f7a07-dfac-4a0a-b7a8-a15847815b0c tempest-CreateVolumesFromSnapshotTest-85329515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-eb4b9bf3-299a-4b10-9dce-d56254d7d406" returned: 0 in 0.790s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:11 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-fe0f7a07-dfac-4a0a-b7a8-a15847815b0c tempest-CreateVolumesFromSnapshotTest-85329515 None] Lock "cinder-quobyte-eb4b9bf3-299a-4b10-9dce-d56254d7d406" released by "delete_volume" :: held 1.774s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:09:11 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-fe0f7a07-dfac-4a0a-b7a8-a15847815b0c tempest-CreateVolumesFromSnapshotTest-85329515 None] Created reservations ['f171bdb0-764d-4214-8dcb-4344ddc3f7eb', '888b2b9f-6fc3-4307-8616-9d7b69838745', 'f583479a-cc3e-4e60-ae06-b5881173451e', 'e0910338-e60a-4158-abf3-7391dd30a583'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:09:11 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-fe0f7a07-dfac-4a0a-b7a8-a15847815b0c tempest-CreateVolumesFromSnapshotTest-85329515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:09:11 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-fe0f7a07-dfac-4a0a-b7a8-a15847815b0c tempest-CreateVolumesFromSnapshotTest-85329515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:09:11 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-fe0f7a07-dfac-4a0a-b7a8-a15847815b0c tempest-CreateVolumesFromSnapshotTest-85329515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:09:11 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-fe0f7a07-dfac-4a0a-b7a8-a15847815b0c tempest-CreateVolumesFromSnapshotTest-85329515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:09:11 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-fe0f7a07-dfac-4a0a-b7a8-a15847815b0c tempest-CreateVolumesFromSnapshotTest-85329515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:09:11 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-fe0f7a07-dfac-4a0a-b7a8-a15847815b0c tempest-CreateVolumesFromSnapshotTest-85329515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:11 devstack sudo[89234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:09:11 devstack sudo[89234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:11 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-23d320ad-4dde-4ffc-8b40-36f92f6d052d tempest-CreateVolumesFromSnapshotTest-85329515 None] Acquiring lock "cinder-0bd0d8c3-6de2-445a-908e-8f8e0a4bf49d-delete_snapshot" by "delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:09:11 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-23d320ad-4dde-4ffc-8b40-36f92f6d052d tempest-CreateVolumesFromSnapshotTest-85329515 None] Lock "cinder-0bd0d8c3-6de2-445a-908e-8f8e0a4bf49d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:09:11 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-23d320ad-4dde-4ffc-8b40-36f92f6d052d tempest-CreateVolumesFromSnapshotTest-85329515 None] Acquiring lock "cinder-quobyte-bb1cbeed-da05-4254-b527-a54975ee9f9f" by "delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:09:11 devstack sudo[89231]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:11 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-1eab8769-8d4f-4d49-a934-f9234dedc6ca tempest-GroupSnapshotsTest-1124623539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-5a543d85-dde5-42ff-b2ad-33b0771e18d9.29098727-1769-486f-adbb-446ebd611d27" returned: 0 in 0.846s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:11 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-23d320ad-4dde-4ffc-8b40-36f92f6d052d tempest-CreateVolumesFromSnapshotTest-85329515 None] Lock "cinder-quobyte-bb1cbeed-da05-4254-b527-a54975ee9f9f" acquired by "delete_snapshot" :: waited 0.074s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:09:11 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-23d320ad-4dde-4ffc-8b40-36f92f6d052d tempest-CreateVolumesFromSnapshotTest-85329515 None] Acquiring lock "cinder-quobyte-0bd0d8c3-6de2-445a-908e-8f8e0a4bf49d" by "_delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:09:11 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-23d320ad-4dde-4ffc-8b40-36f92f6d052d tempest-CreateVolumesFromSnapshotTest-85329515 None] Lock "cinder-quobyte-0bd0d8c3-6de2-445a-908e-8f8e0a4bf49d" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:09:11 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-23d320ad-4dde-4ffc-8b40-36f92f6d052d tempest-CreateVolumesFromSnapshotTest-85329515 None] Deleting offline snapshot 0bd0d8c3-6de2-445a-908e-8f8e0a4bf49d of volume bb1cbeed-da05-4254-b527-a54975ee9f9f {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 22:09:11 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-23d320ad-4dde-4ffc-8b40-36f92f6d052d tempest-CreateVolumesFromSnapshotTest-85329515 None] snapshot_file for this snap is: volume-bb1cbeed-da05-4254-b527-a54975ee9f9f.0bd0d8c3-6de2-445a-908e-8f8e0a4bf49d {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 22:09:11 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-1eab8769-8d4f-4d49-a934-f9234dedc6ca tempest-GroupSnapshotsTest-1124623539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-5a543d85-dde5-42ff-b2ad-33b0771e18d9.info {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:11 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f30f87-8136-4e7a-a410-a05269eab65c]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:09:11 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-23d320ad-4dde-4ffc-8b40-36f92f6d052d tempest-CreateVolumesFromSnapshotTest-85329515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-bb1cbeed-da05-4254-b527-a54975ee9f9f.0bd0d8c3-6de2-445a-908e-8f8e0a4bf49d {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:11 devstack sudo[89237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-5a543d85-dde5-42ff-b2ad-33b0771e18d9.info
Apr 28 22:09:11 devstack sudo[89237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:12 devstack sudo[89238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-bb1cbeed-da05-4254-b527-a54975ee9f9f.0bd0d8c3-6de2-445a-908e-8f8e0a4bf49d
Apr 28 22:09:12 devstack sudo[89238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:12 devstack sudo[89234]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:12 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-fe0f7a07-dfac-4a0a-b7a8-a15847815b0c tempest-CreateVolumesFromSnapshotTest-85329515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 1.052s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:12 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-fe0f7a07-dfac-4a0a-b7a8-a15847815b0c tempest-CreateVolumesFromSnapshotTest-85329515 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:09:12 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-fe0f7a07-dfac-4a0a-b7a8-a15847815b0c tempest-CreateVolumesFromSnapshotTest-85329515 None] Deleted volume successfully.
Apr 28 22:09:12 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-fe0f7a07-dfac-4a0a-b7a8-a15847815b0c tempest-CreateVolumesFromSnapshotTest-85329515 None] Lock "cinder-eb4b9bf3-299a-4b10-9dce-d56254d7d406-delete_volume" released by "delete_volume" :: held 3.176s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:09:13 devstack sudo[89238]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:13 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-23d320ad-4dde-4ffc-8b40-36f92f6d052d tempest-CreateVolumesFromSnapshotTest-85329515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-bb1cbeed-da05-4254-b527-a54975ee9f9f.0bd0d8c3-6de2-445a-908e-8f8e0a4bf49d" returned: 0 in 1.070s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:13 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-23d320ad-4dde-4ffc-8b40-36f92f6d052d tempest-CreateVolumesFromSnapshotTest-85329515 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb1cbeed-da05-4254-b527-a54975ee9f9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 22:09:13 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3ba409-9500-450a-9a50-e51c20439b40]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:09:13 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-23d320ad-4dde-4ffc-8b40-36f92f6d052d tempest-CreateVolumesFromSnapshotTest-85329515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-bb1cbeed-da05-4254-b527-a54975ee9f9f {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:13 devstack sudo[89237]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:13 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-1eab8769-8d4f-4d49-a934-f9234dedc6ca tempest-GroupSnapshotsTest-1124623539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-5a543d85-dde5-42ff-b2ad-33b0771e18d9.info" returned: 0 in 1.198s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:13 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-1eab8769-8d4f-4d49-a934-f9234dedc6ca tempest-GroupSnapshotsTest-1124623539 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-5a543d85-dde5-42ff-b2ad-33b0771e18d9.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 28 22:09:13 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-1eab8769-8d4f-4d49-a934-f9234dedc6ca tempest-GroupSnapshotsTest-1124623539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-5a543d85-dde5-42ff-b2ad-33b0771e18d9.info {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:13 devstack sudo[89263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-5a543d85-dde5-42ff-b2ad-33b0771e18d9.info
Apr 28 22:09:13 devstack sudo[89263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:13 devstack sudo[89259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-bb1cbeed-da05-4254-b527-a54975ee9f9f
Apr 28 22:09:13 devstack sudo[89259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:13 devstack sudo[89263]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:13 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-1eab8769-8d4f-4d49-a934-f9234dedc6ca tempest-GroupSnapshotsTest-1124623539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-5a543d85-dde5-42ff-b2ad-33b0771e18d9.info" returned: 0 in 0.715s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:13 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-1eab8769-8d4f-4d49-a934-f9234dedc6ca tempest-GroupSnapshotsTest-1124623539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.676s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:09:13 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-1eab8769-8d4f-4d49-a934-f9234dedc6ca tempest-GroupSnapshotsTest-1124623539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:09:13 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-1eab8769-8d4f-4d49-a934-f9234dedc6ca tempest-GroupSnapshotsTest-1124623539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:09:13 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-1eab8769-8d4f-4d49-a934-f9234dedc6ca tempest-GroupSnapshotsTest-1124623539 None] Creating offline snapshot 8aa4bc3b-e5cc-4acc-b3fd-fd30570b508e of volume df7dbed6-75ba-459e-abf4-58d8eca356b9 {{(pid=83924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 22:09:13 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c03614-9646-4107-b0bc-7a763a0285f8]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:09:13 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-1eab8769-8d4f-4d49-a934-f9234dedc6ca tempest-GroupSnapshotsTest-1124623539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-df7dbed6-75ba-459e-abf4-58d8eca356b9 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:14 devstack sudo[89259]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:14 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-23d320ad-4dde-4ffc-8b40-36f92f6d052d tempest-CreateVolumesFromSnapshotTest-85329515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-bb1cbeed-da05-4254-b527-a54975ee9f9f" returned: 0 in 0.918s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:14 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-23d320ad-4dde-4ffc-8b40-36f92f6d052d tempest-CreateVolumesFromSnapshotTest-85329515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-bb1cbeed-da05-4254-b527-a54975ee9f9f.0bd0d8c3-6de2-445a-908e-8f8e0a4bf49d {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:14 devstack sudo[89274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-bb1cbeed-da05-4254-b527-a54975ee9f9f.0bd0d8c3-6de2-445a-908e-8f8e0a4bf49d
Apr 28 22:09:14 devstack sudo[89274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:14 devstack sudo[89273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-df7dbed6-75ba-459e-abf4-58d8eca356b9
Apr 28 22:09:14 devstack sudo[89273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:14 devstack sudo[89273]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:14 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-1eab8769-8d4f-4d49-a934-f9234dedc6ca tempest-GroupSnapshotsTest-1124623539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-df7dbed6-75ba-459e-abf4-58d8eca356b9" returned: 0 in 1.041s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:15 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-1eab8769-8d4f-4d49-a934-f9234dedc6ca tempest-GroupSnapshotsTest-1124623539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-df7dbed6-75ba-459e-abf4-58d8eca356b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-df7dbed6-75ba-459e-abf4-58d8eca356b9.8aa4bc3b-e5cc-4acc-b3fd-fd30570b508e 1G {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:15 devstack sudo[89284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-df7dbed6-75ba-459e-abf4-58d8eca356b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-df7dbed6-75ba-459e-abf4-58d8eca356b9.8aa4bc3b-e5cc-4acc-b3fd-fd30570b508e 1G
Apr 28 22:09:15 devstack sudo[89284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:15 devstack sudo[89274]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:15 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-23d320ad-4dde-4ffc-8b40-36f92f6d052d tempest-CreateVolumesFromSnapshotTest-85329515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-bb1cbeed-da05-4254-b527-a54975ee9f9f.0bd0d8c3-6de2-445a-908e-8f8e0a4bf49d" returned: 0 in 1.057s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:15 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-23d320ad-4dde-4ffc-8b40-36f92f6d052d tempest-CreateVolumesFromSnapshotTest-85329515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-bb1cbeed-da05-4254-b527-a54975ee9f9f.0bd0d8c3-6de2-445a-908e-8f8e0a4bf49d {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:15 devstack sudo[89286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-bb1cbeed-da05-4254-b527-a54975ee9f9f.0bd0d8c3-6de2-445a-908e-8f8e0a4bf49d
Apr 28 22:09:15 devstack sudo[89286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:15 devstack sudo[89286]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:15 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-23d320ad-4dde-4ffc-8b40-36f92f6d052d tempest-CreateVolumesFromSnapshotTest-85329515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-bb1cbeed-da05-4254-b527-a54975ee9f9f.0bd0d8c3-6de2-445a-908e-8f8e0a4bf49d" returned: 0 in 0.734s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:15 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-23d320ad-4dde-4ffc-8b40-36f92f6d052d tempest-CreateVolumesFromSnapshotTest-85329515 None] Lock "cinder-quobyte-0bd0d8c3-6de2-445a-908e-8f8e0a4bf49d" released by "_delete_snapshot" :: held 3.944s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:09:15 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-23d320ad-4dde-4ffc-8b40-36f92f6d052d tempest-CreateVolumesFromSnapshotTest-85329515 None] Lock "cinder-quobyte-bb1cbeed-da05-4254-b527-a54975ee9f9f" released by "delete_snapshot" :: held 3.983s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:09:15 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-23d320ad-4dde-4ffc-8b40-36f92f6d052d tempest-CreateVolumesFromSnapshotTest-85329515 None] Created reservations ['ffd5708b-817b-432b-b63d-73de0edcbf6f', 'a78b3553-1858-4dd9-9368-7fcce5ea757f', '0dfade8d-9aa3-4b73-9698-e217470c29dd', '7c721615-571a-4da9-84e7-ee428223f51a'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:09:16 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-23d320ad-4dde-4ffc-8b40-36f92f6d052d tempest-CreateVolumesFromSnapshotTest-85329515 None] Delete snapshot completed successfully.
Apr 28 22:09:16 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-23d320ad-4dde-4ffc-8b40-36f92f6d052d tempest-CreateVolumesFromSnapshotTest-85329515 None] Lock "cinder-0bd0d8c3-6de2-445a-908e-8f8e0a4bf49d-delete_snapshot" released by "delete_snapshot" :: held 4.245s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:09:16 devstack sudo[89284]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:16 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-1eab8769-8d4f-4d49-a934-f9234dedc6ca tempest-GroupSnapshotsTest-1124623539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-df7dbed6-75ba-459e-abf4-58d8eca356b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-df7dbed6-75ba-459e-abf4-58d8eca356b9.8aa4bc3b-e5cc-4acc-b3fd-fd30570b508e 1G" returned: 0 in 1.061s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:16 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-1eab8769-8d4f-4d49-a934-f9234dedc6ca tempest-GroupSnapshotsTest-1124623539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df7dbed6-75ba-459e-abf4-58d8eca356b9 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-df7dbed6-75ba-459e-abf4-58d8eca356b9.8aa4bc3b-e5cc-4acc-b3fd-fd30570b508e {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:16 devstack sudo[89293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df7dbed6-75ba-459e-abf4-58d8eca356b9 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-df7dbed6-75ba-459e-abf4-58d8eca356b9.8aa4bc3b-e5cc-4acc-b3fd-fd30570b508e
Apr 28 22:09:16 devstack sudo[89293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:16 devstack sudo[89293]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:16 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-1eab8769-8d4f-4d49-a934-f9234dedc6ca tempest-GroupSnapshotsTest-1124623539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df7dbed6-75ba-459e-abf4-58d8eca356b9 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-df7dbed6-75ba-459e-abf4-58d8eca356b9.8aa4bc3b-e5cc-4acc-b3fd-fd30570b508e" returned: 0 in 0.748s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:16 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-1eab8769-8d4f-4d49-a934-f9234dedc6ca tempest-GroupSnapshotsTest-1124623539 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-df7dbed6-75ba-459e-abf4-58d8eca356b9.8aa4bc3b-e5cc-4acc-b3fd-fd30570b508e is being set with open permissions: ugo+rw: NotImplementedError
Apr 28 22:09:16 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-1eab8769-8d4f-4d49-a934-f9234dedc6ca tempest-GroupSnapshotsTest-1124623539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-df7dbed6-75ba-459e-abf4-58d8eca356b9.8aa4bc3b-e5cc-4acc-b3fd-fd30570b508e {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:16 devstack sudo[89299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-df7dbed6-75ba-459e-abf4-58d8eca356b9.8aa4bc3b-e5cc-4acc-b3fd-fd30570b508e
Apr 28 22:09:16 devstack sudo[89299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:17 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-7d99c9ed-7d4e-481a-b7ff-310e9d683226 tempest-CreateVolumesFromSnapshotTest-85329515 None] Acquiring lock "cinder-bb1cbeed-da05-4254-b527-a54975ee9f9f-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:09:17 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-7d99c9ed-7d4e-481a-b7ff-310e9d683226 tempest-CreateVolumesFromSnapshotTest-85329515 None] Lock "cinder-bb1cbeed-da05-4254-b527-a54975ee9f9f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:09:17 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-7d99c9ed-7d4e-481a-b7ff-310e9d683226 tempest-CreateVolumesFromSnapshotTest-85329515 None] Acquiring lock "cinder-quobyte-bb1cbeed-da05-4254-b527-a54975ee9f9f" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:09:17 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-7d99c9ed-7d4e-481a-b7ff-310e9d683226 tempest-CreateVolumesFromSnapshotTest-85329515 None] Lock "cinder-quobyte-bb1cbeed-da05-4254-b527-a54975ee9f9f" acquired by "delete_volume" :: waited 0.021s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:09:17 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d776093a-fc4f-44b6-abc1-075cecf10454]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:09:17 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7d99c9ed-7d4e-481a-b7ff-310e9d683226 tempest-CreateVolumesFromSnapshotTest-85329515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-bb1cbeed-da05-4254-b527-a54975ee9f9f {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:17 devstack sudo[89335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-bb1cbeed-da05-4254-b527-a54975ee9f9f
Apr 28 22:09:17 devstack sudo[89335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:17 devstack sudo[89299]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:17 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-1eab8769-8d4f-4d49-a934-f9234dedc6ca tempest-GroupSnapshotsTest-1124623539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-df7dbed6-75ba-459e-abf4-58d8eca356b9.8aa4bc3b-e5cc-4acc-b3fd-fd30570b508e" returned: 0 in 0.900s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:17 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-1eab8769-8d4f-4d49-a934-f9234dedc6ca tempest-GroupSnapshotsTest-1124623539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-df7dbed6-75ba-459e-abf4-58d8eca356b9.info {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:17 devstack sudo[89344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-df7dbed6-75ba-459e-abf4-58d8eca356b9.info
Apr 28 22:09:17 devstack sudo[89344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:18 devstack sudo[89335]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:18 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7d99c9ed-7d4e-481a-b7ff-310e9d683226 tempest-CreateVolumesFromSnapshotTest-85329515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-bb1cbeed-da05-4254-b527-a54975ee9f9f" returned: 0 in 0.941s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:18 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7d99c9ed-7d4e-481a-b7ff-310e9d683226 tempest-CreateVolumesFromSnapshotTest-85329515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-bb1cbeed-da05-4254-b527-a54975ee9f9f {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:18 devstack sudo[89349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-bb1cbeed-da05-4254-b527-a54975ee9f9f
Apr 28 22:09:18 devstack sudo[89349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:18 devstack sudo[89344]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:18 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-1eab8769-8d4f-4d49-a934-f9234dedc6ca tempest-GroupSnapshotsTest-1124623539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-df7dbed6-75ba-459e-abf4-58d8eca356b9.info" returned: 0 in 0.763s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:18 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-1eab8769-8d4f-4d49-a934-f9234dedc6ca tempest-GroupSnapshotsTest-1124623539 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-df7dbed6-75ba-459e-abf4-58d8eca356b9.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 28 22:09:18 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-1eab8769-8d4f-4d49-a934-f9234dedc6ca tempest-GroupSnapshotsTest-1124623539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-df7dbed6-75ba-459e-abf4-58d8eca356b9.info {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:18 devstack sudo[89352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-df7dbed6-75ba-459e-abf4-58d8eca356b9.info
Apr 28 22:09:18 devstack sudo[89352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:18 devstack sudo[89349]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:18 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7d99c9ed-7d4e-481a-b7ff-310e9d683226 tempest-CreateVolumesFromSnapshotTest-85329515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-bb1cbeed-da05-4254-b527-a54975ee9f9f" returned: 0 in 0.693s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:18 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-7d99c9ed-7d4e-481a-b7ff-310e9d683226 tempest-CreateVolumesFromSnapshotTest-85329515 None] Lock "cinder-quobyte-bb1cbeed-da05-4254-b527-a54975ee9f9f" released by "delete_volume" :: held 1.715s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:09:19 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-7d99c9ed-7d4e-481a-b7ff-310e9d683226 tempest-CreateVolumesFromSnapshotTest-85329515 None] Created reservations ['bf792136-32b3-4e57-8fa7-2300dff8f311', '9638ccd5-ce8a-4194-8bd3-cec3f7836c0b', '3ec1b5ab-f3d6-4cda-8364-a58f48a2e4d3', '765af36e-678a-4087-8187-3f17a3beb568'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:09:19 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-7d99c9ed-7d4e-481a-b7ff-310e9d683226 tempest-CreateVolumesFromSnapshotTest-85329515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:09:19 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-7d99c9ed-7d4e-481a-b7ff-310e9d683226 tempest-CreateVolumesFromSnapshotTest-85329515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:09:19 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-7d99c9ed-7d4e-481a-b7ff-310e9d683226 tempest-CreateVolumesFromSnapshotTest-85329515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:09:19 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-7d99c9ed-7d4e-481a-b7ff-310e9d683226 tempest-CreateVolumesFromSnapshotTest-85329515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:09:19 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-7d99c9ed-7d4e-481a-b7ff-310e9d683226 tempest-CreateVolumesFromSnapshotTest-85329515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:09:19 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7d99c9ed-7d4e-481a-b7ff-310e9d683226 tempest-CreateVolumesFromSnapshotTest-85329515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:19 devstack sudo[89356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:09:19 devstack sudo[89356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:19 devstack sudo[89352]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:19 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-1eab8769-8d4f-4d49-a934-f9234dedc6ca tempest-GroupSnapshotsTest-1124623539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-df7dbed6-75ba-459e-abf4-58d8eca356b9.info" returned: 0 in 0.665s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:19 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-1eab8769-8d4f-4d49-a934-f9234dedc6ca tempest-GroupSnapshotsTest-1124623539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.365s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:09:19 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-1eab8769-8d4f-4d49-a934-f9234dedc6ca tempest-GroupSnapshotsTest-1124623539 None] group_snapshot 5a74552b-862f-4311-934f-a4322429ce81: created successfully
Apr 28 22:09:20 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-b8e1e927-49fd-44c2-a173-3b69b9db9334 tempest-GroupSnapshotsTest-1124623539 None] group_snapshot 5a74552b-862f-4311-934f-a4322429ce81: deleting
Apr 28 22:09:20 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b8e1e927-49fd-44c2-a173-3b69b9db9334 tempest-GroupSnapshotsTest-1124623539 None] group_snapshot 5a74552b-862f-4311-934f-a4322429ce81: deleting {{(pid=83924) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 28 22:09:20 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-b8e1e927-49fd-44c2-a173-3b69b9db9334 tempest-GroupSnapshotsTest-1124623539 None] Acquiring lock "cinder-quobyte-5a543d85-dde5-42ff-b2ad-33b0771e18d9" by "delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:09:20 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-b8e1e927-49fd-44c2-a173-3b69b9db9334 tempest-GroupSnapshotsTest-1124623539 None] Lock "cinder-quobyte-5a543d85-dde5-42ff-b2ad-33b0771e18d9" acquired by "delete_snapshot" :: waited 0.030s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:09:20 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-b8e1e927-49fd-44c2-a173-3b69b9db9334 tempest-GroupSnapshotsTest-1124623539 None] Acquiring lock "cinder-quobyte-29098727-1769-486f-adbb-446ebd611d27" by "_delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:09:20 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-b8e1e927-49fd-44c2-a173-3b69b9db9334 tempest-GroupSnapshotsTest-1124623539 None] Lock "cinder-quobyte-29098727-1769-486f-adbb-446ebd611d27" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:09:20 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-b8e1e927-49fd-44c2-a173-3b69b9db9334 tempest-GroupSnapshotsTest-1124623539 None] Deleting offline snapshot 29098727-1769-486f-adbb-446ebd611d27 of volume 5a543d85-dde5-42ff-b2ad-33b0771e18d9 {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 22:09:20 devstack sudo[89356]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:20 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-b8e1e927-49fd-44c2-a173-3b69b9db9334 tempest-GroupSnapshotsTest-1124623539 None] snapshot_file for this snap is: volume-5a543d85-dde5-42ff-b2ad-33b0771e18d9.29098727-1769-486f-adbb-446ebd611d27 {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 22:09:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7d99c9ed-7d4e-481a-b7ff-310e9d683226 tempest-CreateVolumesFromSnapshotTest-85329515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 1.409s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:20 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-7d99c9ed-7d4e-481a-b7ff-310e9d683226 tempest-CreateVolumesFromSnapshotTest-85329515 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:09:20 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-7d99c9ed-7d4e-481a-b7ff-310e9d683226 tempest-CreateVolumesFromSnapshotTest-85329515 None] Deleted volume successfully.
Apr 28 22:09:20 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[439cc9a1-f1c9-459e-89bc-75141b2325fc]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:09:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b8e1e927-49fd-44c2-a173-3b69b9db9334 tempest-GroupSnapshotsTest-1124623539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-5a543d85-dde5-42ff-b2ad-33b0771e18d9.29098727-1769-486f-adbb-446ebd611d27 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:20 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-7d99c9ed-7d4e-481a-b7ff-310e9d683226 tempest-CreateVolumesFromSnapshotTest-85329515 None] Lock "cinder-bb1cbeed-da05-4254-b527-a54975ee9f9f-delete_volume" released by "delete_volume" :: held 3.446s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:09:20 devstack sudo[89419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-5a543d85-dde5-42ff-b2ad-33b0771e18d9.29098727-1769-486f-adbb-446ebd611d27
Apr 28 22:09:20 devstack sudo[89419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:21 devstack sudo[89419]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:21 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b8e1e927-49fd-44c2-a173-3b69b9db9334 tempest-GroupSnapshotsTest-1124623539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-5a543d85-dde5-42ff-b2ad-33b0771e18d9.29098727-1769-486f-adbb-446ebd611d27" returned: 0 in 1.351s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:21 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-b8e1e927-49fd-44c2-a173-3b69b9db9334 tempest-GroupSnapshotsTest-1124623539 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a543d85-dde5-42ff-b2ad-33b0771e18d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 22:09:21 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb635eb6-d5a0-4b92-911a-b7973ff511dd]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:09:21 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b8e1e927-49fd-44c2-a173-3b69b9db9334 tempest-GroupSnapshotsTest-1124623539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-5a543d85-dde5-42ff-b2ad-33b0771e18d9 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:22 devstack sudo[89428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-5a543d85-dde5-42ff-b2ad-33b0771e18d9
Apr 28 22:09:22 devstack sudo[89428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:23 devstack sudo[89428]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:23 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b8e1e927-49fd-44c2-a173-3b69b9db9334 tempest-GroupSnapshotsTest-1124623539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-5a543d85-dde5-42ff-b2ad-33b0771e18d9" returned: 0 in 1.047s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:23 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b8e1e927-49fd-44c2-a173-3b69b9db9334 tempest-GroupSnapshotsTest-1124623539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-5a543d85-dde5-42ff-b2ad-33b0771e18d9.29098727-1769-486f-adbb-446ebd611d27 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:23 devstack sudo[89435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-5a543d85-dde5-42ff-b2ad-33b0771e18d9.29098727-1769-486f-adbb-446ebd611d27
Apr 28 22:09:23 devstack sudo[89435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:24 devstack sudo[89435]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:24 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b8e1e927-49fd-44c2-a173-3b69b9db9334 tempest-GroupSnapshotsTest-1124623539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-5a543d85-dde5-42ff-b2ad-33b0771e18d9.29098727-1769-486f-adbb-446ebd611d27" returned: 0 in 1.274s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:24 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b8e1e927-49fd-44c2-a173-3b69b9db9334 tempest-GroupSnapshotsTest-1124623539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-5a543d85-dde5-42ff-b2ad-33b0771e18d9.29098727-1769-486f-adbb-446ebd611d27 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:24 devstack sudo[89450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-5a543d85-dde5-42ff-b2ad-33b0771e18d9.29098727-1769-486f-adbb-446ebd611d27
Apr 28 22:09:24 devstack sudo[89450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:25 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-d51f238a-311c-4629-806d-5714b78a0731 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:09:25 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-d51f238a-311c-4629-806d-5714b78a0731 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Flow 'volume_create_manager' (d91549cf-3302-4cbc-b94a-944b42a55450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:09:25 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-d51f238a-311c-4629-806d-5714b78a0731 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f5196e0-c9b1-4096-8e43-1fbcc598e524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:09:25 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-d51f238a-311c-4629-806d-5714b78a0731 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f5196e0-c9b1-4096-8e43-1fbcc598e524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1048929276',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8085af2f-5152-4633-8ecf-cfb1a551b95f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34b3aa27fb8244058989e0a7a47f4755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:09:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:09:25Z,use_quota=True,user_id='f3981ac072de4f70845ba313a7abfa90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:09:25 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-d51f238a-311c-4629-806d-5714b78a0731 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb0a1382-74de-4b1b-95fa-50faf9e11ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:09:25 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-d51f238a-311c-4629-806d-5714b78a0731 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb0a1382-74de-4b1b-95fa-50faf9e11ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:09:25 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-d51f238a-311c-4629-806d-5714b78a0731 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12323fd0-fa84-4d87-8ef0-3b9ac7a431b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:09:25 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-d51f238a-311c-4629-806d-5714b78a0731 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12323fd0-fa84-4d87-8ef0-3b9ac7a431b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8085af2f-5152-4633-8ecf-cfb1a551b95f', 'volume_name': 'volume-8085af2f-5152-4633-8ecf-cfb1a551b95f', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:09:25 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-d51f238a-311c-4629-806d-5714b78a0731 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe623f20-8fc2-4ab4-8e5f-0fdef39f6a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:09:25 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-d51f238a-311c-4629-806d-5714b78a0731 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe623f20-8fc2-4ab4-8e5f-0fdef39f6a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:09:25 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-d51f238a-311c-4629-806d-5714b78a0731 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47e76619-1096-4867-a711-6f843228f0ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:09:25 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-d51f238a-311c-4629-806d-5714b78a0731 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Volume 8085af2f-5152-4633-8ecf-cfb1a551b95f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8085af2f-5152-4633-8ecf-cfb1a551b95f', 'volume_size': 1}
Apr 28 22:09:25 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-d51f238a-311c-4629-806d-5714b78a0731 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:09:25 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-d51f238a-311c-4629-806d-5714b78a0731 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:09:25 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-d51f238a-311c-4629-806d-5714b78a0731 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1048929276',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8085af2f-5152-4633-8ecf-cfb1a551b95f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34b3aa27fb8244058989e0a7a47f4755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:09:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:09:25Z,use_quota=True,user_id='f3981ac072de4f70845ba313a7abfa90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:09:25 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-d51f238a-311c-4629-806d-5714b78a0731 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Creating volume 8085af2f-5152-4633-8ecf-cfb1a551b95f {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:09:25 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-d51f238a-311c-4629-806d-5714b78a0731 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:09:25 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-d51f238a-311c-4629-806d-5714b78a0731 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:09:25 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-d51f238a-311c-4629-806d-5714b78a0731 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:09:25 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-d51f238a-311c-4629-806d-5714b78a0731 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:09:25 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-d51f238a-311c-4629-806d-5714b78a0731 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:09:25 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-d51f238a-311c-4629-806d-5714b78a0731 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:09:25 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-d51f238a-311c-4629-806d-5714b78a0731 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:09:25 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-d51f238a-311c-4629-806d-5714b78a0731 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8085af2f-5152-4633-8ecf-cfb1a551b95f 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:25 devstack sudo[89494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8085af2f-5152-4633-8ecf-cfb1a551b95f 1073741824
Apr 28 22:09:25 devstack sudo[89494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:25 devstack sudo[89450]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:25 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b8e1e927-49fd-44c2-a173-3b69b9db9334 tempest-GroupSnapshotsTest-1124623539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-5a543d85-dde5-42ff-b2ad-33b0771e18d9.29098727-1769-486f-adbb-446ebd611d27" returned: 0 in 1.292s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:25 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-b8e1e927-49fd-44c2-a173-3b69b9db9334 tempest-GroupSnapshotsTest-1124623539 None] Lock "cinder-quobyte-29098727-1769-486f-adbb-446ebd611d27" released by "_delete_snapshot" :: held 5.206s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:09:25 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-b8e1e927-49fd-44c2-a173-3b69b9db9334 tempest-GroupSnapshotsTest-1124623539 None] Lock "cinder-quobyte-5a543d85-dde5-42ff-b2ad-33b0771e18d9" released by "delete_snapshot" :: held 5.257s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:09:25 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-b8e1e927-49fd-44c2-a173-3b69b9db9334 tempest-GroupSnapshotsTest-1124623539 None] Acquiring lock "cinder-quobyte-df7dbed6-75ba-459e-abf4-58d8eca356b9" by "delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:09:25 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-b8e1e927-49fd-44c2-a173-3b69b9db9334 tempest-GroupSnapshotsTest-1124623539 None] Lock "cinder-quobyte-df7dbed6-75ba-459e-abf4-58d8eca356b9" acquired by "delete_snapshot" :: waited 0.030s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:09:25 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-b8e1e927-49fd-44c2-a173-3b69b9db9334 tempest-GroupSnapshotsTest-1124623539 None] Acquiring lock "cinder-quobyte-8aa4bc3b-e5cc-4acc-b3fd-fd30570b508e" by "_delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:09:25 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-b8e1e927-49fd-44c2-a173-3b69b9db9334 tempest-GroupSnapshotsTest-1124623539 None] Lock "cinder-quobyte-8aa4bc3b-e5cc-4acc-b3fd-fd30570b508e" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:09:25 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-b8e1e927-49fd-44c2-a173-3b69b9db9334 tempest-GroupSnapshotsTest-1124623539 None] Deleting offline snapshot 8aa4bc3b-e5cc-4acc-b3fd-fd30570b508e of volume df7dbed6-75ba-459e-abf4-58d8eca356b9 {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 22:09:25 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-b8e1e927-49fd-44c2-a173-3b69b9db9334 tempest-GroupSnapshotsTest-1124623539 None] snapshot_file for this snap is: volume-df7dbed6-75ba-459e-abf4-58d8eca356b9.8aa4bc3b-e5cc-4acc-b3fd-fd30570b508e {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 22:09:25 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e66acc0-9f3a-42fa-a893-534535d205fd]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:09:25 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b8e1e927-49fd-44c2-a173-3b69b9db9334 tempest-GroupSnapshotsTest-1124623539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-df7dbed6-75ba-459e-abf4-58d8eca356b9.8aa4bc3b-e5cc-4acc-b3fd-fd30570b508e {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:25 devstack sudo[89498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-df7dbed6-75ba-459e-abf4-58d8eca356b9.8aa4bc3b-e5cc-4acc-b3fd-fd30570b508e
Apr 28 22:09:25 devstack sudo[89498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:26 devstack sudo[89494]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:26 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-d51f238a-311c-4629-806d-5714b78a0731 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8085af2f-5152-4633-8ecf-cfb1a551b95f 1073741824" returned: 0 in 1.075s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:26 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-d51f238a-311c-4629-806d-5714b78a0731 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8085af2f-5152-4633-8ecf-cfb1a551b95f {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:26 devstack sudo[89506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8085af2f-5152-4633-8ecf-cfb1a551b95f
Apr 28 22:09:26 devstack sudo[89506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:26 devstack sudo[89498]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:26 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b8e1e927-49fd-44c2-a173-3b69b9db9334 tempest-GroupSnapshotsTest-1124623539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-df7dbed6-75ba-459e-abf4-58d8eca356b9.8aa4bc3b-e5cc-4acc-b3fd-fd30570b508e" returned: 0 in 0.937s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:26 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-b8e1e927-49fd-44c2-a173-3b69b9db9334 tempest-GroupSnapshotsTest-1124623539 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df7dbed6-75ba-459e-abf4-58d8eca356b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 22:09:26 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2bba77-e568-4097-bb7e-112792d1d905]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:09:26 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b8e1e927-49fd-44c2-a173-3b69b9db9334 tempest-GroupSnapshotsTest-1124623539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-df7dbed6-75ba-459e-abf4-58d8eca356b9 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:26 devstack sudo[89511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-df7dbed6-75ba-459e-abf4-58d8eca356b9
Apr 28 22:09:26 devstack sudo[89511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:27 devstack sudo[89506]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:27 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-d51f238a-311c-4629-806d-5714b78a0731 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8085af2f-5152-4633-8ecf-cfb1a551b95f" returned: 0 in 0.909s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:27 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-d51f238a-311c-4629-806d-5714b78a0731 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] <== create_volume: return (2060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:09:27 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-d51f238a-311c-4629-806d-5714b78a0731 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.062s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:09:27 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-d51f238a-311c-4629-806d-5714b78a0731 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47e76619-1096-4867-a711-6f843228f0ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8085af2f-5152-4633-8ecf-cfb1a551b95f', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:09:27 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-d51f238a-311c-4629-806d-5714b78a0731 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33ea7a12-ab26-4077-b28b-701358700315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:09:27 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-d51f238a-311c-4629-806d-5714b78a0731 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Volume volume-8085af2f-5152-4633-8ecf-cfb1a551b95f (8085af2f-5152-4633-8ecf-cfb1a551b95f): created successfully
Apr 28 22:09:27 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-d51f238a-311c-4629-806d-5714b78a0731 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33ea7a12-ab26-4077-b28b-701358700315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:09:27 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-d51f238a-311c-4629-806d-5714b78a0731 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Flow 'volume_create_manager' (d91549cf-3302-4cbc-b94a-944b42a55450) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:09:27 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-d51f238a-311c-4629-806d-5714b78a0731 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Created volume successfully.
Apr 28 22:09:27 devstack sudo[89511]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:27 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b8e1e927-49fd-44c2-a173-3b69b9db9334 tempest-GroupSnapshotsTest-1124623539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-df7dbed6-75ba-459e-abf4-58d8eca356b9" returned: 0 in 0.944s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:27 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b8e1e927-49fd-44c2-a173-3b69b9db9334 tempest-GroupSnapshotsTest-1124623539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-df7dbed6-75ba-459e-abf4-58d8eca356b9.8aa4bc3b-e5cc-4acc-b3fd-fd30570b508e {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:27 devstack sudo[89518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-df7dbed6-75ba-459e-abf4-58d8eca356b9.8aa4bc3b-e5cc-4acc-b3fd-fd30570b508e
Apr 28 22:09:27 devstack sudo[89518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:28 devstack sudo[89518]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:28 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b8e1e927-49fd-44c2-a173-3b69b9db9334 tempest-GroupSnapshotsTest-1124623539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-df7dbed6-75ba-459e-abf4-58d8eca356b9.8aa4bc3b-e5cc-4acc-b3fd-fd30570b508e" returned: 0 in 0.720s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:28 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b8e1e927-49fd-44c2-a173-3b69b9db9334 tempest-GroupSnapshotsTest-1124623539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-df7dbed6-75ba-459e-abf4-58d8eca356b9.8aa4bc3b-e5cc-4acc-b3fd-fd30570b508e {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:28 devstack sudo[89524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-df7dbed6-75ba-459e-abf4-58d8eca356b9.8aa4bc3b-e5cc-4acc-b3fd-fd30570b508e
Apr 28 22:09:28 devstack sudo[89524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:28 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-414c4558-8db7-4c07-bd9d-f4c059c54af9 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:09:28 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-414c4558-8db7-4c07-bd9d-f4c059c54af9 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Flow 'volume_create_manager' (1dd0a33d-3542-4d9a-8dee-62a95ee426b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:09:28 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-414c4558-8db7-4c07-bd9d-f4c059c54af9 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (828ea5a2-e493-4bf9-a6e4-dc266c9fb078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:09:28 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-414c4558-8db7-4c07-bd9d-f4c059c54af9 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (828ea5a2-e493-4bf9-a6e4-dc266c9fb078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:09:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2046155578',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0779d21-0de8-4ac8-a11b-668d59701aae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34b3aa27fb8244058989e0a7a47f4755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:09:29Z,use_quota=True,user_id='f3981ac072de4f70845ba313a7abfa90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:09:28 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-414c4558-8db7-4c07-bd9d-f4c059c54af9 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (392284bf-8e2b-4485-b945-47c37fafe232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:09:28 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-414c4558-8db7-4c07-bd9d-f4c059c54af9 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (392284bf-8e2b-4485-b945-47c37fafe232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:09:28 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-414c4558-8db7-4c07-bd9d-f4c059c54af9 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4df6efec-27a1-4061-99c4-ce5a1cf77087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:09:28 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-414c4558-8db7-4c07-bd9d-f4c059c54af9 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4df6efec-27a1-4061-99c4-ce5a1cf77087) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0779d21-0de8-4ac8-a11b-668d59701aae', 'volume_name': 'volume-c0779d21-0de8-4ac8-a11b-668d59701aae', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:09:28 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-414c4558-8db7-4c07-bd9d-f4c059c54af9 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31a99819-67a8-459f-a9e5-4a0f0fe9c197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:09:28 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-414c4558-8db7-4c07-bd9d-f4c059c54af9 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31a99819-67a8-459f-a9e5-4a0f0fe9c197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:09:28 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-414c4558-8db7-4c07-bd9d-f4c059c54af9 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a69a71a2-2ea1-4367-8aed-0664ccecb3f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:09:28 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-414c4558-8db7-4c07-bd9d-f4c059c54af9 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Volume c0779d21-0de8-4ac8-a11b-668d59701aae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0779d21-0de8-4ac8-a11b-668d59701aae', 'volume_size': 1}
Apr 28 22:09:28 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-414c4558-8db7-4c07-bd9d-f4c059c54af9 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:09:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-414c4558-8db7-4c07-bd9d-f4c059c54af9 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:09:29 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-414c4558-8db7-4c07-bd9d-f4c059c54af9 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:09:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2046155578',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0779d21-0de8-4ac8-a11b-668d59701aae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34b3aa27fb8244058989e0a7a47f4755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:09:29Z,use_quota=True,user_id='f3981ac072de4f70845ba313a7abfa90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:09:29 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-414c4558-8db7-4c07-bd9d-f4c059c54af9 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Creating volume c0779d21-0de8-4ac8-a11b-668d59701aae {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:09:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-414c4558-8db7-4c07-bd9d-f4c059c54af9 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:09:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-414c4558-8db7-4c07-bd9d-f4c059c54af9 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:09:29 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-414c4558-8db7-4c07-bd9d-f4c059c54af9 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:09:29 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-414c4558-8db7-4c07-bd9d-f4c059c54af9 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:09:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-414c4558-8db7-4c07-bd9d-f4c059c54af9 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:09:29 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-414c4558-8db7-4c07-bd9d-f4c059c54af9 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:09:29 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-414c4558-8db7-4c07-bd9d-f4c059c54af9 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:09:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-414c4558-8db7-4c07-bd9d-f4c059c54af9 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-c0779d21-0de8-4ac8-a11b-668d59701aae 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:29 devstack sudo[89526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-c0779d21-0de8-4ac8-a11b-668d59701aae 1073741824
Apr 28 22:09:29 devstack sudo[89526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:29 devstack sudo[89524]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b8e1e927-49fd-44c2-a173-3b69b9db9334 tempest-GroupSnapshotsTest-1124623539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-df7dbed6-75ba-459e-abf4-58d8eca356b9.8aa4bc3b-e5cc-4acc-b3fd-fd30570b508e" returned: 0 in 0.869s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:29 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-b8e1e927-49fd-44c2-a173-3b69b9db9334 tempest-GroupSnapshotsTest-1124623539 None] Lock "cinder-quobyte-8aa4bc3b-e5cc-4acc-b3fd-fd30570b508e" released by "_delete_snapshot" :: held 3.675s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:09:29 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-b8e1e927-49fd-44c2-a173-3b69b9db9334 tempest-GroupSnapshotsTest-1124623539 None] Lock "cinder-quobyte-df7dbed6-75ba-459e-abf4-58d8eca356b9" released by "delete_snapshot" :: held 3.718s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:09:29 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5625737-7c87-4ef0-96b5-10d5403ca766 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:09:29 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-c5625737-7c87-4ef0-96b5-10d5403ca766 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Flow 'volume_create_manager' (0d201063-415a-430d-91a5-947e61137859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:09:29 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-c5625737-7c87-4ef0-96b5-10d5403ca766 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf7b688e-eee1-4946-a116-8138bd6041d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:09:29 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-c5625737-7c87-4ef0-96b5-10d5403ca766 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf7b688e-eee1-4946-a116-8138bd6041d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1997026305',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56cb03fa-c7a3-44b2-b8a2-54bacc881548,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34b3aa27fb8244058989e0a7a47f4755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:09:29Z,use_quota=True,user_id='f3981ac072de4f70845ba313a7abfa90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:09:29 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-c5625737-7c87-4ef0-96b5-10d5403ca766 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75345bfd-a99c-4d84-9e07-b30460204cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:09:29 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-c5625737-7c87-4ef0-96b5-10d5403ca766 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75345bfd-a99c-4d84-9e07-b30460204cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:09:29 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-c5625737-7c87-4ef0-96b5-10d5403ca766 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb91f40d-d178-4418-b441-eecf6e75b373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:09:29 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-c5625737-7c87-4ef0-96b5-10d5403ca766 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb91f40d-d178-4418-b441-eecf6e75b373) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56cb03fa-c7a3-44b2-b8a2-54bacc881548', 'volume_name': 'volume-56cb03fa-c7a3-44b2-b8a2-54bacc881548', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:09:29 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-c5625737-7c87-4ef0-96b5-10d5403ca766 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c347506b-9996-449e-ab21-bf5e49b9961f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:09:29 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-c5625737-7c87-4ef0-96b5-10d5403ca766 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c347506b-9996-449e-ab21-bf5e49b9961f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:09:29 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-c5625737-7c87-4ef0-96b5-10d5403ca766 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75510fd7-50a2-456b-b953-e6c8b78e6dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:09:29 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-c5625737-7c87-4ef0-96b5-10d5403ca766 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Volume 56cb03fa-c7a3-44b2-b8a2-54bacc881548: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56cb03fa-c7a3-44b2-b8a2-54bacc881548', 'volume_size': 1}
Apr 28 22:09:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-c5625737-7c87-4ef0-96b5-10d5403ca766 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:09:29 devstack cinder-volume[83924]: WARNING cinder.quota [None req-b8e1e927-49fd-44c2-a173-3b69b9db9334 tempest-GroupSnapshotsTest-1124623539 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2098007352 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2098007352, it is now deprecated. Please use the default quota class for default quota.
Apr 28 22:09:29 devstack cinder-volume[83924]: WARNING cinder.quota [None req-b8e1e927-49fd-44c2-a173-3b69b9db9334 tempest-GroupSnapshotsTest-1124623539 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2098007352 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2098007352, it is now deprecated. Please use the default quota class for default quota.
Apr 28 22:09:29 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-b8e1e927-49fd-44c2-a173-3b69b9db9334 tempest-GroupSnapshotsTest-1124623539 None] Created reservations ['54524d80-6950-48ed-b05f-dba050212144', '6c10ccc0-84f8-4b63-97a0-d913d2450735', '11dd9767-8111-4dbd-a63e-f98fa5a096ab', '1f8eba4d-8568-492c-ba0e-b7a46de2657a'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:09:30 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-b8e1e927-49fd-44c2-a173-3b69b9db9334 tempest-GroupSnapshotsTest-1124623539 None] Created reservations ['5d162ddf-83e8-4d1b-9462-91756ffa7d4d', 'f96ef790-95e0-486b-8466-e0d713486a28', '9acf7016-64c9-435d-9b83-bed1fada77e3', 'e327cc25-74d7-45a4-b6f4-5e48900f6b2b'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:09:30 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-96370621-f950-46df-9ed9-adfa6366b8e8 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:09:30 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-96370621-f950-46df-9ed9-adfa6366b8e8 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Flow 'volume_create_manager' (e54685a2-3ab0-4f27-9084-b135ee81d73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:09:30 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-96370621-f950-46df-9ed9-adfa6366b8e8 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0efd8611-1101-4227-aa12-8fea4ac33c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:09:30 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-96370621-f950-46df-9ed9-adfa6366b8e8 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0efd8611-1101-4227-aa12-8fea4ac33c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:09:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1979172052',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffab0336-9d81-4dcb-9504-c2e93ca76175,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34b3aa27fb8244058989e0a7a47f4755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:09:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:09:30Z,use_quota=True,user_id='f3981ac072de4f70845ba313a7abfa90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:09:30 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-96370621-f950-46df-9ed9-adfa6366b8e8 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cf88c07-4411-4352-9b63-44e4b8a7bcca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:09:30 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-96370621-f950-46df-9ed9-adfa6366b8e8 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cf88c07-4411-4352-9b63-44e4b8a7bcca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:09:30 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-96370621-f950-46df-9ed9-adfa6366b8e8 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0741343f-0a1a-487e-8cc3-67d7e45d76e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:09:30 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-96370621-f950-46df-9ed9-adfa6366b8e8 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0741343f-0a1a-487e-8cc3-67d7e45d76e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffab0336-9d81-4dcb-9504-c2e93ca76175', 'volume_name': 'volume-ffab0336-9d81-4dcb-9504-c2e93ca76175', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:09:30 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-96370621-f950-46df-9ed9-adfa6366b8e8 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (848ed1a7-e090-4c27-a865-5f62838fcd93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:09:30 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-96370621-f950-46df-9ed9-adfa6366b8e8 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (848ed1a7-e090-4c27-a865-5f62838fcd93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:09:30 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-96370621-f950-46df-9ed9-adfa6366b8e8 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d5f954a-9e64-435e-9d14-10546e160e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:09:30 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-96370621-f950-46df-9ed9-adfa6366b8e8 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Volume ffab0336-9d81-4dcb-9504-c2e93ca76175: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffab0336-9d81-4dcb-9504-c2e93ca76175', 'volume_size': 1}
Apr 28 22:09:30 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-96370621-f950-46df-9ed9-adfa6366b8e8 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:09:30 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-b8e1e927-49fd-44c2-a173-3b69b9db9334 tempest-GroupSnapshotsTest-1124623539 None] group_snapshot 5a74552b-862f-4311-934f-a4322429ce81: deleted successfully
Apr 28 22:09:30 devstack sudo[89526]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:30 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-414c4558-8db7-4c07-bd9d-f4c059c54af9 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-c0779d21-0de8-4ac8-a11b-668d59701aae 1073741824" returned: 0 in 1.277s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:30 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-414c4558-8db7-4c07-bd9d-f4c059c54af9 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-c0779d21-0de8-4ac8-a11b-668d59701aae {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:30 devstack sudo[89532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-c0779d21-0de8-4ac8-a11b-668d59701aae
Apr 28 22:09:30 devstack sudo[89532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:30 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-42572b58-67cc-4c13-848f-c727f67eca62 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:09:30 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-42572b58-67cc-4c13-848f-c727f67eca62 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Flow 'volume_create_manager' (1eba5ade-d053-46ec-aa29-707ef183503a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:09:30 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-42572b58-67cc-4c13-848f-c727f67eca62 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9ad0dea-647f-4dbc-9b17-1b1530eae1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:09:30 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-42572b58-67cc-4c13-848f-c727f67eca62 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9ad0dea-647f-4dbc-9b17-1b1530eae1f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:09:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-734436370',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=110fc230-88e1-47f1-8ab7-1bb7f0ce6d23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34b3aa27fb8244058989e0a7a47f4755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:09:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:09:31Z,use_quota=True,user_id='f3981ac072de4f70845ba313a7abfa90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:09:30 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-42572b58-67cc-4c13-848f-c727f67eca62 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc9d87c7-74c5-4491-a033-cb540dd85666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:09:30 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-42572b58-67cc-4c13-848f-c727f67eca62 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc9d87c7-74c5-4491-a033-cb540dd85666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:09:30 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-42572b58-67cc-4c13-848f-c727f67eca62 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2060194d-1581-4db3-ad60-6ae4c4fd5511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:09:30 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-42572b58-67cc-4c13-848f-c727f67eca62 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2060194d-1581-4db3-ad60-6ae4c4fd5511) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '110fc230-88e1-47f1-8ab7-1bb7f0ce6d23', 'volume_name': 'volume-110fc230-88e1-47f1-8ab7-1bb7f0ce6d23', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:09:30 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-42572b58-67cc-4c13-848f-c727f67eca62 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b0d7003-24da-4d8f-b094-896594080b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:09:30 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-42572b58-67cc-4c13-848f-c727f67eca62 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b0d7003-24da-4d8f-b094-896594080b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:09:30 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-42572b58-67cc-4c13-848f-c727f67eca62 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (884c52e8-4410-46d4-9852-6dc7cf9f522d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:09:30 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-42572b58-67cc-4c13-848f-c727f67eca62 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Volume 110fc230-88e1-47f1-8ab7-1bb7f0ce6d23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-110fc230-88e1-47f1-8ab7-1bb7f0ce6d23', 'volume_size': 1}
Apr 28 22:09:30 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-42572b58-67cc-4c13-848f-c727f67eca62 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:09:31 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-498272b8-408e-4cc8-854f-71c31b8b9419 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:09:31 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-498272b8-408e-4cc8-854f-71c31b8b9419 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Flow 'volume_create_manager' (4d8fb2e0-4bc2-4b21-8956-273d931efae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:09:31 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-498272b8-408e-4cc8-854f-71c31b8b9419 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d595ea3e-86d5-4ac1-a344-8b9642439b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:09:31 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-498272b8-408e-4cc8-854f-71c31b8b9419 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d595ea3e-86d5-4ac1-a344-8b9642439b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:09:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-976800889',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c761dfe-040f-41c5-9a57-a1039d7a0730,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34b3aa27fb8244058989e0a7a47f4755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:09:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:09:31Z,use_quota=True,user_id='f3981ac072de4f70845ba313a7abfa90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:09:31 devstack sudo[89532]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:31 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-498272b8-408e-4cc8-854f-71c31b8b9419 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e13b0cfd-95c1-423f-b320-b123e042c99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:09:31 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-498272b8-408e-4cc8-854f-71c31b8b9419 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e13b0cfd-95c1-423f-b320-b123e042c99b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:09:31 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-498272b8-408e-4cc8-854f-71c31b8b9419 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c29e038a-fb2c-4947-9d2d-4ded7fcc9102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:09:31 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-498272b8-408e-4cc8-854f-71c31b8b9419 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c29e038a-fb2c-4947-9d2d-4ded7fcc9102) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c761dfe-040f-41c5-9a57-a1039d7a0730', 'volume_name': 'volume-2c761dfe-040f-41c5-9a57-a1039d7a0730', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:09:31 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-498272b8-408e-4cc8-854f-71c31b8b9419 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f8d6d77-ed72-4dc2-882c-54f0dfc24854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:09:31 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-498272b8-408e-4cc8-854f-71c31b8b9419 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f8d6d77-ed72-4dc2-882c-54f0dfc24854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:09:31 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-498272b8-408e-4cc8-854f-71c31b8b9419 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70ad5eef-4ef9-41bb-aa3c-47dfd1103ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:09:31 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-498272b8-408e-4cc8-854f-71c31b8b9419 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Volume 2c761dfe-040f-41c5-9a57-a1039d7a0730: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c761dfe-040f-41c5-9a57-a1039d7a0730', 'volume_size': 1}
Apr 28 22:09:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-498272b8-408e-4cc8-854f-71c31b8b9419 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:09:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-414c4558-8db7-4c07-bd9d-f4c059c54af9 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-c0779d21-0de8-4ac8-a11b-668d59701aae" returned: 0 in 1.078s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:31 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-414c4558-8db7-4c07-bd9d-f4c059c54af9 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] <== create_volume: return (2413ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:09:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-414c4558-8db7-4c07-bd9d-f4c059c54af9 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.416s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:09:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-c5625737-7c87-4ef0-96b5-10d5403ca766 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.733s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:09:31 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-c5625737-7c87-4ef0-96b5-10d5403ca766 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1997026305',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56cb03fa-c7a3-44b2-b8a2-54bacc881548,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34b3aa27fb8244058989e0a7a47f4755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:09:29Z,use_quota=True,user_id='f3981ac072de4f70845ba313a7abfa90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:09:31 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-c5625737-7c87-4ef0-96b5-10d5403ca766 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Creating volume 56cb03fa-c7a3-44b2-b8a2-54bacc881548 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:09:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-c5625737-7c87-4ef0-96b5-10d5403ca766 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:09:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-c5625737-7c87-4ef0-96b5-10d5403ca766 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:09:31 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-c5625737-7c87-4ef0-96b5-10d5403ca766 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:09:31 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-c5625737-7c87-4ef0-96b5-10d5403ca766 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:09:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-c5625737-7c87-4ef0-96b5-10d5403ca766 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:09:31 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-c5625737-7c87-4ef0-96b5-10d5403ca766 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:09:31 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-c5625737-7c87-4ef0-96b5-10d5403ca766 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:09:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c5625737-7c87-4ef0-96b5-10d5403ca766 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-56cb03fa-c7a3-44b2-b8a2-54bacc881548 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:31 devstack sudo[89535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-56cb03fa-c7a3-44b2-b8a2-54bacc881548 1073741824
Apr 28 22:09:31 devstack sudo[89535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:31 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-414c4558-8db7-4c07-bd9d-f4c059c54af9 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a69a71a2-2ea1-4367-8aed-0664ccecb3f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0779d21-0de8-4ac8-a11b-668d59701aae', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:09:31 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-414c4558-8db7-4c07-bd9d-f4c059c54af9 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57693917-6a20-4176-acea-d93b0d874eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:09:31 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-414c4558-8db7-4c07-bd9d-f4c059c54af9 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Volume volume-c0779d21-0de8-4ac8-a11b-668d59701aae (c0779d21-0de8-4ac8-a11b-668d59701aae): created successfully
Apr 28 22:09:31 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-414c4558-8db7-4c07-bd9d-f4c059c54af9 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57693917-6a20-4176-acea-d93b0d874eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:09:31 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-414c4558-8db7-4c07-bd9d-f4c059c54af9 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Flow 'volume_create_manager' (1dd0a33d-3542-4d9a-8dee-62a95ee426b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:09:31 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-414c4558-8db7-4c07-bd9d-f4c059c54af9 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Created volume successfully.
Apr 28 22:09:31 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-431248dc-8f22-48f7-80f5-513b8f390f3f tempest-GroupSnapshotsTest-1124623539 None] Acquiring lock "cinder-quobyte-5a543d85-dde5-42ff-b2ad-33b0771e18d9" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:09:31 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-431248dc-8f22-48f7-80f5-513b8f390f3f tempest-GroupSnapshotsTest-1124623539 None] Lock "cinder-quobyte-5a543d85-dde5-42ff-b2ad-33b0771e18d9" acquired by "delete_volume" :: waited 0.037s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:09:31 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[245c2552-9772-40ba-83c2-451c57d14252]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:09:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-431248dc-8f22-48f7-80f5-513b8f390f3f tempest-GroupSnapshotsTest-1124623539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-5a543d85-dde5-42ff-b2ad-33b0771e18d9 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:31 devstack sudo[89537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-5a543d85-dde5-42ff-b2ad-33b0771e18d9
Apr 28 22:09:31 devstack sudo[89537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:32 devstack sudo[89535]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:32 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c5625737-7c87-4ef0-96b5-10d5403ca766 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-56cb03fa-c7a3-44b2-b8a2-54bacc881548 1073741824" returned: 0 in 1.238s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:32 devstack sudo[89537]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:32 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-431248dc-8f22-48f7-80f5-513b8f390f3f tempest-GroupSnapshotsTest-1124623539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-5a543d85-dde5-42ff-b2ad-33b0771e18d9" returned: 0 in 0.951s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:32 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-431248dc-8f22-48f7-80f5-513b8f390f3f tempest-GroupSnapshotsTest-1124623539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-5a543d85-dde5-42ff-b2ad-33b0771e18d9 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:32 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c5625737-7c87-4ef0-96b5-10d5403ca766 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-56cb03fa-c7a3-44b2-b8a2-54bacc881548 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:32 devstack sudo[89547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-5a543d85-dde5-42ff-b2ad-33b0771e18d9
Apr 28 22:09:32 devstack sudo[89547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:32 devstack sudo[89548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-56cb03fa-c7a3-44b2-b8a2-54bacc881548
Apr 28 22:09:32 devstack sudo[89548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:33 devstack sudo[89548]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:33 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c5625737-7c87-4ef0-96b5-10d5403ca766 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-56cb03fa-c7a3-44b2-b8a2-54bacc881548" returned: 0 in 0.667s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:33 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-c5625737-7c87-4ef0-96b5-10d5403ca766 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] <== create_volume: return (1990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:09:33 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-c5625737-7c87-4ef0-96b5-10d5403ca766 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.993s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:09:33 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-96370621-f950-46df-9ed9-adfa6366b8e8 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.269s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:09:33 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-96370621-f950-46df-9ed9-adfa6366b8e8 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:09:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1979172052',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffab0336-9d81-4dcb-9504-c2e93ca76175,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34b3aa27fb8244058989e0a7a47f4755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:09:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:09:30Z,use_quota=True,user_id='f3981ac072de4f70845ba313a7abfa90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:09:33 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-96370621-f950-46df-9ed9-adfa6366b8e8 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Creating volume ffab0336-9d81-4dcb-9504-c2e93ca76175 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:09:33 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-96370621-f950-46df-9ed9-adfa6366b8e8 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:09:33 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-96370621-f950-46df-9ed9-adfa6366b8e8 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:09:33 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-96370621-f950-46df-9ed9-adfa6366b8e8 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:09:33 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-96370621-f950-46df-9ed9-adfa6366b8e8 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:09:33 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-96370621-f950-46df-9ed9-adfa6366b8e8 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:09:33 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-96370621-f950-46df-9ed9-adfa6366b8e8 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:09:33 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-96370621-f950-46df-9ed9-adfa6366b8e8 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:09:33 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-96370621-f950-46df-9ed9-adfa6366b8e8 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ffab0336-9d81-4dcb-9504-c2e93ca76175 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:33 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-c5625737-7c87-4ef0-96b5-10d5403ca766 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75510fd7-50a2-456b-b953-e6c8b78e6dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56cb03fa-c7a3-44b2-b8a2-54bacc881548', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:09:33 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-c5625737-7c87-4ef0-96b5-10d5403ca766 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (261b6c64-912f-47ac-a3a5-0c3ddfaaa777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:09:33 devstack sudo[89554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ffab0336-9d81-4dcb-9504-c2e93ca76175 1073741824
Apr 28 22:09:33 devstack sudo[89554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:33 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-c5625737-7c87-4ef0-96b5-10d5403ca766 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Volume volume-56cb03fa-c7a3-44b2-b8a2-54bacc881548 (56cb03fa-c7a3-44b2-b8a2-54bacc881548): created successfully
Apr 28 22:09:33 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-c5625737-7c87-4ef0-96b5-10d5403ca766 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (261b6c64-912f-47ac-a3a5-0c3ddfaaa777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:09:33 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-c5625737-7c87-4ef0-96b5-10d5403ca766 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Flow 'volume_create_manager' (0d201063-415a-430d-91a5-947e61137859) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:09:33 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-c5625737-7c87-4ef0-96b5-10d5403ca766 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Created volume successfully.
Apr 28 22:09:33 devstack sudo[89547]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:33 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-431248dc-8f22-48f7-80f5-513b8f390f3f tempest-GroupSnapshotsTest-1124623539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-5a543d85-dde5-42ff-b2ad-33b0771e18d9" returned: 0 in 0.831s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:33 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-431248dc-8f22-48f7-80f5-513b8f390f3f tempest-GroupSnapshotsTest-1124623539 None] Lock "cinder-quobyte-5a543d85-dde5-42ff-b2ad-33b0771e18d9" released by "delete_volume" :: held 1.881s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:09:33 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-431248dc-8f22-48f7-80f5-513b8f390f3f tempest-GroupSnapshotsTest-1124623539 None] Acquiring lock "cinder-quobyte-df7dbed6-75ba-459e-abf4-58d8eca356b9" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:09:33 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-431248dc-8f22-48f7-80f5-513b8f390f3f tempest-GroupSnapshotsTest-1124623539 None] Lock "cinder-quobyte-df7dbed6-75ba-459e-abf4-58d8eca356b9" acquired by "delete_volume" :: waited 0.034s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:09:33 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30abd09-0b41-4111-b377-5d59086d248f]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:09:33 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-431248dc-8f22-48f7-80f5-513b8f390f3f tempest-GroupSnapshotsTest-1124623539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-df7dbed6-75ba-459e-abf4-58d8eca356b9 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:33 devstack sudo[89556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-df7dbed6-75ba-459e-abf4-58d8eca356b9
Apr 28 22:09:33 devstack sudo[89556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:34 devstack sudo[89554]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:34 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-96370621-f950-46df-9ed9-adfa6366b8e8 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ffab0336-9d81-4dcb-9504-c2e93ca76175 1073741824" returned: 0 in 1.153s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:34 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-96370621-f950-46df-9ed9-adfa6366b8e8 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ffab0336-9d81-4dcb-9504-c2e93ca76175 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:34 devstack sudo[89556]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:34 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-431248dc-8f22-48f7-80f5-513b8f390f3f tempest-GroupSnapshotsTest-1124623539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-df7dbed6-75ba-459e-abf4-58d8eca356b9" returned: 0 in 1.003s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:34 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-431248dc-8f22-48f7-80f5-513b8f390f3f tempest-GroupSnapshotsTest-1124623539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-df7dbed6-75ba-459e-abf4-58d8eca356b9 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:34 devstack sudo[89567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ffab0336-9d81-4dcb-9504-c2e93ca76175
Apr 28 22:09:34 devstack sudo[89567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:34 devstack sudo[89568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-df7dbed6-75ba-459e-abf4-58d8eca356b9
Apr 28 22:09:34 devstack sudo[89568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:35 devstack sudo[89567]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:35 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-96370621-f950-46df-9ed9-adfa6366b8e8 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ffab0336-9d81-4dcb-9504-c2e93ca76175" returned: 0 in 0.690s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:35 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-96370621-f950-46df-9ed9-adfa6366b8e8 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] <== create_volume: return (1945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:09:35 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-96370621-f950-46df-9ed9-adfa6366b8e8 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.949s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:09:35 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-42572b58-67cc-4c13-848f-c727f67eca62 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.593s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:09:35 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-42572b58-67cc-4c13-848f-c727f67eca62 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:09:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-734436370',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=110fc230-88e1-47f1-8ab7-1bb7f0ce6d23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34b3aa27fb8244058989e0a7a47f4755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:09:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:09:31Z,use_quota=True,user_id='f3981ac072de4f70845ba313a7abfa90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:09:35 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-42572b58-67cc-4c13-848f-c727f67eca62 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Creating volume 110fc230-88e1-47f1-8ab7-1bb7f0ce6d23 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:09:35 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-42572b58-67cc-4c13-848f-c727f67eca62 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:09:35 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-42572b58-67cc-4c13-848f-c727f67eca62 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:09:35 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-42572b58-67cc-4c13-848f-c727f67eca62 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:09:35 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-42572b58-67cc-4c13-848f-c727f67eca62 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:09:35 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-42572b58-67cc-4c13-848f-c727f67eca62 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:09:35 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-42572b58-67cc-4c13-848f-c727f67eca62 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:09:35 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-42572b58-67cc-4c13-848f-c727f67eca62 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:09:35 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-42572b58-67cc-4c13-848f-c727f67eca62 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-110fc230-88e1-47f1-8ab7-1bb7f0ce6d23 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:35 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-96370621-f950-46df-9ed9-adfa6366b8e8 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d5f954a-9e64-435e-9d14-10546e160e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffab0336-9d81-4dcb-9504-c2e93ca76175', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:09:35 devstack sudo[89575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-110fc230-88e1-47f1-8ab7-1bb7f0ce6d23 1073741824
Apr 28 22:09:35 devstack sudo[89575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:35 devstack sudo[89568]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:35 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-96370621-f950-46df-9ed9-adfa6366b8e8 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df95055b-c125-4f0a-b5b0-d137025afa2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:09:35 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-431248dc-8f22-48f7-80f5-513b8f390f3f tempest-GroupSnapshotsTest-1124623539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-df7dbed6-75ba-459e-abf4-58d8eca356b9" returned: 0 in 0.745s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:35 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-431248dc-8f22-48f7-80f5-513b8f390f3f tempest-GroupSnapshotsTest-1124623539 None] Lock "cinder-quobyte-df7dbed6-75ba-459e-abf4-58d8eca356b9" released by "delete_volume" :: held 1.844s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:09:35 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-96370621-f950-46df-9ed9-adfa6366b8e8 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Volume volume-ffab0336-9d81-4dcb-9504-c2e93ca76175 (ffab0336-9d81-4dcb-9504-c2e93ca76175): created successfully
Apr 28 22:09:35 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-96370621-f950-46df-9ed9-adfa6366b8e8 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df95055b-c125-4f0a-b5b0-d137025afa2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:09:35 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-96370621-f950-46df-9ed9-adfa6366b8e8 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Flow 'volume_create_manager' (e54685a2-3ab0-4f27-9084-b135ee81d73c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:09:35 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-96370621-f950-46df-9ed9-adfa6366b8e8 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Created volume successfully.
Apr 28 22:09:35 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-431248dc-8f22-48f7-80f5-513b8f390f3f tempest-GroupSnapshotsTest-1124623539 None] Created reservations ['09a0d688-b094-4275-8bbf-b5de3d437466'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:09:35 devstack cinder-volume[83924]: WARNING cinder.quota [None req-431248dc-8f22-48f7-80f5-513b8f390f3f tempest-GroupSnapshotsTest-1124623539 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2098007352 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2098007352, it is now deprecated. Please use the default quota class for default quota.
Apr 28 22:09:35 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-431248dc-8f22-48f7-80f5-513b8f390f3f tempest-GroupSnapshotsTest-1124623539 None] Created reservations ['3b4aa513-80b4-4f7e-9f1b-d7b87de4b14e', 'e500c404-f142-4b7e-b1da-7fab6b8b0923', '3555d284-b450-4429-863d-4b473026e13b', '4dadab4d-247e-4851-84f4-bcb13a42f855'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:09:35 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-431248dc-8f22-48f7-80f5-513b8f390f3f tempest-GroupSnapshotsTest-1124623539 None] Created reservations ['cc0d2bc7-cce8-45cb-8c11-a00fc6863a79', '56fdc161-e1fe-43ff-ad2e-18df539e34dc', '635ed755-69c9-42cd-9413-e73bc29916e1', 'e6759095-a35b-4216-b9c7-e8d51df7c629'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:09:36 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-431248dc-8f22-48f7-80f5-513b8f390f3f tempest-GroupSnapshotsTest-1124623539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:09:36 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-431248dc-8f22-48f7-80f5-513b8f390f3f tempest-GroupSnapshotsTest-1124623539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:09:36 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-431248dc-8f22-48f7-80f5-513b8f390f3f tempest-GroupSnapshotsTest-1124623539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:09:36 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-431248dc-8f22-48f7-80f5-513b8f390f3f tempest-GroupSnapshotsTest-1124623539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:09:36 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-431248dc-8f22-48f7-80f5-513b8f390f3f tempest-GroupSnapshotsTest-1124623539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:09:36 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-431248dc-8f22-48f7-80f5-513b8f390f3f tempest-GroupSnapshotsTest-1124623539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:36 devstack sudo[89577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:09:36 devstack sudo[89577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:36 devstack sudo[89575]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:36 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-42572b58-67cc-4c13-848f-c727f67eca62 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-110fc230-88e1-47f1-8ab7-1bb7f0ce6d23 1073741824" returned: 0 in 1.222s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:36 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-42572b58-67cc-4c13-848f-c727f67eca62 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-110fc230-88e1-47f1-8ab7-1bb7f0ce6d23 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:36 devstack sudo[89583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-110fc230-88e1-47f1-8ab7-1bb7f0ce6d23
Apr 28 22:09:36 devstack sudo[89583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:36 devstack sudo[89577]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:36 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-431248dc-8f22-48f7-80f5-513b8f390f3f tempest-GroupSnapshotsTest-1124623539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.884s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:36 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-431248dc-8f22-48f7-80f5-513b8f390f3f tempest-GroupSnapshotsTest-1124623539 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:09:36 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-6499250b-34e8-4afa-959c-83be639537cc tempest-GroupSnapshotsTest-1124623539 None] Group tempest-GroupSnapshotsTest-Group-2060930653: creating
Apr 28 22:09:36 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-431248dc-8f22-48f7-80f5-513b8f390f3f tempest-GroupSnapshotsTest-1124623539 None] Delete group completed successfully.
Apr 28 22:09:37 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-6499250b-34e8-4afa-959c-83be639537cc tempest-GroupSnapshotsTest-1124623539 None] Group tempest-GroupSnapshotsTest-Group-2060930653: created successfully
Apr 28 22:09:37 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-6499250b-34e8-4afa-959c-83be639537cc tempest-GroupSnapshotsTest-1124623539 None] Create group completed successfully.
Apr 28 22:09:37 devstack sudo[89583]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:37 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-42572b58-67cc-4c13-848f-c727f67eca62 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-110fc230-88e1-47f1-8ab7-1bb7f0ce6d23" returned: 0 in 0.791s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:37 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-42572b58-67cc-4c13-848f-c727f67eca62 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] <== create_volume: return (2075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:09:37 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-42572b58-67cc-4c13-848f-c727f67eca62 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.079s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:09:37 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-498272b8-408e-4cc8-854f-71c31b8b9419 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.041s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:09:37 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-498272b8-408e-4cc8-854f-71c31b8b9419 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:09:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-976800889',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c761dfe-040f-41c5-9a57-a1039d7a0730,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34b3aa27fb8244058989e0a7a47f4755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:09:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:09:31Z,use_quota=True,user_id='f3981ac072de4f70845ba313a7abfa90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:09:37 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-498272b8-408e-4cc8-854f-71c31b8b9419 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Creating volume 2c761dfe-040f-41c5-9a57-a1039d7a0730 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:09:37 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-498272b8-408e-4cc8-854f-71c31b8b9419 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:09:37 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-498272b8-408e-4cc8-854f-71c31b8b9419 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:09:37 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-498272b8-408e-4cc8-854f-71c31b8b9419 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:09:37 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-498272b8-408e-4cc8-854f-71c31b8b9419 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:09:37 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-498272b8-408e-4cc8-854f-71c31b8b9419 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:09:37 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-498272b8-408e-4cc8-854f-71c31b8b9419 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:09:37 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-498272b8-408e-4cc8-854f-71c31b8b9419 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:09:37 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-498272b8-408e-4cc8-854f-71c31b8b9419 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2c761dfe-040f-41c5-9a57-a1039d7a0730 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:37 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-42572b58-67cc-4c13-848f-c727f67eca62 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (884c52e8-4410-46d4-9852-6dc7cf9f522d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-110fc230-88e1-47f1-8ab7-1bb7f0ce6d23', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:09:37 devstack sudo[89587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2c761dfe-040f-41c5-9a57-a1039d7a0730 1073741824
Apr 28 22:09:37 devstack sudo[89587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:37 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-42572b58-67cc-4c13-848f-c727f67eca62 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (341cc1fd-5eca-4869-9984-eeac55eb07b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:09:37 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-42572b58-67cc-4c13-848f-c727f67eca62 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Volume volume-110fc230-88e1-47f1-8ab7-1bb7f0ce6d23 (110fc230-88e1-47f1-8ab7-1bb7f0ce6d23): created successfully
Apr 28 22:09:37 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-42572b58-67cc-4c13-848f-c727f67eca62 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (341cc1fd-5eca-4869-9984-eeac55eb07b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:09:37 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-42572b58-67cc-4c13-848f-c727f67eca62 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Flow 'volume_create_manager' (1eba5ade-d053-46ec-aa29-707ef183503a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:09:37 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-42572b58-67cc-4c13-848f-c727f67eca62 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Created volume successfully.
Apr 28 22:09:38 devstack sudo[89587]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:38 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-498272b8-408e-4cc8-854f-71c31b8b9419 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2c761dfe-040f-41c5-9a57-a1039d7a0730 1073741824" returned: 0 in 1.104s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:38 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-498272b8-408e-4cc8-854f-71c31b8b9419 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2c761dfe-040f-41c5-9a57-a1039d7a0730 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:38 devstack sudo[89593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2c761dfe-040f-41c5-9a57-a1039d7a0730
Apr 28 22:09:38 devstack sudo[89593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:38 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f1ffa2a-8bed-4669-a03e-6e0641e10840 tempest-GroupSnapshotsTest-1124623539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:09:38 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3f1ffa2a-8bed-4669-a03e-6e0641e10840 tempest-GroupSnapshotsTest-1124623539 None] Flow 'volume_create_manager' (d2cfa000-9be1-44e2-bd61-7888d7984e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:09:38 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3f1ffa2a-8bed-4669-a03e-6e0641e10840 tempest-GroupSnapshotsTest-1124623539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0ab4e55-ed90-4e3e-b3ad-e4aefdf8cfb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:09:38 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3f1ffa2a-8bed-4669-a03e-6e0641e10840 tempest-GroupSnapshotsTest-1124623539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0ab4e55-ed90-4e3e-b3ad-e4aefdf8cfb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:09:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1364198173',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7f776eb3-8081-4b49-ad36-e98155c364b5,host='devstack@QuobyteHD#QuobyteHD',id=517db8a5-3db4-4b27-9c92-d9b4117f98f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29d2f5d38aff44ebb5481ff2a7413f6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:09:39Z,use_quota=True,user_id='6cc1cf2f2521481c81eae86959034746',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a561b66-8102-47e6-adf6-6f22915cee87),volume_type_id=3a561b66-8102-47e6-adf6-6f22915cee87)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:09:38 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3f1ffa2a-8bed-4669-a03e-6e0641e10840 tempest-GroupSnapshotsTest-1124623539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f727d3a-74b0-4001-8ab3-dce8b40cffa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:09:38 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3f1ffa2a-8bed-4669-a03e-6e0641e10840 tempest-GroupSnapshotsTest-1124623539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f727d3a-74b0-4001-8ab3-dce8b40cffa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:09:38 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3f1ffa2a-8bed-4669-a03e-6e0641e10840 tempest-GroupSnapshotsTest-1124623539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (013820c4-4702-49af-bc0a-b7c46889087a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:09:38 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3f1ffa2a-8bed-4669-a03e-6e0641e10840 tempest-GroupSnapshotsTest-1124623539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (013820c4-4702-49af-bc0a-b7c46889087a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '517db8a5-3db4-4b27-9c92-d9b4117f98f4', 'volume_name': 'volume-517db8a5-3db4-4b27-9c92-d9b4117f98f4', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:09:38 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3f1ffa2a-8bed-4669-a03e-6e0641e10840 tempest-GroupSnapshotsTest-1124623539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (466debdf-a3b7-4ba6-9d24-2acd7db69c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:09:38 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3f1ffa2a-8bed-4669-a03e-6e0641e10840 tempest-GroupSnapshotsTest-1124623539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (466debdf-a3b7-4ba6-9d24-2acd7db69c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:09:38 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3f1ffa2a-8bed-4669-a03e-6e0641e10840 tempest-GroupSnapshotsTest-1124623539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b399268-1f79-4d0a-aecf-e86867784c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:09:38 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-3f1ffa2a-8bed-4669-a03e-6e0641e10840 tempest-GroupSnapshotsTest-1124623539 None] Volume 517db8a5-3db4-4b27-9c92-d9b4117f98f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-517db8a5-3db4-4b27-9c92-d9b4117f98f4', 'volume_size': 1}
Apr 28 22:09:38 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-3f1ffa2a-8bed-4669-a03e-6e0641e10840 tempest-GroupSnapshotsTest-1124623539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:09:39 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-96b50366-dc58-4bdf-9eb1-f65d2b51afc4 tempest-VolumesNegativeTest-2135850914 None] Acquiring lock "cinder-8a25a468-d4f0-4138-b7bf-67cc2af32574-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:09:39 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-96b50366-dc58-4bdf-9eb1-f65d2b51afc4 tempest-VolumesNegativeTest-2135850914 None] Lock "cinder-8a25a468-d4f0-4138-b7bf-67cc2af32574-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:09:39 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-96b50366-dc58-4bdf-9eb1-f65d2b51afc4 tempest-VolumesNegativeTest-2135850914 None] Acquiring lock "cinder-quobyte-8a25a468-d4f0-4138-b7bf-67cc2af32574" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:09:39 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-96b50366-dc58-4bdf-9eb1-f65d2b51afc4 tempest-VolumesNegativeTest-2135850914 None] Lock "cinder-quobyte-8a25a468-d4f0-4138-b7bf-67cc2af32574" acquired by "delete_volume" :: waited 0.018s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:09:39 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc4b031-a8f7-4f9c-9cfb-485d6a5591f2]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:09:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-96b50366-dc58-4bdf-9eb1-f65d2b51afc4 tempest-VolumesNegativeTest-2135850914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8a25a468-d4f0-4138-b7bf-67cc2af32574 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:39 devstack sudo[89593]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-498272b8-408e-4cc8-854f-71c31b8b9419 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2c761dfe-040f-41c5-9a57-a1039d7a0730" returned: 0 in 0.718s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:39 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-498272b8-408e-4cc8-854f-71c31b8b9419 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] <== create_volume: return (1889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:09:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-498272b8-408e-4cc8-854f-71c31b8b9419 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.894s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:09:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-3f1ffa2a-8bed-4669-a03e-6e0641e10840 tempest-GroupSnapshotsTest-1124623539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.492s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:09:39 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-3f1ffa2a-8bed-4669-a03e-6e0641e10840 tempest-GroupSnapshotsTest-1124623539 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=7f776eb3-8081-4b49-ad36-e98155c364b5,created_at=2026-04-28T20:09:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1364198173',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7f776eb3-8081-4b49-ad36-e98155c364b5,host='devstack@QuobyteHD#QuobyteHD',id=517db8a5-3db4-4b27-9c92-d9b4117f98f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29d2f5d38aff44ebb5481ff2a7413f6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:09:39Z,use_quota=True,user_id='6cc1cf2f2521481c81eae86959034746',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a561b66-8102-47e6-adf6-6f22915cee87),volume_type_id=3a561b66-8102-47e6-adf6-6f22915cee87)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:09:39 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-3f1ffa2a-8bed-4669-a03e-6e0641e10840 tempest-GroupSnapshotsTest-1124623539 None] Creating volume 517db8a5-3db4-4b27-9c92-d9b4117f98f4 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:09:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-3f1ffa2a-8bed-4669-a03e-6e0641e10840 tempest-GroupSnapshotsTest-1124623539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:09:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-3f1ffa2a-8bed-4669-a03e-6e0641e10840 tempest-GroupSnapshotsTest-1124623539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:09:39 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-3f1ffa2a-8bed-4669-a03e-6e0641e10840 tempest-GroupSnapshotsTest-1124623539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:09:39 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-3f1ffa2a-8bed-4669-a03e-6e0641e10840 tempest-GroupSnapshotsTest-1124623539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:09:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-3f1ffa2a-8bed-4669-a03e-6e0641e10840 tempest-GroupSnapshotsTest-1124623539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:09:39 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-3f1ffa2a-8bed-4669-a03e-6e0641e10840 tempest-GroupSnapshotsTest-1124623539 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:09:39 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-3f1ffa2a-8bed-4669-a03e-6e0641e10840 tempest-GroupSnapshotsTest-1124623539 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:09:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-3f1ffa2a-8bed-4669-a03e-6e0641e10840 tempest-GroupSnapshotsTest-1124623539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-517db8a5-3db4-4b27-9c92-d9b4117f98f4 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:39 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-498272b8-408e-4cc8-854f-71c31b8b9419 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70ad5eef-4ef9-41bb-aa3c-47dfd1103ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c761dfe-040f-41c5-9a57-a1039d7a0730', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:09:39 devstack sudo[89596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8a25a468-d4f0-4138-b7bf-67cc2af32574
Apr 28 22:09:39 devstack sudo[89596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:39 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-498272b8-408e-4cc8-854f-71c31b8b9419 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8f30080-d5de-484e-80f9-13708d2fa9b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:09:39 devstack sudo[89597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-517db8a5-3db4-4b27-9c92-d9b4117f98f4 1073741824
Apr 28 22:09:39 devstack sudo[89597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:39 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-498272b8-408e-4cc8-854f-71c31b8b9419 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Volume volume-2c761dfe-040f-41c5-9a57-a1039d7a0730 (2c761dfe-040f-41c5-9a57-a1039d7a0730): created successfully
Apr 28 22:09:39 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-498272b8-408e-4cc8-854f-71c31b8b9419 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8f30080-d5de-484e-80f9-13708d2fa9b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:09:39 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-498272b8-408e-4cc8-854f-71c31b8b9419 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Flow 'volume_create_manager' (4d8fb2e0-4bc2-4b21-8956-273d931efae2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:09:39 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-498272b8-408e-4cc8-854f-71c31b8b9419 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Created volume successfully.
Apr 28 22:09:39 devstack cinder-volume[83924]: DEBUG oslo_service.periodic_task [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83924) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 28 22:09:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:09:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:09:39 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:09:39 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:09:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:09:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:39 devstack sudo[89600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:09:39 devstack sudo[89600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:40 devstack sudo[89596]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:40 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-96b50366-dc58-4bdf-9eb1-f65d2b51afc4 tempest-VolumesNegativeTest-2135850914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8a25a468-d4f0-4138-b7bf-67cc2af32574" returned: 0 in 0.929s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:40 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-96b50366-dc58-4bdf-9eb1-f65d2b51afc4 tempest-VolumesNegativeTest-2135850914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8a25a468-d4f0-4138-b7bf-67cc2af32574 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:40 devstack sudo[89609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8a25a468-d4f0-4138-b7bf-67cc2af32574
Apr 28 22:09:40 devstack sudo[89609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:40 devstack sudo[89597]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:40 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-3f1ffa2a-8bed-4669-a03e-6e0641e10840 tempest-GroupSnapshotsTest-1124623539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-517db8a5-3db4-4b27-9c92-d9b4117f98f4 1073741824" returned: 0 in 1.079s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:40 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-3f1ffa2a-8bed-4669-a03e-6e0641e10840 tempest-GroupSnapshotsTest-1124623539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-517db8a5-3db4-4b27-9c92-d9b4117f98f4 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:40 devstack sudo[89600]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:40 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.817s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:40 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:09:40 devstack sudo[89612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-517db8a5-3db4-4b27-9c92-d9b4117f98f4
Apr 28 22:09:40 devstack sudo[89612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:40 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-be5c8901-3ba2-4d8e-8f7a-ea760c2780f0 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Acquiring lock "cinder-2c761dfe-040f-41c5-9a57-a1039d7a0730-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:09:40 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-be5c8901-3ba2-4d8e-8f7a-ea760c2780f0 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Lock "cinder-2c761dfe-040f-41c5-9a57-a1039d7a0730-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:09:40 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-be5c8901-3ba2-4d8e-8f7a-ea760c2780f0 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Acquiring lock "cinder-quobyte-2c761dfe-040f-41c5-9a57-a1039d7a0730" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:09:40 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-be5c8901-3ba2-4d8e-8f7a-ea760c2780f0 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Lock "cinder-quobyte-2c761dfe-040f-41c5-9a57-a1039d7a0730" acquired by "delete_volume" :: waited 0.024s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:09:40 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb0fccd-ec00-4d81-806c-a81336317ee3]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:09:40 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-be5c8901-3ba2-4d8e-8f7a-ea760c2780f0 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2c761dfe-040f-41c5-9a57-a1039d7a0730 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:40 devstack sudo[89614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2c761dfe-040f-41c5-9a57-a1039d7a0730
Apr 28 22:09:40 devstack sudo[89614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:40 devstack sudo[89609]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:41 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-96b50366-dc58-4bdf-9eb1-f65d2b51afc4 tempest-VolumesNegativeTest-2135850914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8a25a468-d4f0-4138-b7bf-67cc2af32574" returned: 0 in 0.813s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:41 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-96b50366-dc58-4bdf-9eb1-f65d2b51afc4 tempest-VolumesNegativeTest-2135850914 None] Lock "cinder-quobyte-8a25a468-d4f0-4138-b7bf-67cc2af32574" released by "delete_volume" :: held 1.799s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:09:41 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-96b50366-dc58-4bdf-9eb1-f65d2b51afc4 tempest-VolumesNegativeTest-2135850914 None] Created reservations ['48681523-a158-4d5c-a7d3-0535cfd70844', '96ccf1e1-063d-4996-bc63-d721a266ab2c', '3a4ddf93-9e67-4b90-8a89-b27300e31f82', '06d94748-6e26-415a-9d64-f731f3a74168'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:09:41 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-96b50366-dc58-4bdf-9eb1-f65d2b51afc4 tempest-VolumesNegativeTest-2135850914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:09:41 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-96b50366-dc58-4bdf-9eb1-f65d2b51afc4 tempest-VolumesNegativeTest-2135850914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:09:41 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-96b50366-dc58-4bdf-9eb1-f65d2b51afc4 tempest-VolumesNegativeTest-2135850914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:09:41 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-96b50366-dc58-4bdf-9eb1-f65d2b51afc4 tempest-VolumesNegativeTest-2135850914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:09:41 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-96b50366-dc58-4bdf-9eb1-f65d2b51afc4 tempest-VolumesNegativeTest-2135850914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:09:41 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-96b50366-dc58-4bdf-9eb1-f65d2b51afc4 tempest-VolumesNegativeTest-2135850914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:41 devstack sudo[89619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:09:41 devstack sudo[89619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:41 devstack sudo[89612]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:41 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-3f1ffa2a-8bed-4669-a03e-6e0641e10840 tempest-GroupSnapshotsTest-1124623539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-517db8a5-3db4-4b27-9c92-d9b4117f98f4" returned: 0 in 0.816s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:41 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-3f1ffa2a-8bed-4669-a03e-6e0641e10840 tempest-GroupSnapshotsTest-1124623539 None] <== create_volume: return (1942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:09:41 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-3f1ffa2a-8bed-4669-a03e-6e0641e10840 tempest-GroupSnapshotsTest-1124623539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.945s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:09:41 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3f1ffa2a-8bed-4669-a03e-6e0641e10840 tempest-GroupSnapshotsTest-1124623539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b399268-1f79-4d0a-aecf-e86867784c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-517db8a5-3db4-4b27-9c92-d9b4117f98f4', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:09:41 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3f1ffa2a-8bed-4669-a03e-6e0641e10840 tempest-GroupSnapshotsTest-1124623539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7645c3e6-b490-4c03-a02b-41ef33848b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:09:41 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-3f1ffa2a-8bed-4669-a03e-6e0641e10840 tempest-GroupSnapshotsTest-1124623539 None] Volume volume-517db8a5-3db4-4b27-9c92-d9b4117f98f4 (517db8a5-3db4-4b27-9c92-d9b4117f98f4): created successfully
Apr 28 22:09:41 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3f1ffa2a-8bed-4669-a03e-6e0641e10840 tempest-GroupSnapshotsTest-1124623539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7645c3e6-b490-4c03-a02b-41ef33848b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:09:41 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3f1ffa2a-8bed-4669-a03e-6e0641e10840 tempest-GroupSnapshotsTest-1124623539 None] Flow 'volume_create_manager' (d2cfa000-9be1-44e2-bd61-7888d7984e20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:09:41 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-3f1ffa2a-8bed-4669-a03e-6e0641e10840 tempest-GroupSnapshotsTest-1124623539 None] Created volume successfully.
Apr 28 22:09:41 devstack sudo[89614]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:41 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-be5c8901-3ba2-4d8e-8f7a-ea760c2780f0 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2c761dfe-040f-41c5-9a57-a1039d7a0730" returned: 0 in 0.850s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:41 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-be5c8901-3ba2-4d8e-8f7a-ea760c2780f0 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2c761dfe-040f-41c5-9a57-a1039d7a0730 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:41 devstack sudo[89624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2c761dfe-040f-41c5-9a57-a1039d7a0730
Apr 28 22:09:41 devstack sudo[89624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:41 devstack sudo[89619]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:41 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-96b50366-dc58-4bdf-9eb1-f65d2b51afc4 tempest-VolumesNegativeTest-2135850914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.694s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:41 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-96b50366-dc58-4bdf-9eb1-f65d2b51afc4 tempest-VolumesNegativeTest-2135850914 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:09:41 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-96b50366-dc58-4bdf-9eb1-f65d2b51afc4 tempest-VolumesNegativeTest-2135850914 None] Deleted volume successfully.
Apr 28 22:09:41 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-96b50366-dc58-4bdf-9eb1-f65d2b51afc4 tempest-VolumesNegativeTest-2135850914 None] Lock "cinder-8a25a468-d4f0-4138-b7bf-67cc2af32574-delete_volume" released by "delete_volume" :: held 2.739s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:09:42 devstack sudo[89624]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:42 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-be5c8901-3ba2-4d8e-8f7a-ea760c2780f0 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2c761dfe-040f-41c5-9a57-a1039d7a0730" returned: 0 in 0.684s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:42 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-be5c8901-3ba2-4d8e-8f7a-ea760c2780f0 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Lock "cinder-quobyte-2c761dfe-040f-41c5-9a57-a1039d7a0730" released by "delete_volume" :: held 1.592s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:09:42 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-4d9b29e5-c4d5-4774-af23-d30636d2bd24 tempest-GroupSnapshotsTest-1124623539 None] GroupSnapshot 1657a9a2-944f-437a-af36-16dcfbc7eb76: creating.
Apr 28 22:09:42 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-be5c8901-3ba2-4d8e-8f7a-ea760c2780f0 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Created reservations ['da6f81dd-4949-4c45-bb9b-8b1124ed41ef', 'f2d374b1-3e73-4524-8da2-06256e6165a8', '3b51e89a-cf69-496e-9e8f-c52fe77072bc', 'f76f2247-19cb-4a5b-af88-3b1ade15863b'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:09:42 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-4d9b29e5-c4d5-4774-af23-d30636d2bd24 tempest-GroupSnapshotsTest-1124623539 None] Group snapshot 1657a9a2-944f-437a-af36-16dcfbc7eb76: creating. {{(pid=83924) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 28 22:09:42 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-4d9b29e5-c4d5-4774-af23-d30636d2bd24 tempest-GroupSnapshotsTest-1124623539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:09:42 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-4d9b29e5-c4d5-4774-af23-d30636d2bd24 tempest-GroupSnapshotsTest-1124623539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:09:42 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-4d9b29e5-c4d5-4774-af23-d30636d2bd24 tempest-GroupSnapshotsTest-1124623539 None] Creating offline snapshot 0df10bbf-1b0e-4802-b1bf-b58e9e720737 of volume 517db8a5-3db4-4b27-9c92-d9b4117f98f4 {{(pid=83924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 22:09:42 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ada0633-f391-44a9-a4e9-052049a385cf]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:09:42 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4d9b29e5-c4d5-4774-af23-d30636d2bd24 tempest-GroupSnapshotsTest-1124623539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-517db8a5-3db4-4b27-9c92-d9b4117f98f4 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:42 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-be5c8901-3ba2-4d8e-8f7a-ea760c2780f0 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:09:42 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-be5c8901-3ba2-4d8e-8f7a-ea760c2780f0 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:09:42 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-be5c8901-3ba2-4d8e-8f7a-ea760c2780f0 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:09:42 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-be5c8901-3ba2-4d8e-8f7a-ea760c2780f0 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:09:42 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-be5c8901-3ba2-4d8e-8f7a-ea760c2780f0 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:09:42 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-be5c8901-3ba2-4d8e-8f7a-ea760c2780f0 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:42 devstack sudo[89629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:09:42 devstack sudo[89629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:42 devstack sudo[89628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-517db8a5-3db4-4b27-9c92-d9b4117f98f4
Apr 28 22:09:42 devstack sudo[89628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:42 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-079873a9-ddc6-44b6-a36e-dc267b0e8520 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Acquiring lock "cinder-110fc230-88e1-47f1-8ab7-1bb7f0ce6d23-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:09:43 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-079873a9-ddc6-44b6-a36e-dc267b0e8520 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Lock "cinder-110fc230-88e1-47f1-8ab7-1bb7f0ce6d23-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:09:43 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-079873a9-ddc6-44b6-a36e-dc267b0e8520 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Acquiring lock "cinder-quobyte-110fc230-88e1-47f1-8ab7-1bb7f0ce6d23" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:09:43 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a9bdc27-0e4d-4efe-a9a2-d9a2c6ef22ce tempest-VolumeRetypeWithoutMigrationTest-1341522919 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:09:43 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-6a9bdc27-0e4d-4efe-a9a2-d9a2c6ef22ce tempest-VolumeRetypeWithoutMigrationTest-1341522919 None] Flow 'volume_create_manager' (61d02023-99af-492d-a8ea-c7b82e7bef24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:09:43 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-6a9bdc27-0e4d-4efe-a9a2-d9a2c6ef22ce tempest-VolumeRetypeWithoutMigrationTest-1341522919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bd8fe7e-4711-44e3-a7ae-1c02269f2e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:09:43 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-079873a9-ddc6-44b6-a36e-dc267b0e8520 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Lock "cinder-quobyte-110fc230-88e1-47f1-8ab7-1bb7f0ce6d23" acquired by "delete_volume" :: waited 0.054s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:09:43 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-6a9bdc27-0e4d-4efe-a9a2-d9a2c6ef22ce tempest-VolumeRetypeWithoutMigrationTest-1341522919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bd8fe7e-4711-44e3-a7ae-1c02269f2e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:09:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2120767428',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d56591af-f277-4094-b891-bed948cd2c0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5029b03cfdbb44fea7a5eaa75b409c3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:09:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:09:43Z,use_quota=True,user_id='c6569ff40c2b4627915e4c146a6addd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a8f1267-1172-41c7-b4f3-48742cc3e590),volume_type_id=0a8f1267-1172-41c7-b4f3-48742cc3e590)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:09:43 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-6a9bdc27-0e4d-4efe-a9a2-d9a2c6ef22ce tempest-VolumeRetypeWithoutMigrationTest-1341522919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36130328-0a71-48c6-a13b-35d3a35fbca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:09:43 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-6a9bdc27-0e4d-4efe-a9a2-d9a2c6ef22ce tempest-VolumeRetypeWithoutMigrationTest-1341522919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36130328-0a71-48c6-a13b-35d3a35fbca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:09:43 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-6a9bdc27-0e4d-4efe-a9a2-d9a2c6ef22ce tempest-VolumeRetypeWithoutMigrationTest-1341522919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64a29192-d83c-4f94-9791-c353cffad2a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:09:43 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-6a9bdc27-0e4d-4efe-a9a2-d9a2c6ef22ce tempest-VolumeRetypeWithoutMigrationTest-1341522919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64a29192-d83c-4f94-9791-c353cffad2a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd56591af-f277-4094-b891-bed948cd2c0d', 'volume_name': 'volume-d56591af-f277-4094-b891-bed948cd2c0d', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:09:43 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-6a9bdc27-0e4d-4efe-a9a2-d9a2c6ef22ce tempest-VolumeRetypeWithoutMigrationTest-1341522919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f918dfd8-40db-42b7-b147-b80355235521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:09:43 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-6a9bdc27-0e4d-4efe-a9a2-d9a2c6ef22ce tempest-VolumeRetypeWithoutMigrationTest-1341522919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f918dfd8-40db-42b7-b147-b80355235521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:09:43 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-6a9bdc27-0e4d-4efe-a9a2-d9a2c6ef22ce tempest-VolumeRetypeWithoutMigrationTest-1341522919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6a3ad48-1a49-4193-9e41-44c383da4bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:09:43 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-6a9bdc27-0e4d-4efe-a9a2-d9a2c6ef22ce tempest-VolumeRetypeWithoutMigrationTest-1341522919 None] Volume d56591af-f277-4094-b891-bed948cd2c0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d56591af-f277-4094-b891-bed948cd2c0d', 'volume_size': 1}
Apr 28 22:09:43 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-6a9bdc27-0e4d-4efe-a9a2-d9a2c6ef22ce tempest-VolumeRetypeWithoutMigrationTest-1341522919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:09:43 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83e530c-09d5-4b98-ad5d-df43c8639173]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:09:43 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-079873a9-ddc6-44b6-a36e-dc267b0e8520 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-110fc230-88e1-47f1-8ab7-1bb7f0ce6d23 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:43 devstack sudo[89629]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:43 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-be5c8901-3ba2-4d8e-8f7a-ea760c2780f0 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.739s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:43 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-be5c8901-3ba2-4d8e-8f7a-ea760c2780f0 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:09:43 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-be5c8901-3ba2-4d8e-8f7a-ea760c2780f0 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Deleted volume successfully.
Apr 28 22:09:43 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-be5c8901-3ba2-4d8e-8f7a-ea760c2780f0 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Lock "cinder-2c761dfe-040f-41c5-9a57-a1039d7a0730-delete_volume" released by "delete_volume" :: held 2.721s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:09:43 devstack sudo[89634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-110fc230-88e1-47f1-8ab7-1bb7f0ce6d23
Apr 28 22:09:43 devstack sudo[89634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:43 devstack sudo[89628]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:43 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4d9b29e5-c4d5-4774-af23-d30636d2bd24 tempest-GroupSnapshotsTest-1124623539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-517db8a5-3db4-4b27-9c92-d9b4117f98f4" returned: 0 in 0.982s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:43 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4d9b29e5-c4d5-4774-af23-d30636d2bd24 tempest-GroupSnapshotsTest-1124623539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-517db8a5-3db4-4b27-9c92-d9b4117f98f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-517db8a5-3db4-4b27-9c92-d9b4117f98f4.0df10bbf-1b0e-4802-b1bf-b58e9e720737 1G {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:43 devstack sudo[89639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-517db8a5-3db4-4b27-9c92-d9b4117f98f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-517db8a5-3db4-4b27-9c92-d9b4117f98f4.0df10bbf-1b0e-4802-b1bf-b58e9e720737 1G
Apr 28 22:09:43 devstack sudo[89639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:43 devstack sudo[89634]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:43 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-079873a9-ddc6-44b6-a36e-dc267b0e8520 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-110fc230-88e1-47f1-8ab7-1bb7f0ce6d23" returned: 0 in 0.741s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:43 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-079873a9-ddc6-44b6-a36e-dc267b0e8520 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-110fc230-88e1-47f1-8ab7-1bb7f0ce6d23 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:43 devstack sudo[89644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-110fc230-88e1-47f1-8ab7-1bb7f0ce6d23
Apr 28 22:09:43 devstack sudo[89644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:44 devstack sudo[89639]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:44 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4d9b29e5-c4d5-4774-af23-d30636d2bd24 tempest-GroupSnapshotsTest-1124623539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-517db8a5-3db4-4b27-9c92-d9b4117f98f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-517db8a5-3db4-4b27-9c92-d9b4117f98f4.0df10bbf-1b0e-4802-b1bf-b58e9e720737 1G" returned: 0 in 0.828s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:44 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4d9b29e5-c4d5-4774-af23-d30636d2bd24 tempest-GroupSnapshotsTest-1124623539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-517db8a5-3db4-4b27-9c92-d9b4117f98f4 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-517db8a5-3db4-4b27-9c92-d9b4117f98f4.0df10bbf-1b0e-4802-b1bf-b58e9e720737 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:44 devstack sudo[89649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-517db8a5-3db4-4b27-9c92-d9b4117f98f4 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-517db8a5-3db4-4b27-9c92-d9b4117f98f4.0df10bbf-1b0e-4802-b1bf-b58e9e720737
Apr 28 22:09:44 devstack sudo[89649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:44 devstack sudo[89644]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:44 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-079873a9-ddc6-44b6-a36e-dc267b0e8520 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-110fc230-88e1-47f1-8ab7-1bb7f0ce6d23" returned: 0 in 0.559s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:44 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-079873a9-ddc6-44b6-a36e-dc267b0e8520 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Lock "cinder-quobyte-110fc230-88e1-47f1-8ab7-1bb7f0ce6d23" released by "delete_volume" :: held 1.383s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:09:44 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-079873a9-ddc6-44b6-a36e-dc267b0e8520 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Created reservations ['b2ebdc24-65ea-400b-a3e3-817d0ea9f84d', 'b720a6d1-a1a4-49a4-874c-89b718a1566c', '895dda5e-0fbc-492f-9bdd-3771eb8a47b4', 'c3c5dc2b-1717-4d24-af89-cb0c2a7853cb'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:09:44 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-079873a9-ddc6-44b6-a36e-dc267b0e8520 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:09:44 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-079873a9-ddc6-44b6-a36e-dc267b0e8520 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:09:44 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-079873a9-ddc6-44b6-a36e-dc267b0e8520 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:09:44 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-079873a9-ddc6-44b6-a36e-dc267b0e8520 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:09:44 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-079873a9-ddc6-44b6-a36e-dc267b0e8520 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:09:44 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-079873a9-ddc6-44b6-a36e-dc267b0e8520 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:44 devstack sudo[89652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:09:44 devstack sudo[89652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:44 devstack sudo[89649]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:44 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4d9b29e5-c4d5-4774-af23-d30636d2bd24 tempest-GroupSnapshotsTest-1124623539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-517db8a5-3db4-4b27-9c92-d9b4117f98f4 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-517db8a5-3db4-4b27-9c92-d9b4117f98f4.0df10bbf-1b0e-4802-b1bf-b58e9e720737" returned: 0 in 0.675s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:44 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-4d9b29e5-c4d5-4774-af23-d30636d2bd24 tempest-GroupSnapshotsTest-1124623539 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-517db8a5-3db4-4b27-9c92-d9b4117f98f4.0df10bbf-1b0e-4802-b1bf-b58e9e720737 is being set with open permissions: ugo+rw: NotImplementedError
Apr 28 22:09:44 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4d9b29e5-c4d5-4774-af23-d30636d2bd24 tempest-GroupSnapshotsTest-1124623539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-517db8a5-3db4-4b27-9c92-d9b4117f98f4.0df10bbf-1b0e-4802-b1bf-b58e9e720737 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:44 devstack sudo[89657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-517db8a5-3db4-4b27-9c92-d9b4117f98f4.0df10bbf-1b0e-4802-b1bf-b58e9e720737
Apr 28 22:09:44 devstack sudo[89657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:45 devstack sudo[89652]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:45 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-079873a9-ddc6-44b6-a36e-dc267b0e8520 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.585s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:45 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-079873a9-ddc6-44b6-a36e-dc267b0e8520 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:09:45 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-079873a9-ddc6-44b6-a36e-dc267b0e8520 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Deleted volume successfully.
Apr 28 22:09:45 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-079873a9-ddc6-44b6-a36e-dc267b0e8520 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Lock "cinder-110fc230-88e1-47f1-8ab7-1bb7f0ce6d23-delete_volume" released by "delete_volume" :: held 2.258s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:09:45 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-3b739797-b218-4c21-9825-a69ddd8ae77b tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Acquiring lock "cinder-ffab0336-9d81-4dcb-9504-c2e93ca76175-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:09:45 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-3b739797-b218-4c21-9825-a69ddd8ae77b tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Lock "cinder-ffab0336-9d81-4dcb-9504-c2e93ca76175-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:09:45 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-3b739797-b218-4c21-9825-a69ddd8ae77b tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Acquiring lock "cinder-quobyte-ffab0336-9d81-4dcb-9504-c2e93ca76175" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:09:45 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-3b739797-b218-4c21-9825-a69ddd8ae77b tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Lock "cinder-quobyte-ffab0336-9d81-4dcb-9504-c2e93ca76175" acquired by "delete_volume" :: waited 0.018s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:09:45 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a9402d-5463-4791-957b-caa2c7aadae5]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:09:45 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-3b739797-b218-4c21-9825-a69ddd8ae77b tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ffab0336-9d81-4dcb-9504-c2e93ca76175 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:45 devstack sudo[89660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ffab0336-9d81-4dcb-9504-c2e93ca76175
Apr 28 22:09:45 devstack sudo[89660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:45 devstack sudo[89657]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:45 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4d9b29e5-c4d5-4774-af23-d30636d2bd24 tempest-GroupSnapshotsTest-1124623539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-517db8a5-3db4-4b27-9c92-d9b4117f98f4.0df10bbf-1b0e-4802-b1bf-b58e9e720737" returned: 0 in 0.661s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:45 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4d9b29e5-c4d5-4774-af23-d30636d2bd24 tempest-GroupSnapshotsTest-1124623539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-517db8a5-3db4-4b27-9c92-d9b4117f98f4.info {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:45 devstack sudo[89663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-517db8a5-3db4-4b27-9c92-d9b4117f98f4.info
Apr 28 22:09:45 devstack sudo[89663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:46 devstack sudo[89660]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-3b739797-b218-4c21-9825-a69ddd8ae77b tempest-CreateVolumesFromSourceVolumeTest-220697289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ffab0336-9d81-4dcb-9504-c2e93ca76175" returned: 0 in 0.757s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-3b739797-b218-4c21-9825-a69ddd8ae77b tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ffab0336-9d81-4dcb-9504-c2e93ca76175 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:46 devstack sudo[89668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ffab0336-9d81-4dcb-9504-c2e93ca76175
Apr 28 22:09:46 devstack sudo[89668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:46 devstack sudo[89663]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4d9b29e5-c4d5-4774-af23-d30636d2bd24 tempest-GroupSnapshotsTest-1124623539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-517db8a5-3db4-4b27-9c92-d9b4117f98f4.info" returned: 0 in 0.617s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:46 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-4d9b29e5-c4d5-4774-af23-d30636d2bd24 tempest-GroupSnapshotsTest-1124623539 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-517db8a5-3db4-4b27-9c92-d9b4117f98f4.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 28 22:09:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4d9b29e5-c4d5-4774-af23-d30636d2bd24 tempest-GroupSnapshotsTest-1124623539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-517db8a5-3db4-4b27-9c92-d9b4117f98f4.info {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:46 devstack sudo[89671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-517db8a5-3db4-4b27-9c92-d9b4117f98f4.info
Apr 28 22:09:46 devstack sudo[89671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:46 devstack sudo[89668]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-3b739797-b218-4c21-9825-a69ddd8ae77b tempest-CreateVolumesFromSourceVolumeTest-220697289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ffab0336-9d81-4dcb-9504-c2e93ca76175" returned: 0 in 0.628s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:46 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-3b739797-b218-4c21-9825-a69ddd8ae77b tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Lock "cinder-quobyte-ffab0336-9d81-4dcb-9504-c2e93ca76175" released by "delete_volume" :: held 1.430s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:09:46 devstack sudo[89671]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:46 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-3b739797-b218-4c21-9825-a69ddd8ae77b tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Created reservations ['bb11b6fd-b25a-48b2-825a-3a87eb9bfca3', '49f271be-781b-4e32-a481-2a54475f89ab', '057beba8-b154-4275-b306-6b793957dbbe', 'd7261a67-1f89-41f2-b2d7-fb65402dc13b'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:09:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4d9b29e5-c4d5-4774-af23-d30636d2bd24 tempest-GroupSnapshotsTest-1124623539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-517db8a5-3db4-4b27-9c92-d9b4117f98f4.info" returned: 0 in 0.591s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-4d9b29e5-c4d5-4774-af23-d30636d2bd24 tempest-GroupSnapshotsTest-1124623539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.451s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:09:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-6a9bdc27-0e4d-4efe-a9a2-d9a2c6ef22ce tempest-VolumeRetypeWithoutMigrationTest-1341522919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.673s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:09:46 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-6a9bdc27-0e4d-4efe-a9a2-d9a2c6ef22ce tempest-VolumeRetypeWithoutMigrationTest-1341522919 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:09:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2120767428',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d56591af-f277-4094-b891-bed948cd2c0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5029b03cfdbb44fea7a5eaa75b409c3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:09:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:09:43Z,use_quota=True,user_id='c6569ff40c2b4627915e4c146a6addd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a8f1267-1172-41c7-b4f3-48742cc3e590),volume_type_id=0a8f1267-1172-41c7-b4f3-48742cc3e590)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:09:46 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-6a9bdc27-0e4d-4efe-a9a2-d9a2c6ef22ce tempest-VolumeRetypeWithoutMigrationTest-1341522919 None] Creating volume d56591af-f277-4094-b891-bed948cd2c0d {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:09:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-6a9bdc27-0e4d-4efe-a9a2-d9a2c6ef22ce tempest-VolumeRetypeWithoutMigrationTest-1341522919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:09:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-6a9bdc27-0e4d-4efe-a9a2-d9a2c6ef22ce tempest-VolumeRetypeWithoutMigrationTest-1341522919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:09:46 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-6a9bdc27-0e4d-4efe-a9a2-d9a2c6ef22ce tempest-VolumeRetypeWithoutMigrationTest-1341522919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:09:46 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-6a9bdc27-0e4d-4efe-a9a2-d9a2c6ef22ce tempest-VolumeRetypeWithoutMigrationTest-1341522919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:09:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-6a9bdc27-0e4d-4efe-a9a2-d9a2c6ef22ce tempest-VolumeRetypeWithoutMigrationTest-1341522919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:09:46 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-6a9bdc27-0e4d-4efe-a9a2-d9a2c6ef22ce tempest-VolumeRetypeWithoutMigrationTest-1341522919 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:09:46 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-6a9bdc27-0e4d-4efe-a9a2-d9a2c6ef22ce tempest-VolumeRetypeWithoutMigrationTest-1341522919 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:09:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-6a9bdc27-0e4d-4efe-a9a2-d9a2c6ef22ce tempest-VolumeRetypeWithoutMigrationTest-1341522919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-d56591af-f277-4094-b891-bed948cd2c0d 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:46 devstack sudo[89675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-d56591af-f277-4094-b891-bed948cd2c0d 1073741824
Apr 28 22:09:46 devstack sudo[89675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-3b739797-b218-4c21-9825-a69ddd8ae77b tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:09:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-3b739797-b218-4c21-9825-a69ddd8ae77b tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:09:46 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-3b739797-b218-4c21-9825-a69ddd8ae77b tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:09:46 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-3b739797-b218-4c21-9825-a69ddd8ae77b tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:09:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-3b739797-b218-4c21-9825-a69ddd8ae77b tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:09:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-3b739797-b218-4c21-9825-a69ddd8ae77b tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:46 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-4d9b29e5-c4d5-4774-af23-d30636d2bd24 tempest-GroupSnapshotsTest-1124623539 None] group_snapshot 1657a9a2-944f-437a-af36-16dcfbc7eb76: created successfully
Apr 28 22:09:46 devstack sudo[89677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:09:46 devstack sudo[89677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:47 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-30e1b273-c334-41e1-8071-3bda74559839 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Acquiring lock "cinder-56cb03fa-c7a3-44b2-b8a2-54bacc881548-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:09:47 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-30e1b273-c334-41e1-8071-3bda74559839 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Lock "cinder-56cb03fa-c7a3-44b2-b8a2-54bacc881548-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:09:47 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-30e1b273-c334-41e1-8071-3bda74559839 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Acquiring lock "cinder-quobyte-56cb03fa-c7a3-44b2-b8a2-54bacc881548" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:09:47 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-30e1b273-c334-41e1-8071-3bda74559839 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Lock "cinder-quobyte-56cb03fa-c7a3-44b2-b8a2-54bacc881548" acquired by "delete_volume" :: waited 0.032s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:09:47 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d9a3f5-8355-4fff-9823-3939911afb50]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:09:47 devstack sudo[89677]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:47 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-30e1b273-c334-41e1-8071-3bda74559839 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-56cb03fa-c7a3-44b2-b8a2-54bacc881548 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:47 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-3b739797-b218-4c21-9825-a69ddd8ae77b tempest-CreateVolumesFromSourceVolumeTest-220697289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.712s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:47 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-3b739797-b218-4c21-9825-a69ddd8ae77b tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:09:47 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-3b739797-b218-4c21-9825-a69ddd8ae77b tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Deleted volume successfully.
Apr 28 22:09:47 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-3b739797-b218-4c21-9825-a69ddd8ae77b tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Lock "cinder-ffab0336-9d81-4dcb-9504-c2e93ca76175-delete_volume" released by "delete_volume" :: held 2.422s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:09:47 devstack sudo[89675]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:47 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-6a9bdc27-0e4d-4efe-a9a2-d9a2c6ef22ce tempest-VolumeRetypeWithoutMigrationTest-1341522919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-d56591af-f277-4094-b891-bed948cd2c0d 1073741824" returned: 0 in 0.928s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:47 devstack sudo[89683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-56cb03fa-c7a3-44b2-b8a2-54bacc881548
Apr 28 22:09:47 devstack sudo[89683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:47 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-6a9bdc27-0e4d-4efe-a9a2-d9a2c6ef22ce tempest-VolumeRetypeWithoutMigrationTest-1341522919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-d56591af-f277-4094-b891-bed948cd2c0d {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:47 devstack sudo[89685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-d56591af-f277-4094-b891-bed948cd2c0d
Apr 28 22:09:47 devstack sudo[89685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:47 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-ac9d63ec-dc04-4afd-8592-b6d1c2fd9c0e tempest-GroupSnapshotsTest-1124623539 None] group_snapshot 1657a9a2-944f-437a-af36-16dcfbc7eb76: deleting
Apr 28 22:09:47 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-ac9d63ec-dc04-4afd-8592-b6d1c2fd9c0e tempest-GroupSnapshotsTest-1124623539 None] group_snapshot 1657a9a2-944f-437a-af36-16dcfbc7eb76: deleting {{(pid=83924) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 28 22:09:47 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-ac9d63ec-dc04-4afd-8592-b6d1c2fd9c0e tempest-GroupSnapshotsTest-1124623539 None] Acquiring lock "cinder-quobyte-517db8a5-3db4-4b27-9c92-d9b4117f98f4" by "delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:09:48 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-ac9d63ec-dc04-4afd-8592-b6d1c2fd9c0e tempest-GroupSnapshotsTest-1124623539 None] Lock "cinder-quobyte-517db8a5-3db4-4b27-9c92-d9b4117f98f4" acquired by "delete_snapshot" :: waited 0.026s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:09:48 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-ac9d63ec-dc04-4afd-8592-b6d1c2fd9c0e tempest-GroupSnapshotsTest-1124623539 None] Acquiring lock "cinder-quobyte-0df10bbf-1b0e-4802-b1bf-b58e9e720737" by "_delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:09:48 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-ac9d63ec-dc04-4afd-8592-b6d1c2fd9c0e tempest-GroupSnapshotsTest-1124623539 None] Lock "cinder-quobyte-0df10bbf-1b0e-4802-b1bf-b58e9e720737" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:09:48 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-ac9d63ec-dc04-4afd-8592-b6d1c2fd9c0e tempest-GroupSnapshotsTest-1124623539 None] Deleting offline snapshot 0df10bbf-1b0e-4802-b1bf-b58e9e720737 of volume 517db8a5-3db4-4b27-9c92-d9b4117f98f4 {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 22:09:48 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-ac9d63ec-dc04-4afd-8592-b6d1c2fd9c0e tempest-GroupSnapshotsTest-1124623539 None] snapshot_file for this snap is: volume-517db8a5-3db4-4b27-9c92-d9b4117f98f4.0df10bbf-1b0e-4802-b1bf-b58e9e720737 {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 22:09:48 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf87abcc-8d29-450f-90b2-bdb234ebac37]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:09:48 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-ac9d63ec-dc04-4afd-8592-b6d1c2fd9c0e tempest-GroupSnapshotsTest-1124623539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-517db8a5-3db4-4b27-9c92-d9b4117f98f4.0df10bbf-1b0e-4802-b1bf-b58e9e720737 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:48 devstack sudo[89687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-517db8a5-3db4-4b27-9c92-d9b4117f98f4.0df10bbf-1b0e-4802-b1bf-b58e9e720737
Apr 28 22:09:48 devstack sudo[89687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:48 devstack sudo[89683]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:48 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-30e1b273-c334-41e1-8071-3bda74559839 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-56cb03fa-c7a3-44b2-b8a2-54bacc881548" returned: 0 in 0.855s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:48 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-30e1b273-c334-41e1-8071-3bda74559839 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-56cb03fa-c7a3-44b2-b8a2-54bacc881548 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:48 devstack sudo[89693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-56cb03fa-c7a3-44b2-b8a2-54bacc881548
Apr 28 22:09:48 devstack sudo[89693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:48 devstack sudo[89685]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:48 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-6a9bdc27-0e4d-4efe-a9a2-d9a2c6ef22ce tempest-VolumeRetypeWithoutMigrationTest-1341522919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-d56591af-f277-4094-b891-bed948cd2c0d" returned: 0 in 0.802s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:48 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-6a9bdc27-0e4d-4efe-a9a2-d9a2c6ef22ce tempest-VolumeRetypeWithoutMigrationTest-1341522919 None] <== create_volume: return (1776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:09:48 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-6a9bdc27-0e4d-4efe-a9a2-d9a2c6ef22ce tempest-VolumeRetypeWithoutMigrationTest-1341522919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.779s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:09:48 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-6a9bdc27-0e4d-4efe-a9a2-d9a2c6ef22ce tempest-VolumeRetypeWithoutMigrationTest-1341522919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6a3ad48-1a49-4193-9e41-44c383da4bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d56591af-f277-4094-b891-bed948cd2c0d', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:09:48 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-6a9bdc27-0e4d-4efe-a9a2-d9a2c6ef22ce tempest-VolumeRetypeWithoutMigrationTest-1341522919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f8b3f63-5038-4446-8273-098f6d3fad31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:09:48 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-6a9bdc27-0e4d-4efe-a9a2-d9a2c6ef22ce tempest-VolumeRetypeWithoutMigrationTest-1341522919 None] Volume volume-d56591af-f277-4094-b891-bed948cd2c0d (d56591af-f277-4094-b891-bed948cd2c0d): created successfully
Apr 28 22:09:48 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-6a9bdc27-0e4d-4efe-a9a2-d9a2c6ef22ce tempest-VolumeRetypeWithoutMigrationTest-1341522919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f8b3f63-5038-4446-8273-098f6d3fad31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:09:48 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-6a9bdc27-0e4d-4efe-a9a2-d9a2c6ef22ce tempest-VolumeRetypeWithoutMigrationTest-1341522919 None] Flow 'volume_create_manager' (61d02023-99af-492d-a8ea-c7b82e7bef24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:09:48 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-6a9bdc27-0e4d-4efe-a9a2-d9a2c6ef22ce tempest-VolumeRetypeWithoutMigrationTest-1341522919 None] Created volume successfully.
Apr 28 22:09:48 devstack sudo[89687]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:48 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-ac9d63ec-dc04-4afd-8592-b6d1c2fd9c0e tempest-GroupSnapshotsTest-1124623539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-517db8a5-3db4-4b27-9c92-d9b4117f98f4.0df10bbf-1b0e-4802-b1bf-b58e9e720737" returned: 0 in 0.838s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:48 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-ac9d63ec-dc04-4afd-8592-b6d1c2fd9c0e tempest-GroupSnapshotsTest-1124623539 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-517db8a5-3db4-4b27-9c92-d9b4117f98f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 22:09:48 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea632bb6-4ab6-4496-9b65-1882c4aa5953]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:09:48 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-ac9d63ec-dc04-4afd-8592-b6d1c2fd9c0e tempest-GroupSnapshotsTest-1124623539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-517db8a5-3db4-4b27-9c92-d9b4117f98f4 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:49 devstack sudo[89698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-517db8a5-3db4-4b27-9c92-d9b4117f98f4
Apr 28 22:09:49 devstack sudo[89698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:49 devstack sudo[89693]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:49 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-30e1b273-c334-41e1-8071-3bda74559839 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-56cb03fa-c7a3-44b2-b8a2-54bacc881548" returned: 0 in 0.658s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:49 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-30e1b273-c334-41e1-8071-3bda74559839 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Lock "cinder-quobyte-56cb03fa-c7a3-44b2-b8a2-54bacc881548" released by "delete_volume" :: held 1.575s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:09:49 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-30e1b273-c334-41e1-8071-3bda74559839 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Created reservations ['0b115f5d-ce8c-464a-8538-fbea2b3f77f6', '380b53c7-3145-4904-8491-25646ca9dc0d', 'ecb601bb-3160-4945-a8f8-2d36334ec333', '15f43d66-44e2-4a8a-9b19-d71fcad39040'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:09:49 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-30e1b273-c334-41e1-8071-3bda74559839 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:09:49 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-30e1b273-c334-41e1-8071-3bda74559839 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:09:49 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-30e1b273-c334-41e1-8071-3bda74559839 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:09:49 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-30e1b273-c334-41e1-8071-3bda74559839 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:09:49 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-30e1b273-c334-41e1-8071-3bda74559839 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:09:49 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-30e1b273-c334-41e1-8071-3bda74559839 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:49 devstack sudo[89701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:09:49 devstack sudo[89701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:49 devstack sudo[89698]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:49 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-ac9d63ec-dc04-4afd-8592-b6d1c2fd9c0e tempest-GroupSnapshotsTest-1124623539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-517db8a5-3db4-4b27-9c92-d9b4117f98f4" returned: 0 in 0.781s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:49 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-ac9d63ec-dc04-4afd-8592-b6d1c2fd9c0e tempest-GroupSnapshotsTest-1124623539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-517db8a5-3db4-4b27-9c92-d9b4117f98f4.0df10bbf-1b0e-4802-b1bf-b58e9e720737 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:49 devstack sudo[89708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-517db8a5-3db4-4b27-9c92-d9b4117f98f4.0df10bbf-1b0e-4802-b1bf-b58e9e720737
Apr 28 22:09:49 devstack sudo[89708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:49 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-d00c947e-a7ff-49e4-b235-d71898b03d48 tempest-VolumeRetypeWithoutMigrationTest-1341522919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:09:49 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-d00c947e-a7ff-49e4-b235-d71898b03d48 tempest-VolumeRetypeWithoutMigrationTest-1341522919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:09:49 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-d00c947e-a7ff-49e4-b235-d71898b03d48 tempest-VolumeRetypeWithoutMigrationTest-1341522919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:09:49 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-d00c947e-a7ff-49e4-b235-d71898b03d48 tempest-VolumeRetypeWithoutMigrationTest-1341522919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:09:49 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-d00c947e-a7ff-49e4-b235-d71898b03d48 tempest-VolumeRetypeWithoutMigrationTest-1341522919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:09:49 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-d00c947e-a7ff-49e4-b235-d71898b03d48 tempest-VolumeRetypeWithoutMigrationTest-1341522919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:49 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-aac256a4-8355-47ed-86b2-18f034af5e33 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Acquiring lock "cinder-c0779d21-0de8-4ac8-a11b-668d59701aae-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:09:49 devstack sudo[89711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:09:49 devstack sudo[89711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:49 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-aac256a4-8355-47ed-86b2-18f034af5e33 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Lock "cinder-c0779d21-0de8-4ac8-a11b-668d59701aae-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:09:49 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-aac256a4-8355-47ed-86b2-18f034af5e33 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Acquiring lock "cinder-quobyte-c0779d21-0de8-4ac8-a11b-668d59701aae" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:09:49 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-aac256a4-8355-47ed-86b2-18f034af5e33 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Lock "cinder-quobyte-c0779d21-0de8-4ac8-a11b-668d59701aae" acquired by "delete_volume" :: waited 0.022s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:09:50 devstack sudo[89701]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:50 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-30e1b273-c334-41e1-8071-3bda74559839 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.674s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:50 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-30e1b273-c334-41e1-8071-3bda74559839 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:09:50 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-30e1b273-c334-41e1-8071-3bda74559839 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Deleted volume successfully.
Apr 28 22:09:50 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a73df7-c838-4a15-9335-e947cb394fde]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:09:50 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-aac256a4-8355-47ed-86b2-18f034af5e33 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-c0779d21-0de8-4ac8-a11b-668d59701aae {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:50 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-30e1b273-c334-41e1-8071-3bda74559839 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Lock "cinder-56cb03fa-c7a3-44b2-b8a2-54bacc881548-delete_volume" released by "delete_volume" :: held 2.497s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:09:50 devstack sudo[89713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-c0779d21-0de8-4ac8-a11b-668d59701aae
Apr 28 22:09:50 devstack sudo[89713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:50 devstack sudo[89708]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:50 devstack sudo[89711]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:50 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-ac9d63ec-dc04-4afd-8592-b6d1c2fd9c0e tempest-GroupSnapshotsTest-1124623539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-517db8a5-3db4-4b27-9c92-d9b4117f98f4.0df10bbf-1b0e-4802-b1bf-b58e9e720737" returned: 0 in 0.814s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:50 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-ac9d63ec-dc04-4afd-8592-b6d1c2fd9c0e tempest-GroupSnapshotsTest-1124623539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-517db8a5-3db4-4b27-9c92-d9b4117f98f4.0df10bbf-1b0e-4802-b1bf-b58e9e720737 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:50 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-d00c947e-a7ff-49e4-b235-d71898b03d48 tempest-VolumeRetypeWithoutMigrationTest-1341522919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.723s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:50 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-d00c947e-a7ff-49e4-b235-d71898b03d48 tempest-VolumeRetypeWithoutMigrationTest-1341522919 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:09:50 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-d00c947e-a7ff-49e4-b235-d71898b03d48 tempest-VolumeRetypeWithoutMigrationTest-1341522919 None] Retype volume completed successfully.
Apr 28 22:09:50 devstack sudo[89719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-517db8a5-3db4-4b27-9c92-d9b4117f98f4.0df10bbf-1b0e-4802-b1bf-b58e9e720737
Apr 28 22:09:50 devstack sudo[89719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:50 devstack sudo[89713]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:50 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-aac256a4-8355-47ed-86b2-18f034af5e33 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-c0779d21-0de8-4ac8-a11b-668d59701aae" returned: 0 in 0.768s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:50 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-aac256a4-8355-47ed-86b2-18f034af5e33 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-c0779d21-0de8-4ac8-a11b-668d59701aae {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:50 devstack sudo[89724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-c0779d21-0de8-4ac8-a11b-668d59701aae
Apr 28 22:09:50 devstack sudo[89724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:51 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-dbf8e036-582a-4c99-a404-d1a5151a6617 tempest-VolumeRetypeWithoutMigrationTest-1341522919 None] Acquiring lock "cinder-d56591af-f277-4094-b891-bed948cd2c0d-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:09:51 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-dbf8e036-582a-4c99-a404-d1a5151a6617 tempest-VolumeRetypeWithoutMigrationTest-1341522919 None] Lock "cinder-d56591af-f277-4094-b891-bed948cd2c0d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:09:51 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-dbf8e036-582a-4c99-a404-d1a5151a6617 tempest-VolumeRetypeWithoutMigrationTest-1341522919 None] Acquiring lock "cinder-quobyte-d56591af-f277-4094-b891-bed948cd2c0d" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:09:51 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-dbf8e036-582a-4c99-a404-d1a5151a6617 tempest-VolumeRetypeWithoutMigrationTest-1341522919 None] Lock "cinder-quobyte-d56591af-f277-4094-b891-bed948cd2c0d" acquired by "delete_volume" :: waited 0.020s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:09:51 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[759b6997-ff9e-4d86-af54-1b7c18aea25c]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:09:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-dbf8e036-582a-4c99-a404-d1a5151a6617 tempest-VolumeRetypeWithoutMigrationTest-1341522919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-d56591af-f277-4094-b891-bed948cd2c0d {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:51 devstack sudo[89719]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-ac9d63ec-dc04-4afd-8592-b6d1c2fd9c0e tempest-GroupSnapshotsTest-1124623539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-517db8a5-3db4-4b27-9c92-d9b4117f98f4.0df10bbf-1b0e-4802-b1bf-b58e9e720737" returned: 0 in 0.642s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:51 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-ac9d63ec-dc04-4afd-8592-b6d1c2fd9c0e tempest-GroupSnapshotsTest-1124623539 None] Lock "cinder-quobyte-0df10bbf-1b0e-4802-b1bf-b58e9e720737" released by "_delete_snapshot" :: held 3.213s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:09:51 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-ac9d63ec-dc04-4afd-8592-b6d1c2fd9c0e tempest-GroupSnapshotsTest-1124623539 None] Lock "cinder-quobyte-517db8a5-3db4-4b27-9c92-d9b4117f98f4" released by "delete_snapshot" :: held 3.257s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:09:51 devstack sudo[89727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-d56591af-f277-4094-b891-bed948cd2c0d
Apr 28 22:09:51 devstack sudo[89727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:51 devstack cinder-volume[83924]: WARNING cinder.quota [None req-ac9d63ec-dc04-4afd-8592-b6d1c2fd9c0e tempest-GroupSnapshotsTest-1124623539 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-570787241 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-570787241, it is now deprecated. Please use the default quota class for default quota.
Apr 28 22:09:51 devstack cinder-volume[83924]: WARNING cinder.quota [None req-ac9d63ec-dc04-4afd-8592-b6d1c2fd9c0e tempest-GroupSnapshotsTest-1124623539 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-570787241 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-570787241, it is now deprecated. Please use the default quota class for default quota.
Apr 28 22:09:51 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-ac9d63ec-dc04-4afd-8592-b6d1c2fd9c0e tempest-GroupSnapshotsTest-1124623539 None] Created reservations ['122a8914-1b1d-4d5c-ac15-8e9eb0d94cd2', '09e29c15-a062-4371-806a-551e05a5f84d', '2d3ebff6-25ac-448f-b603-ebd346235ae0', 'f93dccac-a849-4044-ace5-46d10bbef123'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:09:51 devstack sudo[89724]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-aac256a4-8355-47ed-86b2-18f034af5e33 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-c0779d21-0de8-4ac8-a11b-668d59701aae" returned: 0 in 0.643s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:51 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-aac256a4-8355-47ed-86b2-18f034af5e33 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Lock "cinder-quobyte-c0779d21-0de8-4ac8-a11b-668d59701aae" released by "delete_volume" :: held 1.463s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:09:51 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-ac9d63ec-dc04-4afd-8592-b6d1c2fd9c0e tempest-GroupSnapshotsTest-1124623539 None] group_snapshot 1657a9a2-944f-437a-af36-16dcfbc7eb76: deleted successfully
Apr 28 22:09:51 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-aac256a4-8355-47ed-86b2-18f034af5e33 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Created reservations ['eb20c915-3a17-43b1-822d-b98b36246023', 'a25c4374-09cf-4e22-87a8-10c4d5604cb8', '80e21497-b9dd-44aa-9fd1-44ae54be371c', '677afa33-b4b7-4be1-b883-d2265271c2a1'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:09:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-aac256a4-8355-47ed-86b2-18f034af5e33 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:09:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-aac256a4-8355-47ed-86b2-18f034af5e33 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:09:51 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-aac256a4-8355-47ed-86b2-18f034af5e33 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:09:51 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-aac256a4-8355-47ed-86b2-18f034af5e33 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:09:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-aac256a4-8355-47ed-86b2-18f034af5e33 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:09:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-aac256a4-8355-47ed-86b2-18f034af5e33 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:51 devstack sudo[89730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:09:51 devstack sudo[89730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:51 devstack sudo[89727]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-dbf8e036-582a-4c99-a404-d1a5151a6617 tempest-VolumeRetypeWithoutMigrationTest-1341522919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-d56591af-f277-4094-b891-bed948cd2c0d" returned: 0 in 0.768s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-dbf8e036-582a-4c99-a404-d1a5151a6617 tempest-VolumeRetypeWithoutMigrationTest-1341522919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-d56591af-f277-4094-b891-bed948cd2c0d {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:51 devstack sudo[89735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-d56591af-f277-4094-b891-bed948cd2c0d
Apr 28 22:09:51 devstack sudo[89735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:52 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-55371e92-ca54-4101-8c9d-6b3943ed031c tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Acquiring lock "cinder-8085af2f-5152-4633-8ecf-cfb1a551b95f-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:09:52 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-55371e92-ca54-4101-8c9d-6b3943ed031c tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Lock "cinder-8085af2f-5152-4633-8ecf-cfb1a551b95f-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:09:52 devstack sudo[89730]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:52 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-aac256a4-8355-47ed-86b2-18f034af5e33 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.667s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:52 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-aac256a4-8355-47ed-86b2-18f034af5e33 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:09:52 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-aac256a4-8355-47ed-86b2-18f034af5e33 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Deleted volume successfully.
Apr 28 22:09:52 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-55371e92-ca54-4101-8c9d-6b3943ed031c tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Acquiring lock "cinder-quobyte-8085af2f-5152-4633-8ecf-cfb1a551b95f" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:09:52 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-55371e92-ca54-4101-8c9d-6b3943ed031c tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Lock "cinder-quobyte-8085af2f-5152-4633-8ecf-cfb1a551b95f" acquired by "delete_volume" :: waited 0.029s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:09:52 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-aac256a4-8355-47ed-86b2-18f034af5e33 tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Lock "cinder-c0779d21-0de8-4ac8-a11b-668d59701aae-delete_volume" released by "delete_volume" :: held 2.395s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:09:52 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[202d7c5d-cf87-4d7d-8ef2-a7e6b2c56a17]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:09:52 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-55371e92-ca54-4101-8c9d-6b3943ed031c tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8085af2f-5152-4633-8ecf-cfb1a551b95f {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:52 devstack sudo[89738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8085af2f-5152-4633-8ecf-cfb1a551b95f
Apr 28 22:09:52 devstack sudo[89738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:52 devstack sudo[89735]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:52 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-dbf8e036-582a-4c99-a404-d1a5151a6617 tempest-VolumeRetypeWithoutMigrationTest-1341522919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-d56591af-f277-4094-b891-bed948cd2c0d" returned: 0 in 0.661s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:52 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-aacb20ff-9bca-40da-954d-be1d6a66d324 tempest-GroupSnapshotsTest-1124623539 None] Acquiring lock "cinder-quobyte-517db8a5-3db4-4b27-9c92-d9b4117f98f4" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:09:52 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-dbf8e036-582a-4c99-a404-d1a5151a6617 tempest-VolumeRetypeWithoutMigrationTest-1341522919 None] Lock "cinder-quobyte-d56591af-f277-4094-b891-bed948cd2c0d" released by "delete_volume" :: held 1.496s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:09:52 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-aacb20ff-9bca-40da-954d-be1d6a66d324 tempest-GroupSnapshotsTest-1124623539 None] Lock "cinder-quobyte-517db8a5-3db4-4b27-9c92-d9b4117f98f4" acquired by "delete_volume" :: waited 0.032s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:09:52 devstack cinder-volume[83924]: WARNING cinder.quota [None req-dbf8e036-582a-4c99-a404-d1a5151a6617 tempest-VolumeRetypeWithoutMigrationTest-1341522919 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 28 22:09:52 devstack cinder-volume[83924]: WARNING cinder.quota [None req-dbf8e036-582a-4c99-a404-d1a5151a6617 tempest-VolumeRetypeWithoutMigrationTest-1341522919 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 28 22:09:52 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[57dc18b2-16c3-456d-a92c-e3abc93fc4d0]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:09:52 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-aacb20ff-9bca-40da-954d-be1d6a66d324 tempest-GroupSnapshotsTest-1124623539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-517db8a5-3db4-4b27-9c92-d9b4117f98f4 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:52 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-dbf8e036-582a-4c99-a404-d1a5151a6617 tempest-VolumeRetypeWithoutMigrationTest-1341522919 None] Created reservations ['16abbd36-3bb1-4ed6-a106-64d14e5dd5e5', '09fda15d-20a7-46af-9db7-0a916b5adaa7', 'a493944b-2a15-439b-89b1-8c9d9a7fac8a', '3bfa29b7-aca6-41f1-8a23-12f6527aed0d'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:09:52 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-dbf8e036-582a-4c99-a404-d1a5151a6617 tempest-VolumeRetypeWithoutMigrationTest-1341522919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:09:52 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-dbf8e036-582a-4c99-a404-d1a5151a6617 tempest-VolumeRetypeWithoutMigrationTest-1341522919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:09:52 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-dbf8e036-582a-4c99-a404-d1a5151a6617 tempest-VolumeRetypeWithoutMigrationTest-1341522919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:09:52 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-dbf8e036-582a-4c99-a404-d1a5151a6617 tempest-VolumeRetypeWithoutMigrationTest-1341522919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:09:52 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-dbf8e036-582a-4c99-a404-d1a5151a6617 tempest-VolumeRetypeWithoutMigrationTest-1341522919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:09:52 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-dbf8e036-582a-4c99-a404-d1a5151a6617 tempest-VolumeRetypeWithoutMigrationTest-1341522919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:52 devstack sudo[89741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-517db8a5-3db4-4b27-9c92-d9b4117f98f4
Apr 28 22:09:52 devstack sudo[89741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:52 devstack sudo[89743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:09:52 devstack sudo[89743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:53 devstack sudo[89738]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:53 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-55371e92-ca54-4101-8c9d-6b3943ed031c tempest-CreateVolumesFromSourceVolumeTest-220697289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8085af2f-5152-4633-8ecf-cfb1a551b95f" returned: 0 in 0.811s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:53 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-55371e92-ca54-4101-8c9d-6b3943ed031c tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8085af2f-5152-4633-8ecf-cfb1a551b95f {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:53 devstack sudo[89749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8085af2f-5152-4633-8ecf-cfb1a551b95f
Apr 28 22:09:53 devstack sudo[89749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:53 devstack sudo[89743]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:53 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-dbf8e036-582a-4c99-a404-d1a5151a6617 tempest-VolumeRetypeWithoutMigrationTest-1341522919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.670s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:53 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-dbf8e036-582a-4c99-a404-d1a5151a6617 tempest-VolumeRetypeWithoutMigrationTest-1341522919 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:09:53 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-dbf8e036-582a-4c99-a404-d1a5151a6617 tempest-VolumeRetypeWithoutMigrationTest-1341522919 None] Deleted volume successfully.
Apr 28 22:09:53 devstack sudo[89741]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:53 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-dbf8e036-582a-4c99-a404-d1a5151a6617 tempest-VolumeRetypeWithoutMigrationTest-1341522919 None] Lock "cinder-d56591af-f277-4094-b891-bed948cd2c0d-delete_volume" released by "delete_volume" :: held 2.456s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:09:53 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-aacb20ff-9bca-40da-954d-be1d6a66d324 tempest-GroupSnapshotsTest-1124623539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-517db8a5-3db4-4b27-9c92-d9b4117f98f4" returned: 0 in 0.825s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:53 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-aacb20ff-9bca-40da-954d-be1d6a66d324 tempest-GroupSnapshotsTest-1124623539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-517db8a5-3db4-4b27-9c92-d9b4117f98f4 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:53 devstack sudo[89755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-517db8a5-3db4-4b27-9c92-d9b4117f98f4
Apr 28 22:09:53 devstack sudo[89755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:53 devstack sudo[89749]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:53 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-55371e92-ca54-4101-8c9d-6b3943ed031c tempest-CreateVolumesFromSourceVolumeTest-220697289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8085af2f-5152-4633-8ecf-cfb1a551b95f" returned: 0 in 0.799s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:53 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-55371e92-ca54-4101-8c9d-6b3943ed031c tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Lock "cinder-quobyte-8085af2f-5152-4633-8ecf-cfb1a551b95f" released by "delete_volume" :: held 1.659s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:09:54 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-55371e92-ca54-4101-8c9d-6b3943ed031c tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Created reservations ['97f392e4-98d5-409a-8caa-24ab4eb35e2c', '179aa709-df23-4645-92e6-79f012de0845', '2a34ecb0-9f6a-48af-9ebb-f1f2e5de78a8', '1c0a532d-18fd-43e3-8ac1-a8bd44d54c0e'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:09:54 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-55371e92-ca54-4101-8c9d-6b3943ed031c tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:09:54 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-55371e92-ca54-4101-8c9d-6b3943ed031c tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:09:54 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-55371e92-ca54-4101-8c9d-6b3943ed031c tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:09:54 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-55371e92-ca54-4101-8c9d-6b3943ed031c tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:09:54 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-55371e92-ca54-4101-8c9d-6b3943ed031c tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:09:54 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-55371e92-ca54-4101-8c9d-6b3943ed031c tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:54 devstack sudo[89759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:09:54 devstack sudo[89759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:54 devstack sudo[89755]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:54 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-aacb20ff-9bca-40da-954d-be1d6a66d324 tempest-GroupSnapshotsTest-1124623539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-517db8a5-3db4-4b27-9c92-d9b4117f98f4" returned: 0 in 0.690s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:54 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-aacb20ff-9bca-40da-954d-be1d6a66d324 tempest-GroupSnapshotsTest-1124623539 None] Lock "cinder-quobyte-517db8a5-3db4-4b27-9c92-d9b4117f98f4" released by "delete_volume" :: held 1.584s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:09:54 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-aacb20ff-9bca-40da-954d-be1d6a66d324 tempest-GroupSnapshotsTest-1124623539 None] Created reservations ['ebea4bf7-e6fe-49d5-978f-29d1127a9d9f'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:09:54 devstack cinder-volume[83924]: WARNING cinder.quota [None req-aacb20ff-9bca-40da-954d-be1d6a66d324 tempest-GroupSnapshotsTest-1124623539 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-570787241 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-570787241, it is now deprecated. Please use the default quota class for default quota.
Apr 28 22:09:54 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-aacb20ff-9bca-40da-954d-be1d6a66d324 tempest-GroupSnapshotsTest-1124623539 None] Created reservations ['f3329aa7-e091-4c06-98fa-16eaf4045c99', '3f683f22-049f-4f0d-9520-d524bbaa3f0c', 'b624657a-c094-4b54-85e3-17b3581f0563', 'c4284645-e99b-45d3-a8cb-09fab6fa35d2'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:09:54 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-aacb20ff-9bca-40da-954d-be1d6a66d324 tempest-GroupSnapshotsTest-1124623539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:09:54 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-aacb20ff-9bca-40da-954d-be1d6a66d324 tempest-GroupSnapshotsTest-1124623539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:09:54 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-aacb20ff-9bca-40da-954d-be1d6a66d324 tempest-GroupSnapshotsTest-1124623539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:09:54 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-aacb20ff-9bca-40da-954d-be1d6a66d324 tempest-GroupSnapshotsTest-1124623539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:09:54 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-aacb20ff-9bca-40da-954d-be1d6a66d324 tempest-GroupSnapshotsTest-1124623539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:09:54 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-aacb20ff-9bca-40da-954d-be1d6a66d324 tempest-GroupSnapshotsTest-1124623539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:54 devstack sudo[89761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:09:54 devstack sudo[89761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:54 devstack sudo[89759]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:54 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-55371e92-ca54-4101-8c9d-6b3943ed031c tempest-CreateVolumesFromSourceVolumeTest-220697289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.792s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:54 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-55371e92-ca54-4101-8c9d-6b3943ed031c tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:09:54 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-55371e92-ca54-4101-8c9d-6b3943ed031c tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Deleted volume successfully.
Apr 28 22:09:54 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-55371e92-ca54-4101-8c9d-6b3943ed031c tempest-CreateVolumesFromSourceVolumeTest-220697289 None] Lock "cinder-8085af2f-5152-4633-8ecf-cfb1a551b95f-delete_volume" released by "delete_volume" :: held 2.746s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:09:55 devstack sudo[89761]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:55 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-aacb20ff-9bca-40da-954d-be1d6a66d324 tempest-GroupSnapshotsTest-1124623539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.945s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:55 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-aacb20ff-9bca-40da-954d-be1d6a66d324 tempest-GroupSnapshotsTest-1124623539 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:09:55 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-aacb20ff-9bca-40da-954d-be1d6a66d324 tempest-GroupSnapshotsTest-1124623539 None] Delete group completed successfully.
Apr 28 22:09:58 devstack cinder-volume[83924]: DEBUG dbcounter [-] [83924] Writing DB stats cinder:SELECT=178,cinder:INSERT=60,cinder:UPDATE=226,cinder:DELETE=15 {{(pid=83924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 28 22:09:58 devstack cinder-volume[83924]: DEBUG dbcounter [-] [83924] Writing DB stats cinder:UPDATE=230,cinder:DELETE=14,cinder:SELECT=174,cinder:INSERT=47 {{(pid=83924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 28 22:09:58 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8c4d389-07c4-4233-8fe5-960c557d2fb3 tempest-CinderUnicodeTest-454738002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:09:58 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a8c4d389-07c4-4233-8fe5-960c557d2fb3 tempest-CinderUnicodeTest-454738002 None] Flow 'volume_create_manager' (0a196f3c-8676-438f-9599-317e7857dfc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:09:58 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a8c4d389-07c4-4233-8fe5-960c557d2fb3 tempest-CinderUnicodeTest-454738002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cea7aeeb-6664-4a4d-8f97-73a852e4a7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:09:58 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a8c4d389-07c4-4233-8fe5-960c557d2fb3 tempest-CinderUnicodeTest-454738002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cea7aeeb-6664-4a4d-8f97-73a852e4a7b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d37f86dd-073b-4c01-a40a-fddfec90be78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='626feb0d4f1a4cbc8999eef670a35e39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:09:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:09:59Z,use_quota=True,user_id='2ffe0bcb69fd477e869c514389b84dc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:09:58 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a8c4d389-07c4-4233-8fe5-960c557d2fb3 tempest-CinderUnicodeTest-454738002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b62776b4-7fc1-4155-b3db-98e2d7a8656c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:09:58 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a8c4d389-07c4-4233-8fe5-960c557d2fb3 tempest-CinderUnicodeTest-454738002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b62776b4-7fc1-4155-b3db-98e2d7a8656c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:09:58 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a8c4d389-07c4-4233-8fe5-960c557d2fb3 tempest-CinderUnicodeTest-454738002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14ec8433-5db0-4d93-804f-3cef428b5697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:09:58 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a8c4d389-07c4-4233-8fe5-960c557d2fb3 tempest-CinderUnicodeTest-454738002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14ec8433-5db0-4d93-804f-3cef428b5697) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd37f86dd-073b-4c01-a40a-fddfec90be78', 'volume_name': 'volume-d37f86dd-073b-4c01-a40a-fddfec90be78', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:09:58 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a8c4d389-07c4-4233-8fe5-960c557d2fb3 tempest-CinderUnicodeTest-454738002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01ed5ccf-5520-46ec-968a-11349fc24e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:09:58 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a8c4d389-07c4-4233-8fe5-960c557d2fb3 tempest-CinderUnicodeTest-454738002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01ed5ccf-5520-46ec-968a-11349fc24e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:09:58 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a8c4d389-07c4-4233-8fe5-960c557d2fb3 tempest-CinderUnicodeTest-454738002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acc8fefe-eaf8-4d75-b36e-dd647ba7309e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:09:58 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-a8c4d389-07c4-4233-8fe5-960c557d2fb3 tempest-CinderUnicodeTest-454738002 None] Volume d37f86dd-073b-4c01-a40a-fddfec90be78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d37f86dd-073b-4c01-a40a-fddfec90be78', 'volume_size': 1}
Apr 28 22:09:58 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-a8c4d389-07c4-4233-8fe5-960c557d2fb3 tempest-CinderUnicodeTest-454738002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:09:58 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-a8c4d389-07c4-4233-8fe5-960c557d2fb3 tempest-CinderUnicodeTest-454738002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:09:58 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-a8c4d389-07c4-4233-8fe5-960c557d2fb3 tempest-CinderUnicodeTest-454738002 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d37f86dd-073b-4c01-a40a-fddfec90be78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='626feb0d4f1a4cbc8999eef670a35e39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:09:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:09:59Z,use_quota=True,user_id='2ffe0bcb69fd477e869c514389b84dc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:09:58 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-a8c4d389-07c4-4233-8fe5-960c557d2fb3 tempest-CinderUnicodeTest-454738002 None] Creating volume d37f86dd-073b-4c01-a40a-fddfec90be78 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:09:58 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-a8c4d389-07c4-4233-8fe5-960c557d2fb3 tempest-CinderUnicodeTest-454738002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:09:58 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-a8c4d389-07c4-4233-8fe5-960c557d2fb3 tempest-CinderUnicodeTest-454738002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:09:58 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-a8c4d389-07c4-4233-8fe5-960c557d2fb3 tempest-CinderUnicodeTest-454738002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:09:58 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-a8c4d389-07c4-4233-8fe5-960c557d2fb3 tempest-CinderUnicodeTest-454738002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:09:58 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-a8c4d389-07c4-4233-8fe5-960c557d2fb3 tempest-CinderUnicodeTest-454738002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:09:58 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-a8c4d389-07c4-4233-8fe5-960c557d2fb3 tempest-CinderUnicodeTest-454738002 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:09:58 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-a8c4d389-07c4-4233-8fe5-960c557d2fb3 tempest-CinderUnicodeTest-454738002 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:09:58 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a8c4d389-07c4-4233-8fe5-960c557d2fb3 tempest-CinderUnicodeTest-454738002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-d37f86dd-073b-4c01-a40a-fddfec90be78 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:58 devstack sudo[89766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-d37f86dd-073b-4c01-a40a-fddfec90be78 1073741824
Apr 28 22:09:58 devstack sudo[89766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:09:59 devstack sudo[89766]: pam_unix(sudo:session): session closed for user root
Apr 28 22:09:59 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a8c4d389-07c4-4233-8fe5-960c557d2fb3 tempest-CinderUnicodeTest-454738002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-d37f86dd-073b-4c01-a40a-fddfec90be78 1073741824" returned: 0 in 0.949s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:09:59 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a8c4d389-07c4-4233-8fe5-960c557d2fb3 tempest-CinderUnicodeTest-454738002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-d37f86dd-073b-4c01-a40a-fddfec90be78 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:09:59 devstack sudo[89772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-d37f86dd-073b-4c01-a40a-fddfec90be78
Apr 28 22:09:59 devstack sudo[89772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:00 devstack sudo[89772]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:00 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a8c4d389-07c4-4233-8fe5-960c557d2fb3 tempest-CinderUnicodeTest-454738002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-d37f86dd-073b-4c01-a40a-fddfec90be78" returned: 0 in 0.609s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:00 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-a8c4d389-07c4-4233-8fe5-960c557d2fb3 tempest-CinderUnicodeTest-454738002 None] <== create_volume: return (1619ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:10:00 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-a8c4d389-07c4-4233-8fe5-960c557d2fb3 tempest-CinderUnicodeTest-454738002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.624s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:10:00 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a8c4d389-07c4-4233-8fe5-960c557d2fb3 tempest-CinderUnicodeTest-454738002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acc8fefe-eaf8-4d75-b36e-dd647ba7309e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d37f86dd-073b-4c01-a40a-fddfec90be78', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:10:00 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a8c4d389-07c4-4233-8fe5-960c557d2fb3 tempest-CinderUnicodeTest-454738002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37340581-6467-421f-8acc-932e04aff99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:10:00 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-a8c4d389-07c4-4233-8fe5-960c557d2fb3 tempest-CinderUnicodeTest-454738002 None] Volume volume-d37f86dd-073b-4c01-a40a-fddfec90be78 (d37f86dd-073b-4c01-a40a-fddfec90be78): created successfully
Apr 28 22:10:00 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a8c4d389-07c4-4233-8fe5-960c557d2fb3 tempest-CinderUnicodeTest-454738002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37340581-6467-421f-8acc-932e04aff99d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:10:00 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a8c4d389-07c4-4233-8fe5-960c557d2fb3 tempest-CinderUnicodeTest-454738002 None] Flow 'volume_create_manager' (0a196f3c-8676-438f-9599-317e7857dfc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:10:00 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-a8c4d389-07c4-4233-8fe5-960c557d2fb3 tempest-CinderUnicodeTest-454738002 None] Created volume successfully.
Apr 28 22:10:01 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-bb492aa1-d691-4f1c-be12-d456b634262d tempest-GroupsV314Test-680821007 None] Group tempest-GroupsV314Test-Group-750211323: creating
Apr 28 22:10:01 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-bb492aa1-d691-4f1c-be12-d456b634262d tempest-GroupsV314Test-680821007 None] Group tempest-GroupsV314Test-Group-750211323: created successfully
Apr 28 22:10:01 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-bb492aa1-d691-4f1c-be12-d456b634262d tempest-GroupsV314Test-680821007 None] Create group completed successfully.
Apr 28 22:10:01 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6eb1329-b123-454f-b397-d301d8ecd4da tempest-CinderUnicodeTest-454738002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:10:01 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a6eb1329-b123-454f-b397-d301d8ecd4da tempest-CinderUnicodeTest-454738002 None] Flow 'volume_create_manager' (9771eaaa-bdbb-4314-bb09-af257011912f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:10:01 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a6eb1329-b123-454f-b397-d301d8ecd4da tempest-CinderUnicodeTest-454738002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe2ce87f-e84d-4e16-97bb-6dd6d3123474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:10:01 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a6eb1329-b123-454f-b397-d301d8ecd4da tempest-CinderUnicodeTest-454738002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe2ce87f-e84d-4e16-97bb-6dd6d3123474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:10:01Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1517462227',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2975a8e7-5814-4e05-85fa-63f6ae151df1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='626feb0d4f1a4cbc8999eef670a35e39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:10:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:10:01Z,use_quota=True,user_id='2ffe0bcb69fd477e869c514389b84dc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:10:01 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a6eb1329-b123-454f-b397-d301d8ecd4da tempest-CinderUnicodeTest-454738002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db86d247-0d33-4106-997b-0b08dd98ba40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:10:01 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a6eb1329-b123-454f-b397-d301d8ecd4da tempest-CinderUnicodeTest-454738002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db86d247-0d33-4106-997b-0b08dd98ba40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:10:01 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a6eb1329-b123-454f-b397-d301d8ecd4da tempest-CinderUnicodeTest-454738002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a1e3987-013c-44e0-af3c-56710f076b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:10:01 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a6eb1329-b123-454f-b397-d301d8ecd4da tempest-CinderUnicodeTest-454738002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a1e3987-013c-44e0-af3c-56710f076b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2975a8e7-5814-4e05-85fa-63f6ae151df1', 'volume_name': 'volume-2975a8e7-5814-4e05-85fa-63f6ae151df1', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:10:01 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a6eb1329-b123-454f-b397-d301d8ecd4da tempest-CinderUnicodeTest-454738002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (178245be-cfcf-4a72-b973-abadca76323f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:10:01 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a6eb1329-b123-454f-b397-d301d8ecd4da tempest-CinderUnicodeTest-454738002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (178245be-cfcf-4a72-b973-abadca76323f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:10:01 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a6eb1329-b123-454f-b397-d301d8ecd4da tempest-CinderUnicodeTest-454738002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e586ed4-0ba8-4ec4-9bc7-8e0cfcafed60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:10:01 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-a6eb1329-b123-454f-b397-d301d8ecd4da tempest-CinderUnicodeTest-454738002 None] Volume 2975a8e7-5814-4e05-85fa-63f6ae151df1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2975a8e7-5814-4e05-85fa-63f6ae151df1', 'volume_size': 1}
Apr 28 22:10:01 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-a6eb1329-b123-454f-b397-d301d8ecd4da tempest-CinderUnicodeTest-454738002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:10:01 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-a6eb1329-b123-454f-b397-d301d8ecd4da tempest-CinderUnicodeTest-454738002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:10:01 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-a6eb1329-b123-454f-b397-d301d8ecd4da tempest-CinderUnicodeTest-454738002 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:10:01Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1517462227',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2975a8e7-5814-4e05-85fa-63f6ae151df1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='626feb0d4f1a4cbc8999eef670a35e39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:10:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:10:01Z,use_quota=True,user_id='2ffe0bcb69fd477e869c514389b84dc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:10:01 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-a6eb1329-b123-454f-b397-d301d8ecd4da tempest-CinderUnicodeTest-454738002 None] Creating volume 2975a8e7-5814-4e05-85fa-63f6ae151df1 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:10:01 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-a6eb1329-b123-454f-b397-d301d8ecd4da tempest-CinderUnicodeTest-454738002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:10:01 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-a6eb1329-b123-454f-b397-d301d8ecd4da tempest-CinderUnicodeTest-454738002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:10:01 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-a6eb1329-b123-454f-b397-d301d8ecd4da tempest-CinderUnicodeTest-454738002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:10:01 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-a6eb1329-b123-454f-b397-d301d8ecd4da tempest-CinderUnicodeTest-454738002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:10:01 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-a6eb1329-b123-454f-b397-d301d8ecd4da tempest-CinderUnicodeTest-454738002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:10:01 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-a6eb1329-b123-454f-b397-d301d8ecd4da tempest-CinderUnicodeTest-454738002 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:10:01 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-a6eb1329-b123-454f-b397-d301d8ecd4da tempest-CinderUnicodeTest-454738002 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:10:01 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a6eb1329-b123-454f-b397-d301d8ecd4da tempest-CinderUnicodeTest-454738002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2975a8e7-5814-4e05-85fa-63f6ae151df1 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:01 devstack sudo[89775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2975a8e7-5814-4e05-85fa-63f6ae151df1 1073741824
Apr 28 22:10:01 devstack sudo[89775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:02 devstack sudo[89775]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:02 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a6eb1329-b123-454f-b397-d301d8ecd4da tempest-CinderUnicodeTest-454738002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2975a8e7-5814-4e05-85fa-63f6ae151df1 1073741824" returned: 0 in 0.868s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:02 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a6eb1329-b123-454f-b397-d301d8ecd4da tempest-CinderUnicodeTest-454738002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2975a8e7-5814-4e05-85fa-63f6ae151df1 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:02 devstack sudo[89781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2975a8e7-5814-4e05-85fa-63f6ae151df1
Apr 28 22:10:02 devstack sudo[89781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:02 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-e61960e4-2fc0-43f0-a993-f231560315c2 tempest-GroupsV314Test-680821007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:10:02 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-e61960e4-2fc0-43f0-a993-f231560315c2 tempest-GroupsV314Test-680821007 None] Flow 'volume_create_manager' (b64b59cb-ca53-496d-a53e-cb6bfc0bbf62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:10:02 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-e61960e4-2fc0-43f0-a993-f231560315c2 tempest-GroupsV314Test-680821007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (058972e4-3a2f-4d77-8ef7-b5d5d257c5f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:10:02 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-e61960e4-2fc0-43f0-a993-f231560315c2 tempest-GroupsV314Test-680821007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (058972e4-3a2f-4d77-8ef7-b5d5d257c5f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:10:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1105347859',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=4e470cf1-bd81-4e61-91ae-509d745fd484,host='devstack@QuobyteHD#QuobyteHD',id=7d633637-6f8a-4cab-af97-57be6a0a8f16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c61ebcd59e44607a8b8fb55b93eb321',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:10:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:10:03Z,use_quota=True,user_id='99480a93663c483a9ef533b0c2ead484',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5b6b990-ad9d-4b7c-9375-8834ac5ba05a),volume_type_id=a5b6b990-ad9d-4b7c-9375-8834ac5ba05a)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:10:02 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-e61960e4-2fc0-43f0-a993-f231560315c2 tempest-GroupsV314Test-680821007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7437c97e-5f58-4344-b428-30f9f336e2d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:10:02 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-e61960e4-2fc0-43f0-a993-f231560315c2 tempest-GroupsV314Test-680821007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7437c97e-5f58-4344-b428-30f9f336e2d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:10:02 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-e61960e4-2fc0-43f0-a993-f231560315c2 tempest-GroupsV314Test-680821007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6265eec9-4279-4d7c-b064-3e9720408979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:10:02 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-e61960e4-2fc0-43f0-a993-f231560315c2 tempest-GroupsV314Test-680821007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6265eec9-4279-4d7c-b064-3e9720408979) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d633637-6f8a-4cab-af97-57be6a0a8f16', 'volume_name': 'volume-7d633637-6f8a-4cab-af97-57be6a0a8f16', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:10:02 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-e61960e4-2fc0-43f0-a993-f231560315c2 tempest-GroupsV314Test-680821007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97c253c4-a636-4323-a3a6-50b9a34098b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:10:02 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-e61960e4-2fc0-43f0-a993-f231560315c2 tempest-GroupsV314Test-680821007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97c253c4-a636-4323-a3a6-50b9a34098b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:10:02 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-e61960e4-2fc0-43f0-a993-f231560315c2 tempest-GroupsV314Test-680821007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27c5fc86-7f05-4763-8044-67c7d28c5729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:10:02 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-e61960e4-2fc0-43f0-a993-f231560315c2 tempest-GroupsV314Test-680821007 None] Volume 7d633637-6f8a-4cab-af97-57be6a0a8f16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d633637-6f8a-4cab-af97-57be6a0a8f16', 'volume_size': 1}
Apr 28 22:10:02 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-e61960e4-2fc0-43f0-a993-f231560315c2 tempest-GroupsV314Test-680821007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:10:03 devstack sudo[89781]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:03 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a6eb1329-b123-454f-b397-d301d8ecd4da tempest-CinderUnicodeTest-454738002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2975a8e7-5814-4e05-85fa-63f6ae151df1" returned: 0 in 0.703s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:03 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-a6eb1329-b123-454f-b397-d301d8ecd4da tempest-CinderUnicodeTest-454738002 None] <== create_volume: return (1620ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:10:03 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-a6eb1329-b123-454f-b397-d301d8ecd4da tempest-CinderUnicodeTest-454738002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.626s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:10:03 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-e61960e4-2fc0-43f0-a993-f231560315c2 tempest-GroupsV314Test-680821007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.153s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:10:03 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-e61960e4-2fc0-43f0-a993-f231560315c2 tempest-GroupsV314Test-680821007 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=4e470cf1-bd81-4e61-91ae-509d745fd484,created_at=2026-04-28T20:10:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1105347859',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=4e470cf1-bd81-4e61-91ae-509d745fd484,host='devstack@QuobyteHD#QuobyteHD',id=7d633637-6f8a-4cab-af97-57be6a0a8f16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c61ebcd59e44607a8b8fb55b93eb321',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:10:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:10:03Z,use_quota=True,user_id='99480a93663c483a9ef533b0c2ead484',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5b6b990-ad9d-4b7c-9375-8834ac5ba05a),volume_type_id=a5b6b990-ad9d-4b7c-9375-8834ac5ba05a)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:10:03 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-e61960e4-2fc0-43f0-a993-f231560315c2 tempest-GroupsV314Test-680821007 None] Creating volume 7d633637-6f8a-4cab-af97-57be6a0a8f16 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:10:03 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-e61960e4-2fc0-43f0-a993-f231560315c2 tempest-GroupsV314Test-680821007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:10:03 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-e61960e4-2fc0-43f0-a993-f231560315c2 tempest-GroupsV314Test-680821007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:10:03 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-e61960e4-2fc0-43f0-a993-f231560315c2 tempest-GroupsV314Test-680821007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:10:03 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-e61960e4-2fc0-43f0-a993-f231560315c2 tempest-GroupsV314Test-680821007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:10:03 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-e61960e4-2fc0-43f0-a993-f231560315c2 tempest-GroupsV314Test-680821007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:10:03 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-e61960e4-2fc0-43f0-a993-f231560315c2 tempest-GroupsV314Test-680821007 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:10:03 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-e61960e4-2fc0-43f0-a993-f231560315c2 tempest-GroupsV314Test-680821007 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:10:03 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e61960e4-2fc0-43f0-a993-f231560315c2 tempest-GroupsV314Test-680821007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7d633637-6f8a-4cab-af97-57be6a0a8f16 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:03 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a6eb1329-b123-454f-b397-d301d8ecd4da tempest-CinderUnicodeTest-454738002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e586ed4-0ba8-4ec4-9bc7-8e0cfcafed60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2975a8e7-5814-4e05-85fa-63f6ae151df1', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:10:03 devstack sudo[89785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7d633637-6f8a-4cab-af97-57be6a0a8f16 1073741824
Apr 28 22:10:03 devstack sudo[89785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:03 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a6eb1329-b123-454f-b397-d301d8ecd4da tempest-CinderUnicodeTest-454738002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92e66c53-1499-4bdc-84cb-6d7f941c4bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:10:03 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-a6eb1329-b123-454f-b397-d301d8ecd4da tempest-CinderUnicodeTest-454738002 None] Volume volume-2975a8e7-5814-4e05-85fa-63f6ae151df1 (2975a8e7-5814-4e05-85fa-63f6ae151df1): created successfully
Apr 28 22:10:03 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a6eb1329-b123-454f-b397-d301d8ecd4da tempest-CinderUnicodeTest-454738002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92e66c53-1499-4bdc-84cb-6d7f941c4bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:10:03 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a6eb1329-b123-454f-b397-d301d8ecd4da tempest-CinderUnicodeTest-454738002 None] Flow 'volume_create_manager' (9771eaaa-bdbb-4314-bb09-af257011912f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:10:03 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-a6eb1329-b123-454f-b397-d301d8ecd4da tempest-CinderUnicodeTest-454738002 None] Created volume successfully.
Apr 28 22:10:03 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-0d86634d-21f4-4437-aa27-38222b137979 tempest-CinderUnicodeTest-454738002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:10:04 devstack sudo[89785]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:04 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e61960e4-2fc0-43f0-a993-f231560315c2 tempest-GroupsV314Test-680821007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7d633637-6f8a-4cab-af97-57be6a0a8f16 1073741824" returned: 0 in 0.987s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:04 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e61960e4-2fc0-43f0-a993-f231560315c2 tempest-GroupsV314Test-680821007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7d633637-6f8a-4cab-af97-57be6a0a8f16 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:04 devstack sudo[89791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7d633637-6f8a-4cab-af97-57be6a0a8f16
Apr 28 22:10:04 devstack sudo[89791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:04 devstack sudo[89791]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:04 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e61960e4-2fc0-43f0-a993-f231560315c2 tempest-GroupsV314Test-680821007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7d633637-6f8a-4cab-af97-57be6a0a8f16" returned: 0 in 0.639s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:04 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-e61960e4-2fc0-43f0-a993-f231560315c2 tempest-GroupsV314Test-680821007 None] <== create_volume: return (1670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:10:04 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-e61960e4-2fc0-43f0-a993-f231560315c2 tempest-GroupsV314Test-680821007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.674s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:10:04 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-0d86634d-21f4-4437-aa27-38222b137979 tempest-CinderUnicodeTest-454738002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.901s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:10:04 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-0d86634d-21f4-4437-aa27-38222b137979 tempest-CinderUnicodeTest-454738002 None] Creating offline snapshot 8fb84f72-32a7-466d-ab73-635c9b21d5a3 of volume 2975a8e7-5814-4e05-85fa-63f6ae151df1 {{(pid=83924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 22:10:04 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b48f83-68bd-491d-a9a0-710aa9fce342]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:10:04 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-0d86634d-21f4-4437-aa27-38222b137979 tempest-CinderUnicodeTest-454738002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2975a8e7-5814-4e05-85fa-63f6ae151df1 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:04 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-e61960e4-2fc0-43f0-a993-f231560315c2 tempest-GroupsV314Test-680821007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27c5fc86-7f05-4763-8044-67c7d28c5729) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d633637-6f8a-4cab-af97-57be6a0a8f16', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:10:04 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-e61960e4-2fc0-43f0-a993-f231560315c2 tempest-GroupsV314Test-680821007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd7195ba-ea34-4fc2-b0f6-463bfa45815c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:10:04 devstack sudo[89794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2975a8e7-5814-4e05-85fa-63f6ae151df1
Apr 28 22:10:04 devstack sudo[89794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:05 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-e61960e4-2fc0-43f0-a993-f231560315c2 tempest-GroupsV314Test-680821007 None] Volume volume-7d633637-6f8a-4cab-af97-57be6a0a8f16 (7d633637-6f8a-4cab-af97-57be6a0a8f16): created successfully
Apr 28 22:10:05 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-e61960e4-2fc0-43f0-a993-f231560315c2 tempest-GroupsV314Test-680821007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd7195ba-ea34-4fc2-b0f6-463bfa45815c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:10:05 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-e61960e4-2fc0-43f0-a993-f231560315c2 tempest-GroupsV314Test-680821007 None] Flow 'volume_create_manager' (b64b59cb-ca53-496d-a53e-cb6bfc0bbf62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:10:05 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-e61960e4-2fc0-43f0-a993-f231560315c2 tempest-GroupsV314Test-680821007 None] Created volume successfully.
Apr 28 22:10:05 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-687e1416-33b0-4c66-be17-e7cc04b69b0e tempest-VolumesListAdminTestJSON-940057122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:10:05 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-687e1416-33b0-4c66-be17-e7cc04b69b0e tempest-VolumesListAdminTestJSON-940057122 None] Flow 'volume_create_manager' (cb567ea6-6ab8-42c2-9c32-afe75d969328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:10:05 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-687e1416-33b0-4c66-be17-e7cc04b69b0e tempest-VolumesListAdminTestJSON-940057122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b339cae8-d8bf-4d73-9615-f1b35d13deef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:10:05 devstack sudo[89794]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:05 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-687e1416-33b0-4c66-be17-e7cc04b69b0e tempest-VolumesListAdminTestJSON-940057122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b339cae8-d8bf-4d73-9615-f1b35d13deef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:10:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1112683774',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8b5a067-fb24-43e9-ae52-cfdbef2f75e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9969b80e83034685a38681cff4ca0dac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:10:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:10:06Z,use_quota=True,user_id='7aced4d0d1ca4b40bac7bc0e0e4897d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:10:05 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-687e1416-33b0-4c66-be17-e7cc04b69b0e tempest-VolumesListAdminTestJSON-940057122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e880342b-7770-4a03-a0a7-e5cf70438bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:10:05 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-687e1416-33b0-4c66-be17-e7cc04b69b0e tempest-VolumesListAdminTestJSON-940057122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e880342b-7770-4a03-a0a7-e5cf70438bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:10:05 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-687e1416-33b0-4c66-be17-e7cc04b69b0e tempest-VolumesListAdminTestJSON-940057122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (450c5726-91d0-4073-a749-c928e9c9029f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:10:05 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-687e1416-33b0-4c66-be17-e7cc04b69b0e tempest-VolumesListAdminTestJSON-940057122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (450c5726-91d0-4073-a749-c928e9c9029f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8b5a067-fb24-43e9-ae52-cfdbef2f75e9', 'volume_name': 'volume-b8b5a067-fb24-43e9-ae52-cfdbef2f75e9', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:10:05 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-687e1416-33b0-4c66-be17-e7cc04b69b0e tempest-VolumesListAdminTestJSON-940057122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29444ff0-1502-46ef-af24-cedec8a1e390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:10:05 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-687e1416-33b0-4c66-be17-e7cc04b69b0e tempest-VolumesListAdminTestJSON-940057122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29444ff0-1502-46ef-af24-cedec8a1e390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:10:05 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-687e1416-33b0-4c66-be17-e7cc04b69b0e tempest-VolumesListAdminTestJSON-940057122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f7d5c5c-4556-4e7a-ba8f-d391f77d76f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:10:05 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-687e1416-33b0-4c66-be17-e7cc04b69b0e tempest-VolumesListAdminTestJSON-940057122 None] Volume b8b5a067-fb24-43e9-ae52-cfdbef2f75e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8b5a067-fb24-43e9-ae52-cfdbef2f75e9', 'volume_size': 1}
Apr 28 22:10:05 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-687e1416-33b0-4c66-be17-e7cc04b69b0e tempest-VolumesListAdminTestJSON-940057122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:10:05 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-0d86634d-21f4-4437-aa27-38222b137979 tempest-CinderUnicodeTest-454738002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2975a8e7-5814-4e05-85fa-63f6ae151df1" returned: 0 in 0.803s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:05 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-0d86634d-21f4-4437-aa27-38222b137979 tempest-CinderUnicodeTest-454738002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2975a8e7-5814-4e05-85fa-63f6ae151df1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2975a8e7-5814-4e05-85fa-63f6ae151df1.8fb84f72-32a7-466d-ab73-635c9b21d5a3 1G {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:05 devstack sudo[89799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2975a8e7-5814-4e05-85fa-63f6ae151df1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2975a8e7-5814-4e05-85fa-63f6ae151df1.8fb84f72-32a7-466d-ab73-635c9b21d5a3 1G
Apr 28 22:10:05 devstack sudo[89799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:06 devstack sudo[89799]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:06 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-0d86634d-21f4-4437-aa27-38222b137979 tempest-CinderUnicodeTest-454738002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2975a8e7-5814-4e05-85fa-63f6ae151df1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2975a8e7-5814-4e05-85fa-63f6ae151df1.8fb84f72-32a7-466d-ab73-635c9b21d5a3 1G" returned: 0 in 0.757s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:06 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-0d86634d-21f4-4437-aa27-38222b137979 tempest-CinderUnicodeTest-454738002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2975a8e7-5814-4e05-85fa-63f6ae151df1 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2975a8e7-5814-4e05-85fa-63f6ae151df1.8fb84f72-32a7-466d-ab73-635c9b21d5a3 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:06 devstack sudo[89805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2975a8e7-5814-4e05-85fa-63f6ae151df1 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2975a8e7-5814-4e05-85fa-63f6ae151df1.8fb84f72-32a7-466d-ab73-635c9b21d5a3
Apr 28 22:10:06 devstack sudo[89805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:07 devstack sudo[89805]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:07 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-0d86634d-21f4-4437-aa27-38222b137979 tempest-CinderUnicodeTest-454738002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2975a8e7-5814-4e05-85fa-63f6ae151df1 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2975a8e7-5814-4e05-85fa-63f6ae151df1.8fb84f72-32a7-466d-ab73-635c9b21d5a3" returned: 0 in 0.650s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:07 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-0d86634d-21f4-4437-aa27-38222b137979 tempest-CinderUnicodeTest-454738002 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2975a8e7-5814-4e05-85fa-63f6ae151df1.8fb84f72-32a7-466d-ab73-635c9b21d5a3 is being set with open permissions: ugo+rw
Apr 28 22:10:07 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-0d86634d-21f4-4437-aa27-38222b137979 tempest-CinderUnicodeTest-454738002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2975a8e7-5814-4e05-85fa-63f6ae151df1.8fb84f72-32a7-466d-ab73-635c9b21d5a3 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:07 devstack sudo[89810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2975a8e7-5814-4e05-85fa-63f6ae151df1.8fb84f72-32a7-466d-ab73-635c9b21d5a3
Apr 28 22:10:07 devstack sudo[89810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:07 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-06cc1936-c5ae-4de9-80ef-5ee340f55511 tempest-GroupsV314Test-680821007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:10:07 devstack sudo[89810]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:07 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-0d86634d-21f4-4437-aa27-38222b137979 tempest-CinderUnicodeTest-454738002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2975a8e7-5814-4e05-85fa-63f6ae151df1.8fb84f72-32a7-466d-ab73-635c9b21d5a3" returned: 0 in 0.619s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:07 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-0d86634d-21f4-4437-aa27-38222b137979 tempest-CinderUnicodeTest-454738002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2975a8e7-5814-4e05-85fa-63f6ae151df1.info {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:07 devstack sudo[89813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2975a8e7-5814-4e05-85fa-63f6ae151df1.info
Apr 28 22:10:07 devstack sudo[89813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:08 devstack sudo[89813]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:08 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-0d86634d-21f4-4437-aa27-38222b137979 tempest-CinderUnicodeTest-454738002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2975a8e7-5814-4e05-85fa-63f6ae151df1.info" returned: 0 in 0.568s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:08 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-0d86634d-21f4-4437-aa27-38222b137979 tempest-CinderUnicodeTest-454738002 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2975a8e7-5814-4e05-85fa-63f6ae151df1.info is being set with open permissions: ugo+rw
Apr 28 22:10:08 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-0d86634d-21f4-4437-aa27-38222b137979 tempest-CinderUnicodeTest-454738002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2975a8e7-5814-4e05-85fa-63f6ae151df1.info {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:08 devstack sudo[89816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2975a8e7-5814-4e05-85fa-63f6ae151df1.info
Apr 28 22:10:08 devstack sudo[89816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:08 devstack sudo[89816]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:08 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-0d86634d-21f4-4437-aa27-38222b137979 tempest-CinderUnicodeTest-454738002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2975a8e7-5814-4e05-85fa-63f6ae151df1.info" returned: 0 in 0.582s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:08 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-0d86634d-21f4-4437-aa27-38222b137979 tempest-CinderUnicodeTest-454738002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.091s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:10:08 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-687e1416-33b0-4c66-be17-e7cc04b69b0e tempest-VolumesListAdminTestJSON-940057122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.234s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:10:08 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-687e1416-33b0-4c66-be17-e7cc04b69b0e tempest-VolumesListAdminTestJSON-940057122 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:10:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1112683774',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8b5a067-fb24-43e9-ae52-cfdbef2f75e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9969b80e83034685a38681cff4ca0dac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:10:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:10:06Z,use_quota=True,user_id='7aced4d0d1ca4b40bac7bc0e0e4897d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:10:08 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-687e1416-33b0-4c66-be17-e7cc04b69b0e tempest-VolumesListAdminTestJSON-940057122 None] Creating volume b8b5a067-fb24-43e9-ae52-cfdbef2f75e9 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:10:08 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-687e1416-33b0-4c66-be17-e7cc04b69b0e tempest-VolumesListAdminTestJSON-940057122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:10:08 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-687e1416-33b0-4c66-be17-e7cc04b69b0e tempest-VolumesListAdminTestJSON-940057122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:10:08 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-687e1416-33b0-4c66-be17-e7cc04b69b0e tempest-VolumesListAdminTestJSON-940057122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:10:08 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-687e1416-33b0-4c66-be17-e7cc04b69b0e tempest-VolumesListAdminTestJSON-940057122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:10:08 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-687e1416-33b0-4c66-be17-e7cc04b69b0e tempest-VolumesListAdminTestJSON-940057122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:10:08 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-687e1416-33b0-4c66-be17-e7cc04b69b0e tempest-VolumesListAdminTestJSON-940057122 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:10:08 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-687e1416-33b0-4c66-be17-e7cc04b69b0e tempest-VolumesListAdminTestJSON-940057122 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:10:08 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-687e1416-33b0-4c66-be17-e7cc04b69b0e tempest-VolumesListAdminTestJSON-940057122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b8b5a067-fb24-43e9-ae52-cfdbef2f75e9 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:08 devstack sudo[89819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b8b5a067-fb24-43e9-ae52-cfdbef2f75e9 1073741824
Apr 28 22:10:08 devstack sudo[89819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:08 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-0d86634d-21f4-4437-aa27-38222b137979 tempest-CinderUnicodeTest-454738002 None] Create snapshot completed successfully
Apr 28 22:10:09 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-968298a4-db8d-47ff-a276-092f63caa18d tempest-CinderUnicodeTest-454738002 None] Acquiring lock "cinder-8fb84f72-32a7-466d-ab73-635c9b21d5a3-delete_snapshot" by "delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:10:09 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-968298a4-db8d-47ff-a276-092f63caa18d tempest-CinderUnicodeTest-454738002 None] Lock "cinder-8fb84f72-32a7-466d-ab73-635c9b21d5a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:10:09 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-968298a4-db8d-47ff-a276-092f63caa18d tempest-CinderUnicodeTest-454738002 None] Acquiring lock "cinder-quobyte-2975a8e7-5814-4e05-85fa-63f6ae151df1" by "delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:10:09 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-968298a4-db8d-47ff-a276-092f63caa18d tempest-CinderUnicodeTest-454738002 None] Lock "cinder-quobyte-2975a8e7-5814-4e05-85fa-63f6ae151df1" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:10:09 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-968298a4-db8d-47ff-a276-092f63caa18d tempest-CinderUnicodeTest-454738002 None] Acquiring lock "cinder-quobyte-8fb84f72-32a7-466d-ab73-635c9b21d5a3" by "_delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:10:09 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-968298a4-db8d-47ff-a276-092f63caa18d tempest-CinderUnicodeTest-454738002 None] Lock "cinder-quobyte-8fb84f72-32a7-466d-ab73-635c9b21d5a3" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:10:09 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-968298a4-db8d-47ff-a276-092f63caa18d tempest-CinderUnicodeTest-454738002 None] Deleting offline snapshot 8fb84f72-32a7-466d-ab73-635c9b21d5a3 of volume 2975a8e7-5814-4e05-85fa-63f6ae151df1 {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 22:10:09 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-968298a4-db8d-47ff-a276-092f63caa18d tempest-CinderUnicodeTest-454738002 None] snapshot_file for this snap is: volume-2975a8e7-5814-4e05-85fa-63f6ae151df1.8fb84f72-32a7-466d-ab73-635c9b21d5a3 {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 22:10:09 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b671bec-af67-4c99-b044-59fea4a89bcd]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:10:09 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-968298a4-db8d-47ff-a276-092f63caa18d tempest-CinderUnicodeTest-454738002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2975a8e7-5814-4e05-85fa-63f6ae151df1.8fb84f72-32a7-466d-ab73-635c9b21d5a3 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:09 devstack sudo[89821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2975a8e7-5814-4e05-85fa-63f6ae151df1.8fb84f72-32a7-466d-ab73-635c9b21d5a3
Apr 28 22:10:09 devstack sudo[89821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:09 devstack sudo[89819]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:09 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-687e1416-33b0-4c66-be17-e7cc04b69b0e tempest-VolumesListAdminTestJSON-940057122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b8b5a067-fb24-43e9-ae52-cfdbef2f75e9 1073741824" returned: 0 in 0.853s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:09 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-687e1416-33b0-4c66-be17-e7cc04b69b0e tempest-VolumesListAdminTestJSON-940057122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b8b5a067-fb24-43e9-ae52-cfdbef2f75e9 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:09 devstack sudo[89826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b8b5a067-fb24-43e9-ae52-cfdbef2f75e9
Apr 28 22:10:09 devstack sudo[89826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:10 devstack sudo[89821]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:10 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-968298a4-db8d-47ff-a276-092f63caa18d tempest-CinderUnicodeTest-454738002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2975a8e7-5814-4e05-85fa-63f6ae151df1.8fb84f72-32a7-466d-ab73-635c9b21d5a3" returned: 0 in 0.782s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:10 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-968298a4-db8d-47ff-a276-092f63caa18d tempest-CinderUnicodeTest-454738002 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2975a8e7-5814-4e05-85fa-63f6ae151df1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 22:10:10 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad88e7f3-05a2-411b-bc8b-4da87f13165a]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:10:10 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-968298a4-db8d-47ff-a276-092f63caa18d tempest-CinderUnicodeTest-454738002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2975a8e7-5814-4e05-85fa-63f6ae151df1 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:10 devstack sudo[89831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2975a8e7-5814-4e05-85fa-63f6ae151df1
Apr 28 22:10:10 devstack sudo[89831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:10 devstack sudo[89826]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:10 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-687e1416-33b0-4c66-be17-e7cc04b69b0e tempest-VolumesListAdminTestJSON-940057122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b8b5a067-fb24-43e9-ae52-cfdbef2f75e9" returned: 0 in 0.581s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:10 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-687e1416-33b0-4c66-be17-e7cc04b69b0e tempest-VolumesListAdminTestJSON-940057122 None] <== create_volume: return (1471ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:10:10 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-687e1416-33b0-4c66-be17-e7cc04b69b0e tempest-VolumesListAdminTestJSON-940057122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.474s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:10:10 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-06cc1936-c5ae-4de9-80ef-5ee340f55511 tempest-GroupsV314Test-680821007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 3.175s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:10:10 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-06cc1936-c5ae-4de9-80ef-5ee340f55511 tempest-GroupsV314Test-680821007 None] Cloning volume 7d633637-6f8a-4cab-af97-57be6a0a8f16 to volume fea05851-5155-4d53-b7ef-9e19ab723195
Apr 28 22:10:10 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-687e1416-33b0-4c66-be17-e7cc04b69b0e tempest-VolumesListAdminTestJSON-940057122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f7d5c5c-4556-4e7a-ba8f-d391f77d76f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8b5a067-fb24-43e9-ae52-cfdbef2f75e9', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:10:10 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-687e1416-33b0-4c66-be17-e7cc04b69b0e tempest-VolumesListAdminTestJSON-940057122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9efa67b3-3e03-453a-a184-4038ca7cdd77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:10:10 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-687e1416-33b0-4c66-be17-e7cc04b69b0e tempest-VolumesListAdminTestJSON-940057122 None] Volume volume-b8b5a067-fb24-43e9-ae52-cfdbef2f75e9 (b8b5a067-fb24-43e9-ae52-cfdbef2f75e9): created successfully
Apr 28 22:10:10 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-687e1416-33b0-4c66-be17-e7cc04b69b0e tempest-VolumesListAdminTestJSON-940057122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9efa67b3-3e03-453a-a184-4038ca7cdd77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:10:10 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-687e1416-33b0-4c66-be17-e7cc04b69b0e tempest-VolumesListAdminTestJSON-940057122 None] Flow 'volume_create_manager' (cb567ea6-6ab8-42c2-9c32-afe75d969328) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:10:10 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-06cc1936-c5ae-4de9-80ef-5ee340f55511 tempest-GroupsV314Test-680821007 None] Creating offline snapshot d9a3ae0a-fdd9-4e09-b88b-118acefb4b40 of volume 7d633637-6f8a-4cab-af97-57be6a0a8f16 {{(pid=83924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 22:10:10 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-687e1416-33b0-4c66-be17-e7cc04b69b0e tempest-VolumesListAdminTestJSON-940057122 None] Created volume successfully.
Apr 28 22:10:10 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ef59f2-057f-4eff-a497-e0afcedf0fb2]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:10:10 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-06cc1936-c5ae-4de9-80ef-5ee340f55511 tempest-GroupsV314Test-680821007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7d633637-6f8a-4cab-af97-57be6a0a8f16 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:10 devstack sudo[89834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7d633637-6f8a-4cab-af97-57be6a0a8f16
Apr 28 22:10:10 devstack sudo[89834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:10 devstack sudo[89831]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:10 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-968298a4-db8d-47ff-a276-092f63caa18d tempest-CinderUnicodeTest-454738002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2975a8e7-5814-4e05-85fa-63f6ae151df1" returned: 0 in 0.720s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:10 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-968298a4-db8d-47ff-a276-092f63caa18d tempest-CinderUnicodeTest-454738002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2975a8e7-5814-4e05-85fa-63f6ae151df1.8fb84f72-32a7-466d-ab73-635c9b21d5a3 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:10 devstack sudo[89839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2975a8e7-5814-4e05-85fa-63f6ae151df1.8fb84f72-32a7-466d-ab73-635c9b21d5a3
Apr 28 22:10:10 devstack sudo[89839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:11 devstack sudo[89834]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:11 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-06cc1936-c5ae-4de9-80ef-5ee340f55511 tempest-GroupsV314Test-680821007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7d633637-6f8a-4cab-af97-57be6a0a8f16" returned: 0 in 0.817s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:11 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-06cc1936-c5ae-4de9-80ef-5ee340f55511 tempest-GroupsV314Test-680821007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7d633637-6f8a-4cab-af97-57be6a0a8f16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7d633637-6f8a-4cab-af97-57be6a0a8f16.d9a3ae0a-fdd9-4e09-b88b-118acefb4b40 1G {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:11 devstack sudo[89848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7d633637-6f8a-4cab-af97-57be6a0a8f16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7d633637-6f8a-4cab-af97-57be6a0a8f16.d9a3ae0a-fdd9-4e09-b88b-118acefb4b40 1G
Apr 28 22:10:11 devstack sudo[89848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:11 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-0aaac963-2e0b-4274-89d0-4447cc79528a tempest-VolumesListAdminTestJSON-940057122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:10:11 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-0aaac963-2e0b-4274-89d0-4447cc79528a tempest-VolumesListAdminTestJSON-940057122 None] Flow 'volume_create_manager' (f9ec09b0-1d24-40bb-9bc8-e08b1d55ba21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:10:11 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-0aaac963-2e0b-4274-89d0-4447cc79528a tempest-VolumesListAdminTestJSON-940057122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b62d2ae2-d16d-472b-9097-8cc61c1f24b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:10:11 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-0aaac963-2e0b-4274-89d0-4447cc79528a tempest-VolumesListAdminTestJSON-940057122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b62d2ae2-d16d-472b-9097-8cc61c1f24b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:10:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-897482252',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=275815b6-4b8a-4630-a08d-e130d9b310b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9969b80e83034685a38681cff4ca0dac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:10:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:10:11Z,use_quota=True,user_id='7aced4d0d1ca4b40bac7bc0e0e4897d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:10:11 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-0aaac963-2e0b-4274-89d0-4447cc79528a tempest-VolumesListAdminTestJSON-940057122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e33a1cf-54ef-42de-8b65-80e27ad26814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:10:11 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-0aaac963-2e0b-4274-89d0-4447cc79528a tempest-VolumesListAdminTestJSON-940057122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e33a1cf-54ef-42de-8b65-80e27ad26814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:10:11 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-0aaac963-2e0b-4274-89d0-4447cc79528a tempest-VolumesListAdminTestJSON-940057122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f277a8d7-c384-42d3-adb0-d7faf6f646a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:10:11 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-0aaac963-2e0b-4274-89d0-4447cc79528a tempest-VolumesListAdminTestJSON-940057122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f277a8d7-c384-42d3-adb0-d7faf6f646a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '275815b6-4b8a-4630-a08d-e130d9b310b5', 'volume_name': 'volume-275815b6-4b8a-4630-a08d-e130d9b310b5', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:10:11 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-0aaac963-2e0b-4274-89d0-4447cc79528a tempest-VolumesListAdminTestJSON-940057122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (884635e4-337e-472a-951a-783bf34aae79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:10:11 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-0aaac963-2e0b-4274-89d0-4447cc79528a tempest-VolumesListAdminTestJSON-940057122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (884635e4-337e-472a-951a-783bf34aae79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:10:11 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-0aaac963-2e0b-4274-89d0-4447cc79528a tempest-VolumesListAdminTestJSON-940057122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed6ca5f1-344b-4b86-ae46-93c78206c96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:10:11 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-0aaac963-2e0b-4274-89d0-4447cc79528a tempest-VolumesListAdminTestJSON-940057122 None] Volume 275815b6-4b8a-4630-a08d-e130d9b310b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-275815b6-4b8a-4630-a08d-e130d9b310b5', 'volume_size': 1}
Apr 28 22:10:11 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-0aaac963-2e0b-4274-89d0-4447cc79528a tempest-VolumesListAdminTestJSON-940057122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:10:11 devstack sudo[89839]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:11 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-968298a4-db8d-47ff-a276-092f63caa18d tempest-CinderUnicodeTest-454738002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2975a8e7-5814-4e05-85fa-63f6ae151df1.8fb84f72-32a7-466d-ab73-635c9b21d5a3" returned: 0 in 0.725s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:11 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-968298a4-db8d-47ff-a276-092f63caa18d tempest-CinderUnicodeTest-454738002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2975a8e7-5814-4e05-85fa-63f6ae151df1.8fb84f72-32a7-466d-ab73-635c9b21d5a3 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:11 devstack sudo[89850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2975a8e7-5814-4e05-85fa-63f6ae151df1.8fb84f72-32a7-466d-ab73-635c9b21d5a3
Apr 28 22:10:11 devstack sudo[89850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:12 devstack sudo[89848]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:12 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-06cc1936-c5ae-4de9-80ef-5ee340f55511 tempest-GroupsV314Test-680821007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7d633637-6f8a-4cab-af97-57be6a0a8f16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7d633637-6f8a-4cab-af97-57be6a0a8f16.d9a3ae0a-fdd9-4e09-b88b-118acefb4b40 1G" returned: 0 in 0.790s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:12 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-06cc1936-c5ae-4de9-80ef-5ee340f55511 tempest-GroupsV314Test-680821007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d633637-6f8a-4cab-af97-57be6a0a8f16 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7d633637-6f8a-4cab-af97-57be6a0a8f16.d9a3ae0a-fdd9-4e09-b88b-118acefb4b40 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:12 devstack sudo[89856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d633637-6f8a-4cab-af97-57be6a0a8f16 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7d633637-6f8a-4cab-af97-57be6a0a8f16.d9a3ae0a-fdd9-4e09-b88b-118acefb4b40
Apr 28 22:10:12 devstack sudo[89856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:12 devstack sudo[89850]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:12 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-968298a4-db8d-47ff-a276-092f63caa18d tempest-CinderUnicodeTest-454738002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2975a8e7-5814-4e05-85fa-63f6ae151df1.8fb84f72-32a7-466d-ab73-635c9b21d5a3" returned: 0 in 0.660s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:12 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-968298a4-db8d-47ff-a276-092f63caa18d tempest-CinderUnicodeTest-454738002 None] Lock "cinder-quobyte-8fb84f72-32a7-466d-ab73-635c9b21d5a3" released by "_delete_snapshot" :: held 3.001s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:10:12 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-968298a4-db8d-47ff-a276-092f63caa18d tempest-CinderUnicodeTest-454738002 None] Lock "cinder-quobyte-2975a8e7-5814-4e05-85fa-63f6ae151df1" released by "delete_snapshot" :: held 3.031s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:10:12 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-968298a4-db8d-47ff-a276-092f63caa18d tempest-CinderUnicodeTest-454738002 None] Created reservations ['8213cd0c-3447-47ba-9627-f7cfbeef1217', 'cce1acba-b056-43ff-8ab5-53e69a41539c', '8b6f4621-4670-4de6-9969-85e30b8f350b', 'b72dd96b-28b2-4814-83a5-b023a10c1f5e'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:10:12 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-968298a4-db8d-47ff-a276-092f63caa18d tempest-CinderUnicodeTest-454738002 None] Delete snapshot completed successfully.
Apr 28 22:10:12 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-968298a4-db8d-47ff-a276-092f63caa18d tempest-CinderUnicodeTest-454738002 None] Lock "cinder-8fb84f72-32a7-466d-ab73-635c9b21d5a3-delete_snapshot" released by "delete_snapshot" :: held 3.191s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:10:12 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-fb790401-55bb-4a45-9b97-7186f11d3b44 tempest-CinderUnicodeTest-454738002 None] Acquiring lock "cinder-2975a8e7-5814-4e05-85fa-63f6ae151df1-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:10:12 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-fb790401-55bb-4a45-9b97-7186f11d3b44 tempest-CinderUnicodeTest-454738002 None] Lock "cinder-2975a8e7-5814-4e05-85fa-63f6ae151df1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:10:12 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-fb790401-55bb-4a45-9b97-7186f11d3b44 tempest-CinderUnicodeTest-454738002 None] Acquiring lock "cinder-quobyte-2975a8e7-5814-4e05-85fa-63f6ae151df1" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:10:12 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-fb790401-55bb-4a45-9b97-7186f11d3b44 tempest-CinderUnicodeTest-454738002 None] Lock "cinder-quobyte-2975a8e7-5814-4e05-85fa-63f6ae151df1" acquired by "delete_volume" :: waited 0.014s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:10:12 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb6da71-75fe-405d-8b9f-cc650fc10efc]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:10:12 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-fb790401-55bb-4a45-9b97-7186f11d3b44 tempest-CinderUnicodeTest-454738002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2975a8e7-5814-4e05-85fa-63f6ae151df1 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:12 devstack sudo[89858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2975a8e7-5814-4e05-85fa-63f6ae151df1
Apr 28 22:10:12 devstack sudo[89858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:12 devstack sudo[89856]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:12 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-06cc1936-c5ae-4de9-80ef-5ee340f55511 tempest-GroupsV314Test-680821007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d633637-6f8a-4cab-af97-57be6a0a8f16 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7d633637-6f8a-4cab-af97-57be6a0a8f16.d9a3ae0a-fdd9-4e09-b88b-118acefb4b40" returned: 0 in 0.738s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:12 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-06cc1936-c5ae-4de9-80ef-5ee340f55511 tempest-GroupsV314Test-680821007 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7d633637-6f8a-4cab-af97-57be6a0a8f16.d9a3ae0a-fdd9-4e09-b88b-118acefb4b40 is being set with open permissions: ugo+rw: NotImplementedError
Apr 28 22:10:12 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-06cc1936-c5ae-4de9-80ef-5ee340f55511 tempest-GroupsV314Test-680821007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7d633637-6f8a-4cab-af97-57be6a0a8f16.d9a3ae0a-fdd9-4e09-b88b-118acefb4b40 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:12 devstack sudo[89864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7d633637-6f8a-4cab-af97-57be6a0a8f16.d9a3ae0a-fdd9-4e09-b88b-118acefb4b40
Apr 28 22:10:12 devstack sudo[89864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:13 devstack sudo[89858]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:13 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-fb790401-55bb-4a45-9b97-7186f11d3b44 tempest-CinderUnicodeTest-454738002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2975a8e7-5814-4e05-85fa-63f6ae151df1" returned: 0 in 0.779s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:13 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-fb790401-55bb-4a45-9b97-7186f11d3b44 tempest-CinderUnicodeTest-454738002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2975a8e7-5814-4e05-85fa-63f6ae151df1 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:13 devstack sudo[89869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2975a8e7-5814-4e05-85fa-63f6ae151df1
Apr 28 22:10:13 devstack sudo[89869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:13 devstack sudo[89864]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:13 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-06cc1936-c5ae-4de9-80ef-5ee340f55511 tempest-GroupsV314Test-680821007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7d633637-6f8a-4cab-af97-57be6a0a8f16.d9a3ae0a-fdd9-4e09-b88b-118acefb4b40" returned: 0 in 0.624s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:13 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-06cc1936-c5ae-4de9-80ef-5ee340f55511 tempest-GroupsV314Test-680821007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7d633637-6f8a-4cab-af97-57be6a0a8f16.info {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:13 devstack sudo[89872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7d633637-6f8a-4cab-af97-57be6a0a8f16.info
Apr 28 22:10:13 devstack sudo[89872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:13 devstack sudo[89869]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:13 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-fb790401-55bb-4a45-9b97-7186f11d3b44 tempest-CinderUnicodeTest-454738002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2975a8e7-5814-4e05-85fa-63f6ae151df1" returned: 0 in 0.686s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:14 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-fb790401-55bb-4a45-9b97-7186f11d3b44 tempest-CinderUnicodeTest-454738002 None] Lock "cinder-quobyte-2975a8e7-5814-4e05-85fa-63f6ae151df1" released by "delete_volume" :: held 1.529s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:10:14 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-fb790401-55bb-4a45-9b97-7186f11d3b44 tempest-CinderUnicodeTest-454738002 None] Created reservations ['c2c89a55-0b0e-4dd6-a12e-24d5b1fdf3be', '63064da1-d1d8-4434-aa2a-02fc027c55c4', 'c186a606-0ae2-417d-b466-ea054f9b9503', 'a8250b87-406a-4d85-b263-a33182f2d2b2'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:10:14 devstack sudo[89872]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:14 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-fb790401-55bb-4a45-9b97-7186f11d3b44 tempest-CinderUnicodeTest-454738002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:10:14 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-fb790401-55bb-4a45-9b97-7186f11d3b44 tempest-CinderUnicodeTest-454738002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:10:14 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-fb790401-55bb-4a45-9b97-7186f11d3b44 tempest-CinderUnicodeTest-454738002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:10:14 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-fb790401-55bb-4a45-9b97-7186f11d3b44 tempest-CinderUnicodeTest-454738002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:10:14 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-fb790401-55bb-4a45-9b97-7186f11d3b44 tempest-CinderUnicodeTest-454738002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:10:14 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-fb790401-55bb-4a45-9b97-7186f11d3b44 tempest-CinderUnicodeTest-454738002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:14 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-06cc1936-c5ae-4de9-80ef-5ee340f55511 tempest-GroupsV314Test-680821007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7d633637-6f8a-4cab-af97-57be6a0a8f16.info" returned: 0 in 0.643s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:14 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-06cc1936-c5ae-4de9-80ef-5ee340f55511 tempest-GroupsV314Test-680821007 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7d633637-6f8a-4cab-af97-57be6a0a8f16.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 28 22:10:14 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-06cc1936-c5ae-4de9-80ef-5ee340f55511 tempest-GroupsV314Test-680821007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7d633637-6f8a-4cab-af97-57be6a0a8f16.info {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:14 devstack sudo[89876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:10:14 devstack sudo[89876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:14 devstack sudo[89877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7d633637-6f8a-4cab-af97-57be6a0a8f16.info
Apr 28 22:10:14 devstack sudo[89877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:14 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-2db3fba2-861b-4bc9-99ee-a961470ba264 tempest-CinderUnicodeTest-454738002 None] Acquiring lock "cinder-d37f86dd-073b-4c01-a40a-fddfec90be78-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:10:14 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-2db3fba2-861b-4bc9-99ee-a961470ba264 tempest-CinderUnicodeTest-454738002 None] Lock "cinder-d37f86dd-073b-4c01-a40a-fddfec90be78-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:10:14 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-2db3fba2-861b-4bc9-99ee-a961470ba264 tempest-CinderUnicodeTest-454738002 None] Acquiring lock "cinder-quobyte-d37f86dd-073b-4c01-a40a-fddfec90be78" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:10:14 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-2db3fba2-861b-4bc9-99ee-a961470ba264 tempest-CinderUnicodeTest-454738002 None] Lock "cinder-quobyte-d37f86dd-073b-4c01-a40a-fddfec90be78" acquired by "delete_volume" :: waited 0.025s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:10:14 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[002aa157-1576-404f-a12a-584c200f49bd]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:10:14 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-2db3fba2-861b-4bc9-99ee-a961470ba264 tempest-CinderUnicodeTest-454738002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-d37f86dd-073b-4c01-a40a-fddfec90be78 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:14 devstack sudo[89876]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:14 devstack sudo[89877]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:14 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-fb790401-55bb-4a45-9b97-7186f11d3b44 tempest-CinderUnicodeTest-454738002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.688s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:14 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-fb790401-55bb-4a45-9b97-7186f11d3b44 tempest-CinderUnicodeTest-454738002 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:10:14 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-06cc1936-c5ae-4de9-80ef-5ee340f55511 tempest-GroupsV314Test-680821007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7d633637-6f8a-4cab-af97-57be6a0a8f16.info" returned: 0 in 0.680s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:14 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-06cc1936-c5ae-4de9-80ef-5ee340f55511 tempest-GroupsV314Test-680821007 None] Acquiring lock "cinder-quobyte-fea05851-5155-4d53-b7ef-9e19ab723195" by "_copy_volume_from_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:10:14 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-fb790401-55bb-4a45-9b97-7186f11d3b44 tempest-CinderUnicodeTest-454738002 None] Deleted volume successfully.
Apr 28 22:10:14 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-06cc1936-c5ae-4de9-80ef-5ee340f55511 tempest-GroupsV314Test-680821007 None] Lock "cinder-quobyte-fea05851-5155-4d53-b7ef-9e19ab723195" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:10:14 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-06cc1936-c5ae-4de9-80ef-5ee340f55511 tempest-GroupsV314Test-680821007 None] snapshot: d9a3ae0a-fdd9-4e09-b88b-118acefb4b40, volume: fea05851-5155-4d53-b7ef-9e19ab723195,  {{(pid=83924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 28 22:10:14 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-06cc1936-c5ae-4de9-80ef-5ee340f55511 tempest-GroupsV314Test-680821007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:10:14 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-06cc1936-c5ae-4de9-80ef-5ee340f55511 tempest-GroupsV314Test-680821007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:10:14 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-06cc1936-c5ae-4de9-80ef-5ee340f55511 tempest-GroupsV314Test-680821007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:10:14 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-06cc1936-c5ae-4de9-80ef-5ee340f55511 tempest-GroupsV314Test-680821007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:10:14 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-06cc1936-c5ae-4de9-80ef-5ee340f55511 tempest-GroupsV314Test-680821007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:10:14 devstack sudo[89882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-d37f86dd-073b-4c01-a40a-fddfec90be78
Apr 28 22:10:14 devstack sudo[89882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:14 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-fb790401-55bb-4a45-9b97-7186f11d3b44 tempest-CinderUnicodeTest-454738002 None] Lock "cinder-2975a8e7-5814-4e05-85fa-63f6ae151df1-delete_volume" released by "delete_volume" :: held 2.489s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:10:14 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4bfd59-69d6-4cff-8f79-65f7ebef8309]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:10:14 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-06cc1936-c5ae-4de9-80ef-5ee340f55511 tempest-GroupsV314Test-680821007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7d633637-6f8a-4cab-af97-57be6a0a8f16.d9a3ae0a-fdd9-4e09-b88b-118acefb4b40 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:15 devstack sudo[89884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7d633637-6f8a-4cab-af97-57be6a0a8f16.d9a3ae0a-fdd9-4e09-b88b-118acefb4b40
Apr 28 22:10:15 devstack sudo[89884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:15 devstack sudo[89882]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:15 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-2db3fba2-861b-4bc9-99ee-a961470ba264 tempest-CinderUnicodeTest-454738002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-d37f86dd-073b-4c01-a40a-fddfec90be78" returned: 0 in 0.759s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:15 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-2db3fba2-861b-4bc9-99ee-a961470ba264 tempest-CinderUnicodeTest-454738002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-d37f86dd-073b-4c01-a40a-fddfec90be78 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:15 devstack sudo[89891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-d37f86dd-073b-4c01-a40a-fddfec90be78
Apr 28 22:10:15 devstack sudo[89891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:15 devstack sudo[89884]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:15 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-06cc1936-c5ae-4de9-80ef-5ee340f55511 tempest-GroupsV314Test-680821007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7d633637-6f8a-4cab-af97-57be6a0a8f16.d9a3ae0a-fdd9-4e09-b88b-118acefb4b40" returned: 0 in 0.773s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:15 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-06cc1936-c5ae-4de9-80ef-5ee340f55511 tempest-GroupsV314Test-680821007 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d633637-6f8a-4cab-af97-57be6a0a8f16(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 22:10:15 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-06cc1936-c5ae-4de9-80ef-5ee340f55511 tempest-GroupsV314Test-680821007 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7d633637-6f8a-4cab-af97-57be6a0a8f16 {{(pid=83924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 28 22:10:15 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-06cc1936-c5ae-4de9-80ef-5ee340f55511 tempest-GroupsV314Test-680821007 None] Creating direct copy from snapshot {{(pid=83924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 28 22:10:15 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc12a050-258e-4a32-b0c5-3f42116f40dc]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:10:15 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-06cc1936-c5ae-4de9-80ef-5ee340f55511 tempest-GroupsV314Test-680821007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7d633637-6f8a-4cab-af97-57be6a0a8f16 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:15 devstack sudo[89894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7d633637-6f8a-4cab-af97-57be6a0a8f16
Apr 28 22:10:15 devstack sudo[89894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:16 devstack sudo[89891]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:16 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-2db3fba2-861b-4bc9-99ee-a961470ba264 tempest-CinderUnicodeTest-454738002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-d37f86dd-073b-4c01-a40a-fddfec90be78" returned: 0 in 0.605s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:16 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-2db3fba2-861b-4bc9-99ee-a961470ba264 tempest-CinderUnicodeTest-454738002 None] Lock "cinder-quobyte-d37f86dd-073b-4c01-a40a-fddfec90be78" released by "delete_volume" :: held 1.418s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:10:16 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-2db3fba2-861b-4bc9-99ee-a961470ba264 tempest-CinderUnicodeTest-454738002 None] Created reservations ['c2d8ceed-fb79-45c1-a8d5-da962b262719', 'df412139-2401-4f7b-86a5-5422263b8f49', 'c24cdcb0-2de3-4d04-9d3a-346fd9851bc2', 'b0388c9c-6630-414a-ac80-be7c531802a6'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:10:16 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-2db3fba2-861b-4bc9-99ee-a961470ba264 tempest-CinderUnicodeTest-454738002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:10:16 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-2db3fba2-861b-4bc9-99ee-a961470ba264 tempest-CinderUnicodeTest-454738002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:10:16 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-2db3fba2-861b-4bc9-99ee-a961470ba264 tempest-CinderUnicodeTest-454738002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:10:16 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-2db3fba2-861b-4bc9-99ee-a961470ba264 tempest-CinderUnicodeTest-454738002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:10:16 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-2db3fba2-861b-4bc9-99ee-a961470ba264 tempest-CinderUnicodeTest-454738002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:10:16 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-2db3fba2-861b-4bc9-99ee-a961470ba264 tempest-CinderUnicodeTest-454738002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:16 devstack sudo[89897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:10:16 devstack sudo[89897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:16 devstack sudo[89894]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:16 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-06cc1936-c5ae-4de9-80ef-5ee340f55511 tempest-GroupsV314Test-680821007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7d633637-6f8a-4cab-af97-57be6a0a8f16" returned: 0 in 0.766s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:16 devstack cinder-volume[83924]: DEBUG cinder.utils [None req-06cc1936-c5ae-4de9-80ef-5ee340f55511 tempest-GroupsV314Test-680821007 None] Path /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-fea05851-5155-4d53-b7ef-9e19ab723195 not found in is_blk_device check {{(pid=83924) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 28 22:10:16 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-06cc1936-c5ae-4de9-80ef-5ee340f55511 tempest-GroupsV314Test-680821007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7d633637-6f8a-4cab-af97-57be6a0a8f16 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-fea05851-5155-4d53-b7ef-9e19ab723195 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:16 devstack sudo[89902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7d633637-6f8a-4cab-af97-57be6a0a8f16 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-fea05851-5155-4d53-b7ef-9e19ab723195
Apr 28 22:10:16 devstack sudo[89902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:16 devstack sudo[89897]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:16 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-2db3fba2-861b-4bc9-99ee-a961470ba264 tempest-CinderUnicodeTest-454738002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.609s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:16 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-2db3fba2-861b-4bc9-99ee-a961470ba264 tempest-CinderUnicodeTest-454738002 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:10:16 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-2db3fba2-861b-4bc9-99ee-a961470ba264 tempest-CinderUnicodeTest-454738002 None] Deleted volume successfully.
Apr 28 22:10:16 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-2db3fba2-861b-4bc9-99ee-a961470ba264 tempest-CinderUnicodeTest-454738002 None] Lock "cinder-d37f86dd-073b-4c01-a40a-fddfec90be78-delete_volume" released by "delete_volume" :: held 2.268s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:10:21 devstack sudo[89902]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:21 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-06cc1936-c5ae-4de9-80ef-5ee340f55511 tempest-GroupsV314Test-680821007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7d633637-6f8a-4cab-af97-57be6a0a8f16 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-fea05851-5155-4d53-b7ef-9e19ab723195" returned: 0 in 5.312s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:21 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a624ff-6f57-4217-9736-3c993bd32e61]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:10:21 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-06cc1936-c5ae-4de9-80ef-5ee340f55511 tempest-GroupsV314Test-680821007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7d633637-6f8a-4cab-af97-57be6a0a8f16 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:21 devstack sudo[89954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7d633637-6f8a-4cab-af97-57be6a0a8f16
Apr 28 22:10:21 devstack sudo[89954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:22 devstack sudo[89954]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:22 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-06cc1936-c5ae-4de9-80ef-5ee340f55511 tempest-GroupsV314Test-680821007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7d633637-6f8a-4cab-af97-57be6a0a8f16" returned: 0 in 1.082s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:22 devstack cinder-volume[83924]: DEBUG cinder.image.image_utils [None req-06cc1936-c5ae-4de9-80ef-5ee340f55511 tempest-GroupsV314Test-680821007 None] Image conversion details: src /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7d633637-6f8a-4cab-af97-57be6a0a8f16, size 1024.00 MB, duration 5.31 sec, destination /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-fea05851-5155-4d53-b7ef-9e19ab723195 {{(pid=83924) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 28 22:10:22 devstack cinder-volume[83924]: INFO cinder.image.image_utils [None req-06cc1936-c5ae-4de9-80ef-5ee340f55511 tempest-GroupsV314Test-680821007 None] Converted 1024.00 MB image at 192.73 MB/s
Apr 28 22:10:22 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-06cc1936-c5ae-4de9-80ef-5ee340f55511 tempest-GroupsV314Test-680821007 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-fea05851-5155-4d53-b7ef-9e19ab723195 is being set with open permissions: ugo+rw: NotImplementedError
Apr 28 22:10:22 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-06cc1936-c5ae-4de9-80ef-5ee340f55511 tempest-GroupsV314Test-680821007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-fea05851-5155-4d53-b7ef-9e19ab723195 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:22 devstack sudo[89961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-fea05851-5155-4d53-b7ef-9e19ab723195
Apr 28 22:10:22 devstack sudo[89961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:23 devstack sudo[89961]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:23 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-06cc1936-c5ae-4de9-80ef-5ee340f55511 tempest-GroupsV314Test-680821007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-fea05851-5155-4d53-b7ef-9e19ab723195" returned: 0 in 0.806s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:23 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-06cc1936-c5ae-4de9-80ef-5ee340f55511 tempest-GroupsV314Test-680821007 None] Lock "cinder-quobyte-fea05851-5155-4d53-b7ef-9e19ab723195" released by "_copy_volume_from_snapshot" :: held 8.844s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:10:23 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-06cc1936-c5ae-4de9-80ef-5ee340f55511 tempest-GroupsV314Test-680821007 None] Acquiring lock "cinder-quobyte-d9a3ae0a-fdd9-4e09-b88b-118acefb4b40" by "_delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:10:23 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-06cc1936-c5ae-4de9-80ef-5ee340f55511 tempest-GroupsV314Test-680821007 None] Lock "cinder-quobyte-d9a3ae0a-fdd9-4e09-b88b-118acefb4b40" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:10:23 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-06cc1936-c5ae-4de9-80ef-5ee340f55511 tempest-GroupsV314Test-680821007 None] Deleting offline snapshot d9a3ae0a-fdd9-4e09-b88b-118acefb4b40 of volume 7d633637-6f8a-4cab-af97-57be6a0a8f16 {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 22:10:23 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-06cc1936-c5ae-4de9-80ef-5ee340f55511 tempest-GroupsV314Test-680821007 None] snapshot_file for this snap is: volume-7d633637-6f8a-4cab-af97-57be6a0a8f16.d9a3ae0a-fdd9-4e09-b88b-118acefb4b40 {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 22:10:23 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f453609-7155-44c7-bab3-ecabc00cf77d]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:10:23 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-06cc1936-c5ae-4de9-80ef-5ee340f55511 tempest-GroupsV314Test-680821007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7d633637-6f8a-4cab-af97-57be6a0a8f16.d9a3ae0a-fdd9-4e09-b88b-118acefb4b40 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:23 devstack sudo[89966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7d633637-6f8a-4cab-af97-57be6a0a8f16.d9a3ae0a-fdd9-4e09-b88b-118acefb4b40
Apr 28 22:10:23 devstack sudo[89966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:24 devstack sudo[89966]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:24 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-06cc1936-c5ae-4de9-80ef-5ee340f55511 tempest-GroupsV314Test-680821007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7d633637-6f8a-4cab-af97-57be6a0a8f16.d9a3ae0a-fdd9-4e09-b88b-118acefb4b40" returned: 0 in 0.766s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:24 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-06cc1936-c5ae-4de9-80ef-5ee340f55511 tempest-GroupsV314Test-680821007 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d633637-6f8a-4cab-af97-57be6a0a8f16(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 22:10:24 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9525b86-ac25-458a-b42a-d837d4f44c4d]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:10:24 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-06cc1936-c5ae-4de9-80ef-5ee340f55511 tempest-GroupsV314Test-680821007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7d633637-6f8a-4cab-af97-57be6a0a8f16 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:24 devstack sudo[89971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7d633637-6f8a-4cab-af97-57be6a0a8f16
Apr 28 22:10:24 devstack sudo[89971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:25 devstack sudo[89971]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:25 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-06cc1936-c5ae-4de9-80ef-5ee340f55511 tempest-GroupsV314Test-680821007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7d633637-6f8a-4cab-af97-57be6a0a8f16" returned: 0 in 0.801s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:25 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-06cc1936-c5ae-4de9-80ef-5ee340f55511 tempest-GroupsV314Test-680821007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7d633637-6f8a-4cab-af97-57be6a0a8f16.d9a3ae0a-fdd9-4e09-b88b-118acefb4b40 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:25 devstack sudo[89982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7d633637-6f8a-4cab-af97-57be6a0a8f16.d9a3ae0a-fdd9-4e09-b88b-118acefb4b40
Apr 28 22:10:25 devstack sudo[89982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:26 devstack sudo[89982]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:26 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-06cc1936-c5ae-4de9-80ef-5ee340f55511 tempest-GroupsV314Test-680821007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7d633637-6f8a-4cab-af97-57be6a0a8f16.d9a3ae0a-fdd9-4e09-b88b-118acefb4b40" returned: 0 in 0.825s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:26 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-06cc1936-c5ae-4de9-80ef-5ee340f55511 tempest-GroupsV314Test-680821007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7d633637-6f8a-4cab-af97-57be6a0a8f16.d9a3ae0a-fdd9-4e09-b88b-118acefb4b40 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:26 devstack sudo[89987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7d633637-6f8a-4cab-af97-57be6a0a8f16.d9a3ae0a-fdd9-4e09-b88b-118acefb4b40
Apr 28 22:10:26 devstack sudo[89987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:26 devstack sudo[89987]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:26 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-06cc1936-c5ae-4de9-80ef-5ee340f55511 tempest-GroupsV314Test-680821007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7d633637-6f8a-4cab-af97-57be6a0a8f16.d9a3ae0a-fdd9-4e09-b88b-118acefb4b40" returned: 0 in 0.615s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:26 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-06cc1936-c5ae-4de9-80ef-5ee340f55511 tempest-GroupsV314Test-680821007 None] Lock "cinder-quobyte-d9a3ae0a-fdd9-4e09-b88b-118acefb4b40" released by "_delete_snapshot" :: held 3.126s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:10:26 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-06cc1936-c5ae-4de9-80ef-5ee340f55511 tempest-GroupsV314Test-680821007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.521s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:10:26 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-0aaac963-2e0b-4274-89d0-4447cc79528a tempest-VolumesListAdminTestJSON-940057122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.470s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:10:26 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-0aaac963-2e0b-4274-89d0-4447cc79528a tempest-VolumesListAdminTestJSON-940057122 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:10:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-897482252',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=275815b6-4b8a-4630-a08d-e130d9b310b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9969b80e83034685a38681cff4ca0dac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:10:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:10:11Z,use_quota=True,user_id='7aced4d0d1ca4b40bac7bc0e0e4897d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:10:26 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-0aaac963-2e0b-4274-89d0-4447cc79528a tempest-VolumesListAdminTestJSON-940057122 None] Creating volume 275815b6-4b8a-4630-a08d-e130d9b310b5 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:10:26 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-0aaac963-2e0b-4274-89d0-4447cc79528a tempest-VolumesListAdminTestJSON-940057122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:10:26 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-0aaac963-2e0b-4274-89d0-4447cc79528a tempest-VolumesListAdminTestJSON-940057122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:10:26 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-0aaac963-2e0b-4274-89d0-4447cc79528a tempest-VolumesListAdminTestJSON-940057122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:10:26 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-0aaac963-2e0b-4274-89d0-4447cc79528a tempest-VolumesListAdminTestJSON-940057122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:10:26 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-0aaac963-2e0b-4274-89d0-4447cc79528a tempest-VolumesListAdminTestJSON-940057122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:10:26 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-0aaac963-2e0b-4274-89d0-4447cc79528a tempest-VolumesListAdminTestJSON-940057122 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:10:26 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-0aaac963-2e0b-4274-89d0-4447cc79528a tempest-VolumesListAdminTestJSON-940057122 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:10:26 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-0aaac963-2e0b-4274-89d0-4447cc79528a tempest-VolumesListAdminTestJSON-940057122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-275815b6-4b8a-4630-a08d-e130d9b310b5 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:26 devstack sudo[89990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-275815b6-4b8a-4630-a08d-e130d9b310b5 1073741824
Apr 28 22:10:26 devstack sudo[89990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:27 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-06cc1936-c5ae-4de9-80ef-5ee340f55511 tempest-GroupsV314Test-680821007 None] Create group from source-group-4e470cf1-bd81-4e61-91ae-509d745fd484 completed successfully.
Apr 28 22:10:27 devstack sudo[89990]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:27 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-0aaac963-2e0b-4274-89d0-4447cc79528a tempest-VolumesListAdminTestJSON-940057122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-275815b6-4b8a-4630-a08d-e130d9b310b5 1073741824" returned: 0 in 0.913s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:27 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-0aaac963-2e0b-4274-89d0-4447cc79528a tempest-VolumesListAdminTestJSON-940057122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-275815b6-4b8a-4630-a08d-e130d9b310b5 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:27 devstack sudo[89997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-275815b6-4b8a-4630-a08d-e130d9b310b5
Apr 28 22:10:27 devstack sudo[89997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:28 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-a041e489-5912-40d8-9f95-2776697f9dc3 tempest-GroupsV314Test-680821007 None] Acquiring lock "cinder-quobyte-fea05851-5155-4d53-b7ef-9e19ab723195" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:10:28 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-a041e489-5912-40d8-9f95-2776697f9dc3 tempest-GroupsV314Test-680821007 None] Lock "cinder-quobyte-fea05851-5155-4d53-b7ef-9e19ab723195" acquired by "delete_volume" :: waited 0.021s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:10:28 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a0a408-58a3-408b-93ee-0af97e28f809]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:10:28 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a041e489-5912-40d8-9f95-2776697f9dc3 tempest-GroupsV314Test-680821007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-fea05851-5155-4d53-b7ef-9e19ab723195 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:28 devstack sudo[89999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-fea05851-5155-4d53-b7ef-9e19ab723195
Apr 28 22:10:28 devstack sudo[89999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:28 devstack sudo[89997]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:28 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-0aaac963-2e0b-4274-89d0-4447cc79528a tempest-VolumesListAdminTestJSON-940057122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-275815b6-4b8a-4630-a08d-e130d9b310b5" returned: 0 in 0.709s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:28 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-0aaac963-2e0b-4274-89d0-4447cc79528a tempest-VolumesListAdminTestJSON-940057122 None] <== create_volume: return (1681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:10:28 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-0aaac963-2e0b-4274-89d0-4447cc79528a tempest-VolumesListAdminTestJSON-940057122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.689s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:10:28 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-0aaac963-2e0b-4274-89d0-4447cc79528a tempest-VolumesListAdminTestJSON-940057122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed6ca5f1-344b-4b86-ae46-93c78206c96b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-275815b6-4b8a-4630-a08d-e130d9b310b5', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:10:28 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-0aaac963-2e0b-4274-89d0-4447cc79528a tempest-VolumesListAdminTestJSON-940057122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73a68792-ab6f-4110-be11-23efffa6bba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:10:28 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-0aaac963-2e0b-4274-89d0-4447cc79528a tempest-VolumesListAdminTestJSON-940057122 None] Volume volume-275815b6-4b8a-4630-a08d-e130d9b310b5 (275815b6-4b8a-4630-a08d-e130d9b310b5): created successfully
Apr 28 22:10:28 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-0aaac963-2e0b-4274-89d0-4447cc79528a tempest-VolumesListAdminTestJSON-940057122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73a68792-ab6f-4110-be11-23efffa6bba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:10:28 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-0aaac963-2e0b-4274-89d0-4447cc79528a tempest-VolumesListAdminTestJSON-940057122 None] Flow 'volume_create_manager' (f9ec09b0-1d24-40bb-9bc8-e08b1d55ba21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:10:28 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-0aaac963-2e0b-4274-89d0-4447cc79528a tempest-VolumesListAdminTestJSON-940057122 None] Created volume successfully.
Apr 28 22:10:29 devstack sudo[89999]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a041e489-5912-40d8-9f95-2776697f9dc3 tempest-GroupsV314Test-680821007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-fea05851-5155-4d53-b7ef-9e19ab723195" returned: 0 in 0.841s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a041e489-5912-40d8-9f95-2776697f9dc3 tempest-GroupsV314Test-680821007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-fea05851-5155-4d53-b7ef-9e19ab723195 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:29 devstack sudo[90005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-fea05851-5155-4d53-b7ef-9e19ab723195
Apr 28 22:10:29 devstack sudo[90005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:29 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-818a69f8-1bad-48bb-b25d-46ce6cadf238 tempest-VolumesListAdminTestJSON-940057122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:10:29 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-818a69f8-1bad-48bb-b25d-46ce6cadf238 tempest-VolumesListAdminTestJSON-940057122 None] Flow 'volume_create_manager' (2ecf7620-1612-46a1-8b8d-85d77b55b648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:10:29 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-818a69f8-1bad-48bb-b25d-46ce6cadf238 tempest-VolumesListAdminTestJSON-940057122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7194a1f0-e966-4a73-8afb-f63ce17fc67a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:10:29 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-818a69f8-1bad-48bb-b25d-46ce6cadf238 tempest-VolumesListAdminTestJSON-940057122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7194a1f0-e966-4a73-8afb-f63ce17fc67a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1125568539',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78e7190b-67c1-40c9-b761-d49d02caf50f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9969b80e83034685a38681cff4ca0dac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:10:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:10:29Z,use_quota=True,user_id='7aced4d0d1ca4b40bac7bc0e0e4897d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:10:29 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-818a69f8-1bad-48bb-b25d-46ce6cadf238 tempest-VolumesListAdminTestJSON-940057122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d869140d-3993-4361-95bf-8e54b301c936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:10:29 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-818a69f8-1bad-48bb-b25d-46ce6cadf238 tempest-VolumesListAdminTestJSON-940057122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d869140d-3993-4361-95bf-8e54b301c936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:10:29 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-818a69f8-1bad-48bb-b25d-46ce6cadf238 tempest-VolumesListAdminTestJSON-940057122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dc39484-8c69-476a-b6b4-889f4884c3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:10:29 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-818a69f8-1bad-48bb-b25d-46ce6cadf238 tempest-VolumesListAdminTestJSON-940057122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dc39484-8c69-476a-b6b4-889f4884c3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78e7190b-67c1-40c9-b761-d49d02caf50f', 'volume_name': 'volume-78e7190b-67c1-40c9-b761-d49d02caf50f', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:10:29 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-818a69f8-1bad-48bb-b25d-46ce6cadf238 tempest-VolumesListAdminTestJSON-940057122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38699ebe-7258-4062-938d-fd358c1a7082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:10:29 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-818a69f8-1bad-48bb-b25d-46ce6cadf238 tempest-VolumesListAdminTestJSON-940057122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38699ebe-7258-4062-938d-fd358c1a7082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:10:29 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-818a69f8-1bad-48bb-b25d-46ce6cadf238 tempest-VolumesListAdminTestJSON-940057122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f61e43da-6bf0-436f-8b3f-add0cfa3cd86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:10:29 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-818a69f8-1bad-48bb-b25d-46ce6cadf238 tempest-VolumesListAdminTestJSON-940057122 None] Volume 78e7190b-67c1-40c9-b761-d49d02caf50f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78e7190b-67c1-40c9-b761-d49d02caf50f', 'volume_size': 1}
Apr 28 22:10:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-818a69f8-1bad-48bb-b25d-46ce6cadf238 tempest-VolumesListAdminTestJSON-940057122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:10:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-818a69f8-1bad-48bb-b25d-46ce6cadf238 tempest-VolumesListAdminTestJSON-940057122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:10:29 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-818a69f8-1bad-48bb-b25d-46ce6cadf238 tempest-VolumesListAdminTestJSON-940057122 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1125568539',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78e7190b-67c1-40c9-b761-d49d02caf50f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9969b80e83034685a38681cff4ca0dac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:10:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:10:29Z,use_quota=True,user_id='7aced4d0d1ca4b40bac7bc0e0e4897d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:10:29 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-818a69f8-1bad-48bb-b25d-46ce6cadf238 tempest-VolumesListAdminTestJSON-940057122 None] Creating volume 78e7190b-67c1-40c9-b761-d49d02caf50f {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:10:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-818a69f8-1bad-48bb-b25d-46ce6cadf238 tempest-VolumesListAdminTestJSON-940057122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:10:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-818a69f8-1bad-48bb-b25d-46ce6cadf238 tempest-VolumesListAdminTestJSON-940057122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:10:29 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-818a69f8-1bad-48bb-b25d-46ce6cadf238 tempest-VolumesListAdminTestJSON-940057122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:10:29 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-818a69f8-1bad-48bb-b25d-46ce6cadf238 tempest-VolumesListAdminTestJSON-940057122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:10:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-818a69f8-1bad-48bb-b25d-46ce6cadf238 tempest-VolumesListAdminTestJSON-940057122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:10:29 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-818a69f8-1bad-48bb-b25d-46ce6cadf238 tempest-VolumesListAdminTestJSON-940057122 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:10:29 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-818a69f8-1bad-48bb-b25d-46ce6cadf238 tempest-VolumesListAdminTestJSON-940057122 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:10:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-818a69f8-1bad-48bb-b25d-46ce6cadf238 tempest-VolumesListAdminTestJSON-940057122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-78e7190b-67c1-40c9-b761-d49d02caf50f 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:29 devstack sudo[90007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-78e7190b-67c1-40c9-b761-d49d02caf50f 1073741824
Apr 28 22:10:29 devstack sudo[90007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:29 devstack sudo[90005]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a041e489-5912-40d8-9f95-2776697f9dc3 tempest-GroupsV314Test-680821007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-fea05851-5155-4d53-b7ef-9e19ab723195" returned: 0 in 0.843s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:29 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-a041e489-5912-40d8-9f95-2776697f9dc3 tempest-GroupsV314Test-680821007 None] Lock "cinder-quobyte-fea05851-5155-4d53-b7ef-9e19ab723195" released by "delete_volume" :: held 1.756s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:10:30 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-a041e489-5912-40d8-9f95-2776697f9dc3 tempest-GroupsV314Test-680821007 None] Created reservations ['b88ee93e-4c53-46ce-b5fc-1e16b7fff8e9'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:10:30 devstack cinder-volume[83924]: WARNING cinder.quota [None req-a041e489-5912-40d8-9f95-2776697f9dc3 tempest-GroupsV314Test-680821007 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1168992584 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1168992584, it is now deprecated. Please use the default quota class for default quota.
Apr 28 22:10:30 devstack cinder-volume[83924]: WARNING cinder.quota [None req-a041e489-5912-40d8-9f95-2776697f9dc3 tempest-GroupsV314Test-680821007 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1168992584 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1168992584, it is now deprecated. Please use the default quota class for default quota.
Apr 28 22:10:30 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-a041e489-5912-40d8-9f95-2776697f9dc3 tempest-GroupsV314Test-680821007 None] Created reservations ['222f1396-98a9-43a1-b95a-85f7002d97c8', '8204ab9f-cb2c-4fc6-8f82-3af95eaa05e7', 'd06abfab-1cbd-4d58-974d-d7d258cfb108', '7276b3af-5c5e-4fe6-8883-6071b8db2dd0'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:10:30 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-a041e489-5912-40d8-9f95-2776697f9dc3 tempest-GroupsV314Test-680821007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:10:30 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-a041e489-5912-40d8-9f95-2776697f9dc3 tempest-GroupsV314Test-680821007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:10:30 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-a041e489-5912-40d8-9f95-2776697f9dc3 tempest-GroupsV314Test-680821007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:10:30 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-a041e489-5912-40d8-9f95-2776697f9dc3 tempest-GroupsV314Test-680821007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:10:30 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-a041e489-5912-40d8-9f95-2776697f9dc3 tempest-GroupsV314Test-680821007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:10:30 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a041e489-5912-40d8-9f95-2776697f9dc3 tempest-GroupsV314Test-680821007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:30 devstack sudo[90010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:10:30 devstack sudo[90010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:30 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-9316b239-fe6f-4928-8d31-7628a8e6c281 tempest-GroupsV314Test-680821007 None] Acquiring lock "cinder-quobyte-7d633637-6f8a-4cab-af97-57be6a0a8f16" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:10:30 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-9316b239-fe6f-4928-8d31-7628a8e6c281 tempest-GroupsV314Test-680821007 None] Lock "cinder-quobyte-7d633637-6f8a-4cab-af97-57be6a0a8f16" acquired by "delete_volume" :: waited 0.034s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:10:30 devstack sudo[90007]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:30 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-818a69f8-1bad-48bb-b25d-46ce6cadf238 tempest-VolumesListAdminTestJSON-940057122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-78e7190b-67c1-40c9-b761-d49d02caf50f 1073741824" returned: 0 in 1.179s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:30 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[95801ab4-75f2-42d9-a991-35c2912fd13c]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:10:30 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-9316b239-fe6f-4928-8d31-7628a8e6c281 tempest-GroupsV314Test-680821007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7d633637-6f8a-4cab-af97-57be6a0a8f16 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:30 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-818a69f8-1bad-48bb-b25d-46ce6cadf238 tempest-VolumesListAdminTestJSON-940057122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-78e7190b-67c1-40c9-b761-d49d02caf50f {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:30 devstack sudo[90016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-78e7190b-67c1-40c9-b761-d49d02caf50f
Apr 28 22:10:30 devstack sudo[90016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:31 devstack sudo[90015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7d633637-6f8a-4cab-af97-57be6a0a8f16
Apr 28 22:10:31 devstack sudo[90015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:31 devstack sudo[90010]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a041e489-5912-40d8-9f95-2776697f9dc3 tempest-GroupsV314Test-680821007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.889s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:31 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-a041e489-5912-40d8-9f95-2776697f9dc3 tempest-GroupsV314Test-680821007 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:10:31 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-a041e489-5912-40d8-9f95-2776697f9dc3 tempest-GroupsV314Test-680821007 None] Delete group completed successfully.
Apr 28 22:10:31 devstack sudo[90015]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-9316b239-fe6f-4928-8d31-7628a8e6c281 tempest-GroupsV314Test-680821007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7d633637-6f8a-4cab-af97-57be6a0a8f16" returned: 0 in 1.005s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-9316b239-fe6f-4928-8d31-7628a8e6c281 tempest-GroupsV314Test-680821007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7d633637-6f8a-4cab-af97-57be6a0a8f16 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:31 devstack sudo[90016]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-818a69f8-1bad-48bb-b25d-46ce6cadf238 tempest-VolumesListAdminTestJSON-940057122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-78e7190b-67c1-40c9-b761-d49d02caf50f" returned: 0 in 0.960s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:31 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-818a69f8-1bad-48bb-b25d-46ce6cadf238 tempest-VolumesListAdminTestJSON-940057122 None] <== create_volume: return (2225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:10:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-818a69f8-1bad-48bb-b25d-46ce6cadf238 tempest-VolumesListAdminTestJSON-940057122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.228s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:10:31 devstack sudo[90024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7d633637-6f8a-4cab-af97-57be6a0a8f16
Apr 28 22:10:31 devstack sudo[90024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:31 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-818a69f8-1bad-48bb-b25d-46ce6cadf238 tempest-VolumesListAdminTestJSON-940057122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f61e43da-6bf0-436f-8b3f-add0cfa3cd86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78e7190b-67c1-40c9-b761-d49d02caf50f', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:10:31 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-818a69f8-1bad-48bb-b25d-46ce6cadf238 tempest-VolumesListAdminTestJSON-940057122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd2e29c8-0024-4031-9ce8-d675e6d6907f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:10:31 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-818a69f8-1bad-48bb-b25d-46ce6cadf238 tempest-VolumesListAdminTestJSON-940057122 None] Volume volume-78e7190b-67c1-40c9-b761-d49d02caf50f (78e7190b-67c1-40c9-b761-d49d02caf50f): created successfully
Apr 28 22:10:31 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-818a69f8-1bad-48bb-b25d-46ce6cadf238 tempest-VolumesListAdminTestJSON-940057122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd2e29c8-0024-4031-9ce8-d675e6d6907f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:10:31 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-818a69f8-1bad-48bb-b25d-46ce6cadf238 tempest-VolumesListAdminTestJSON-940057122 None] Flow 'volume_create_manager' (2ecf7620-1612-46a1-8b8d-85d77b55b648) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:10:31 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-818a69f8-1bad-48bb-b25d-46ce6cadf238 tempest-VolumesListAdminTestJSON-940057122 None] Created volume successfully.
Apr 28 22:10:32 devstack sudo[90024]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:32 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-9316b239-fe6f-4928-8d31-7628a8e6c281 tempest-GroupsV314Test-680821007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7d633637-6f8a-4cab-af97-57be6a0a8f16" returned: 0 in 0.625s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:32 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-9316b239-fe6f-4928-8d31-7628a8e6c281 tempest-GroupsV314Test-680821007 None] Lock "cinder-quobyte-7d633637-6f8a-4cab-af97-57be6a0a8f16" released by "delete_volume" :: held 1.710s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:10:32 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-9316b239-fe6f-4928-8d31-7628a8e6c281 tempest-GroupsV314Test-680821007 None] Created reservations ['3d535b82-ad7f-40ac-83bf-9bb117a9bc95'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:10:32 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-9316b239-fe6f-4928-8d31-7628a8e6c281 tempest-GroupsV314Test-680821007 None] Created reservations ['4a762629-a585-4d2f-a2ae-f871652c741c', '42d5fcee-46eb-4649-900a-3108179abb55', '16ccbe0e-0872-4675-a757-6ceed98ef1cc', 'cedfd6a8-149e-401c-a315-57b6936662a8'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:10:32 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-9316b239-fe6f-4928-8d31-7628a8e6c281 tempest-GroupsV314Test-680821007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:10:32 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-9316b239-fe6f-4928-8d31-7628a8e6c281 tempest-GroupsV314Test-680821007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:10:32 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-9316b239-fe6f-4928-8d31-7628a8e6c281 tempest-GroupsV314Test-680821007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:10:32 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-9316b239-fe6f-4928-8d31-7628a8e6c281 tempest-GroupsV314Test-680821007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:10:32 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-9316b239-fe6f-4928-8d31-7628a8e6c281 tempest-GroupsV314Test-680821007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:10:32 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-9316b239-fe6f-4928-8d31-7628a8e6c281 tempest-GroupsV314Test-680821007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:32 devstack sudo[90028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:10:32 devstack sudo[90028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:33 devstack sudo[90028]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:33 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-9316b239-fe6f-4928-8d31-7628a8e6c281 tempest-GroupsV314Test-680821007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.795s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:33 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-9316b239-fe6f-4928-8d31-7628a8e6c281 tempest-GroupsV314Test-680821007 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:10:33 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-9316b239-fe6f-4928-8d31-7628a8e6c281 tempest-GroupsV314Test-680821007 None] Delete group completed successfully.
Apr 28 22:10:33 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-de1e097e-acc3-4987-96a9-43474c5abc36 tempest-VolumesListAdminTestJSON-2035482929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:10:33 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-de1e097e-acc3-4987-96a9-43474c5abc36 tempest-VolumesListAdminTestJSON-2035482929 None] Flow 'volume_create_manager' (9c97fdc9-3e51-46a3-89ad-779d58e8f2e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:10:33 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-de1e097e-acc3-4987-96a9-43474c5abc36 tempest-VolumesListAdminTestJSON-2035482929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbeea77b-7ef5-4b3b-a8d3-8859001e698e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:10:33 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-de1e097e-acc3-4987-96a9-43474c5abc36 tempest-VolumesListAdminTestJSON-2035482929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbeea77b-7ef5-4b3b-a8d3-8859001e698e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:10:33Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3750c915-43b7-44b5-86e0-6706ceedae79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aca66771cb0b40b3b2b69592bf40151f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:10:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:10:34Z,use_quota=True,user_id='616fc4d76232445b9e23205f969b7bb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:10:33 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-de1e097e-acc3-4987-96a9-43474c5abc36 tempest-VolumesListAdminTestJSON-2035482929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06ff3b99-86ea-4707-8a71-62b40d6a24f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:10:33 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-de1e097e-acc3-4987-96a9-43474c5abc36 tempest-VolumesListAdminTestJSON-2035482929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06ff3b99-86ea-4707-8a71-62b40d6a24f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:10:33 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-de1e097e-acc3-4987-96a9-43474c5abc36 tempest-VolumesListAdminTestJSON-2035482929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (743b5105-0598-4bd4-add7-f0b82a97a3bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:10:33 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-de1e097e-acc3-4987-96a9-43474c5abc36 tempest-VolumesListAdminTestJSON-2035482929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (743b5105-0598-4bd4-add7-f0b82a97a3bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3750c915-43b7-44b5-86e0-6706ceedae79', 'volume_name': 'volume-3750c915-43b7-44b5-86e0-6706ceedae79', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:10:33 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-de1e097e-acc3-4987-96a9-43474c5abc36 tempest-VolumesListAdminTestJSON-2035482929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc8cfc44-b2f2-48bc-8382-d1d4e1287f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:10:33 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-de1e097e-acc3-4987-96a9-43474c5abc36 tempest-VolumesListAdminTestJSON-2035482929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc8cfc44-b2f2-48bc-8382-d1d4e1287f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:10:33 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-de1e097e-acc3-4987-96a9-43474c5abc36 tempest-VolumesListAdminTestJSON-2035482929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1c5fbda-510f-46e4-841a-407774b1cfc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:10:33 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-de1e097e-acc3-4987-96a9-43474c5abc36 tempest-VolumesListAdminTestJSON-2035482929 None] Volume 3750c915-43b7-44b5-86e0-6706ceedae79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3750c915-43b7-44b5-86e0-6706ceedae79', 'volume_size': 1}
Apr 28 22:10:33 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-de1e097e-acc3-4987-96a9-43474c5abc36 tempest-VolumesListAdminTestJSON-2035482929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:10:33 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-de1e097e-acc3-4987-96a9-43474c5abc36 tempest-VolumesListAdminTestJSON-2035482929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:10:33 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-de1e097e-acc3-4987-96a9-43474c5abc36 tempest-VolumesListAdminTestJSON-2035482929 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:10:33Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3750c915-43b7-44b5-86e0-6706ceedae79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aca66771cb0b40b3b2b69592bf40151f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:10:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:10:34Z,use_quota=True,user_id='616fc4d76232445b9e23205f969b7bb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:10:33 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-de1e097e-acc3-4987-96a9-43474c5abc36 tempest-VolumesListAdminTestJSON-2035482929 None] Creating volume 3750c915-43b7-44b5-86e0-6706ceedae79 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:10:33 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-de1e097e-acc3-4987-96a9-43474c5abc36 tempest-VolumesListAdminTestJSON-2035482929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:10:33 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-de1e097e-acc3-4987-96a9-43474c5abc36 tempest-VolumesListAdminTestJSON-2035482929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:10:33 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-de1e097e-acc3-4987-96a9-43474c5abc36 tempest-VolumesListAdminTestJSON-2035482929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:10:33 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-de1e097e-acc3-4987-96a9-43474c5abc36 tempest-VolumesListAdminTestJSON-2035482929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:10:33 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-de1e097e-acc3-4987-96a9-43474c5abc36 tempest-VolumesListAdminTestJSON-2035482929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:10:33 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-de1e097e-acc3-4987-96a9-43474c5abc36 tempest-VolumesListAdminTestJSON-2035482929 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:10:33 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-de1e097e-acc3-4987-96a9-43474c5abc36 tempest-VolumesListAdminTestJSON-2035482929 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:10:33 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-de1e097e-acc3-4987-96a9-43474c5abc36 tempest-VolumesListAdminTestJSON-2035482929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3750c915-43b7-44b5-86e0-6706ceedae79 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:33 devstack sudo[90032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3750c915-43b7-44b5-86e0-6706ceedae79 1073741824
Apr 28 22:10:33 devstack sudo[90032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:34 devstack sudo[90032]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:34 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-de1e097e-acc3-4987-96a9-43474c5abc36 tempest-VolumesListAdminTestJSON-2035482929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3750c915-43b7-44b5-86e0-6706ceedae79 1073741824" returned: 0 in 1.035s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:35 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-de1e097e-acc3-4987-96a9-43474c5abc36 tempest-VolumesListAdminTestJSON-2035482929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3750c915-43b7-44b5-86e0-6706ceedae79 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:35 devstack sudo[90040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3750c915-43b7-44b5-86e0-6706ceedae79
Apr 28 22:10:35 devstack sudo[90040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:35 devstack sudo[90040]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:35 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-de1e097e-acc3-4987-96a9-43474c5abc36 tempest-VolumesListAdminTestJSON-2035482929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3750c915-43b7-44b5-86e0-6706ceedae79" returned: 0 in 0.686s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:35 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-de1e097e-acc3-4987-96a9-43474c5abc36 tempest-VolumesListAdminTestJSON-2035482929 None] <== create_volume: return (1794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:10:35 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-de1e097e-acc3-4987-96a9-43474c5abc36 tempest-VolumesListAdminTestJSON-2035482929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.796s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:10:35 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-de1e097e-acc3-4987-96a9-43474c5abc36 tempest-VolumesListAdminTestJSON-2035482929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1c5fbda-510f-46e4-841a-407774b1cfc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3750c915-43b7-44b5-86e0-6706ceedae79', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:10:35 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-de1e097e-acc3-4987-96a9-43474c5abc36 tempest-VolumesListAdminTestJSON-2035482929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07c49af3-2397-49fb-891c-54879a880954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:10:35 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-de1e097e-acc3-4987-96a9-43474c5abc36 tempest-VolumesListAdminTestJSON-2035482929 None] Volume volume-3750c915-43b7-44b5-86e0-6706ceedae79 (3750c915-43b7-44b5-86e0-6706ceedae79): created successfully
Apr 28 22:10:35 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-de1e097e-acc3-4987-96a9-43474c5abc36 tempest-VolumesListAdminTestJSON-2035482929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07c49af3-2397-49fb-891c-54879a880954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:10:35 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-de1e097e-acc3-4987-96a9-43474c5abc36 tempest-VolumesListAdminTestJSON-2035482929 None] Flow 'volume_create_manager' (9c97fdc9-3e51-46a3-89ad-779d58e8f2e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:10:35 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-de1e097e-acc3-4987-96a9-43474c5abc36 tempest-VolumesListAdminTestJSON-2035482929 None] Created volume successfully.
Apr 28 22:10:36 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-3c7e6840-f9e2-40b5-985e-dc23e1326032 tempest-VolumesListAdminTestJSON-2035482929 None] Acquiring lock "cinder-3750c915-43b7-44b5-86e0-6706ceedae79-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:10:36 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-3c7e6840-f9e2-40b5-985e-dc23e1326032 tempest-VolumesListAdminTestJSON-2035482929 None] Lock "cinder-3750c915-43b7-44b5-86e0-6706ceedae79-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:10:36 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-3c7e6840-f9e2-40b5-985e-dc23e1326032 tempest-VolumesListAdminTestJSON-2035482929 None] Acquiring lock "cinder-quobyte-3750c915-43b7-44b5-86e0-6706ceedae79" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:10:36 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-3c7e6840-f9e2-40b5-985e-dc23e1326032 tempest-VolumesListAdminTestJSON-2035482929 None] Lock "cinder-quobyte-3750c915-43b7-44b5-86e0-6706ceedae79" acquired by "delete_volume" :: waited 0.032s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:10:36 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[961a8e79-74ce-43c6-8726-203584c55482]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:10:36 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-3c7e6840-f9e2-40b5-985e-dc23e1326032 tempest-VolumesListAdminTestJSON-2035482929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3750c915-43b7-44b5-86e0-6706ceedae79 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:36 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-6531b0cb-0516-4221-a6b5-5a035c05e79a tempest-VolumesListAdminTestJSON-940057122 None] Acquiring lock "cinder-78e7190b-67c1-40c9-b761-d49d02caf50f-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:10:36 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-6531b0cb-0516-4221-a6b5-5a035c05e79a tempest-VolumesListAdminTestJSON-940057122 None] Lock "cinder-78e7190b-67c1-40c9-b761-d49d02caf50f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:10:36 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-6531b0cb-0516-4221-a6b5-5a035c05e79a tempest-VolumesListAdminTestJSON-940057122 None] Acquiring lock "cinder-quobyte-78e7190b-67c1-40c9-b761-d49d02caf50f" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:10:36 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-6531b0cb-0516-4221-a6b5-5a035c05e79a tempest-VolumesListAdminTestJSON-940057122 None] Lock "cinder-quobyte-78e7190b-67c1-40c9-b761-d49d02caf50f" acquired by "delete_volume" :: waited 0.021s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:10:36 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf85532f-b4bf-4f91-9c10-7e8a97f39656]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:10:36 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-6531b0cb-0516-4221-a6b5-5a035c05e79a tempest-VolumesListAdminTestJSON-940057122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-78e7190b-67c1-40c9-b761-d49d02caf50f {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:36 devstack sudo[90043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3750c915-43b7-44b5-86e0-6706ceedae79
Apr 28 22:10:36 devstack sudo[90043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:36 devstack sudo[90044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-78e7190b-67c1-40c9-b761-d49d02caf50f
Apr 28 22:10:36 devstack sudo[90044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:37 devstack sudo[90043]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:37 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-3c7e6840-f9e2-40b5-985e-dc23e1326032 tempest-VolumesListAdminTestJSON-2035482929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3750c915-43b7-44b5-86e0-6706ceedae79" returned: 0 in 1.083s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:37 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-3c7e6840-f9e2-40b5-985e-dc23e1326032 tempest-VolumesListAdminTestJSON-2035482929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3750c915-43b7-44b5-86e0-6706ceedae79 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:37 devstack sudo[90044]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:37 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-6531b0cb-0516-4221-a6b5-5a035c05e79a tempest-VolumesListAdminTestJSON-940057122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-78e7190b-67c1-40c9-b761-d49d02caf50f" returned: 0 in 0.950s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:37 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-6531b0cb-0516-4221-a6b5-5a035c05e79a tempest-VolumesListAdminTestJSON-940057122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-78e7190b-67c1-40c9-b761-d49d02caf50f {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:37 devstack sudo[90053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3750c915-43b7-44b5-86e0-6706ceedae79
Apr 28 22:10:37 devstack sudo[90053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:37 devstack sudo[90055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-78e7190b-67c1-40c9-b761-d49d02caf50f
Apr 28 22:10:37 devstack sudo[90055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:38 devstack sudo[90055]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:38 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-6531b0cb-0516-4221-a6b5-5a035c05e79a tempest-VolumesListAdminTestJSON-940057122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-78e7190b-67c1-40c9-b761-d49d02caf50f" returned: 0 in 0.711s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:38 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-6531b0cb-0516-4221-a6b5-5a035c05e79a tempest-VolumesListAdminTestJSON-940057122 None] Lock "cinder-quobyte-78e7190b-67c1-40c9-b761-d49d02caf50f" released by "delete_volume" :: held 1.730s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:10:38 devstack sudo[90053]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:38 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-3c7e6840-f9e2-40b5-985e-dc23e1326032 tempest-VolumesListAdminTestJSON-2035482929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3750c915-43b7-44b5-86e0-6706ceedae79" returned: 0 in 0.784s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:38 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-3c7e6840-f9e2-40b5-985e-dc23e1326032 tempest-VolumesListAdminTestJSON-2035482929 None] Lock "cinder-quobyte-3750c915-43b7-44b5-86e0-6706ceedae79" released by "delete_volume" :: held 1.938s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:10:38 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-6531b0cb-0516-4221-a6b5-5a035c05e79a tempest-VolumesListAdminTestJSON-940057122 None] Created reservations ['c4ab5f6f-135a-4bef-b8fb-255ecaf5878e', 'cf9121d2-9668-42ea-ace2-5d5960976169', 'c2cb763c-3cdb-4302-8011-80643d626d41', '6e01674f-5c28-4f18-b83d-4758613dec8c'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:10:38 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-3c7e6840-f9e2-40b5-985e-dc23e1326032 tempest-VolumesListAdminTestJSON-2035482929 None] Created reservations ['6f93ff4d-5625-4012-a297-4a5759ed8bbf', '067a68bd-7b8a-4cca-ad74-233907445861', 'f509adb0-348b-4483-aa78-e98265b1f7a8', '03d212d7-0eca-4b11-8456-aa0382b41d79'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:10:38 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-6531b0cb-0516-4221-a6b5-5a035c05e79a tempest-VolumesListAdminTestJSON-940057122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:10:38 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-6531b0cb-0516-4221-a6b5-5a035c05e79a tempest-VolumesListAdminTestJSON-940057122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:10:38 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-6531b0cb-0516-4221-a6b5-5a035c05e79a tempest-VolumesListAdminTestJSON-940057122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:10:38 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-6531b0cb-0516-4221-a6b5-5a035c05e79a tempest-VolumesListAdminTestJSON-940057122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:10:38 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-6531b0cb-0516-4221-a6b5-5a035c05e79a tempest-VolumesListAdminTestJSON-940057122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:10:38 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-6531b0cb-0516-4221-a6b5-5a035c05e79a tempest-VolumesListAdminTestJSON-940057122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:38 devstack sudo[90059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:10:38 devstack sudo[90059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:38 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-3c7e6840-f9e2-40b5-985e-dc23e1326032 tempest-VolumesListAdminTestJSON-2035482929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:10:38 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-3c7e6840-f9e2-40b5-985e-dc23e1326032 tempest-VolumesListAdminTestJSON-2035482929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:10:38 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-3c7e6840-f9e2-40b5-985e-dc23e1326032 tempest-VolumesListAdminTestJSON-2035482929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:10:38 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-3c7e6840-f9e2-40b5-985e-dc23e1326032 tempest-VolumesListAdminTestJSON-2035482929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:10:38 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-3c7e6840-f9e2-40b5-985e-dc23e1326032 tempest-VolumesListAdminTestJSON-2035482929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:10:38 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-3c7e6840-f9e2-40b5-985e-dc23e1326032 tempest-VolumesListAdminTestJSON-2035482929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:38 devstack sudo[90061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:10:38 devstack sudo[90061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:38 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-09014a0b-1bc4-4053-98fb-d16d837034d9 tempest-VolumesListAdminTestJSON-940057122 None] Acquiring lock "cinder-275815b6-4b8a-4630-a08d-e130d9b310b5-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:10:38 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-09014a0b-1bc4-4053-98fb-d16d837034d9 tempest-VolumesListAdminTestJSON-940057122 None] Lock "cinder-275815b6-4b8a-4630-a08d-e130d9b310b5-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:10:38 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-09014a0b-1bc4-4053-98fb-d16d837034d9 tempest-VolumesListAdminTestJSON-940057122 None] Acquiring lock "cinder-quobyte-275815b6-4b8a-4630-a08d-e130d9b310b5" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:10:38 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-09014a0b-1bc4-4053-98fb-d16d837034d9 tempest-VolumesListAdminTestJSON-940057122 None] Lock "cinder-quobyte-275815b6-4b8a-4630-a08d-e130d9b310b5" acquired by "delete_volume" :: waited 0.023s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:10:39 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d62da2c6-f891-49b4-8b0c-9bd5a84d9abc]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:10:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-09014a0b-1bc4-4053-98fb-d16d837034d9 tempest-VolumesListAdminTestJSON-940057122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-275815b6-4b8a-4630-a08d-e130d9b310b5 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:39 devstack sudo[90063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-275815b6-4b8a-4630-a08d-e130d9b310b5
Apr 28 22:10:39 devstack sudo[90063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:39 devstack sudo[90059]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-6531b0cb-0516-4221-a6b5-5a035c05e79a tempest-VolumesListAdminTestJSON-940057122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 1.018s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:39 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-6531b0cb-0516-4221-a6b5-5a035c05e79a tempest-VolumesListAdminTestJSON-940057122 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:10:39 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-6531b0cb-0516-4221-a6b5-5a035c05e79a tempest-VolumesListAdminTestJSON-940057122 None] Deleted volume successfully.
Apr 28 22:10:39 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-6531b0cb-0516-4221-a6b5-5a035c05e79a tempest-VolumesListAdminTestJSON-940057122 None] Lock "cinder-78e7190b-67c1-40c9-b761-d49d02caf50f-delete_volume" released by "delete_volume" :: held 3.086s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:10:39 devstack sudo[90061]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-3c7e6840-f9e2-40b5-985e-dc23e1326032 tempest-VolumesListAdminTestJSON-2035482929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 1.263s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:39 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-3c7e6840-f9e2-40b5-985e-dc23e1326032 tempest-VolumesListAdminTestJSON-2035482929 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:10:39 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-3c7e6840-f9e2-40b5-985e-dc23e1326032 tempest-VolumesListAdminTestJSON-2035482929 None] Deleted volume successfully.
Apr 28 22:10:39 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-3c7e6840-f9e2-40b5-985e-dc23e1326032 tempest-VolumesListAdminTestJSON-2035482929 None] Lock "cinder-3750c915-43b7-44b5-86e0-6706ceedae79-delete_volume" released by "delete_volume" :: held 3.568s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:10:39 devstack cinder-volume[83924]: DEBUG oslo_service.periodic_task [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83924) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 28 22:10:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:10:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:10:39 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:10:39 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:10:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:10:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:39 devstack sudo[90067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:10:39 devstack sudo[90067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:39 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-48a0f811-1402-4517-94f8-7c7e451051b7 tempest-SnapshotsActionsTest-285904011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:10:39 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-48a0f811-1402-4517-94f8-7c7e451051b7 tempest-SnapshotsActionsTest-285904011 None] Flow 'volume_create_manager' (236691aa-03e1-4bdd-a380-b0b8ee78a991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:10:40 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-48a0f811-1402-4517-94f8-7c7e451051b7 tempest-SnapshotsActionsTest-285904011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (948ade30-7d4e-4731-97ce-9e4a651e2133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:10:40 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-48a0f811-1402-4517-94f8-7c7e451051b7 tempest-SnapshotsActionsTest-285904011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (948ade30-7d4e-4731-97ce-9e4a651e2133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:10:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1082916320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=623c783b-a15c-45e5-a63a-1ff893a60ad9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a5d1e18076f4ce5a83a64a26c1896f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:10:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:10:40Z,use_quota=True,user_id='58bdad7fb2484267a2d0019c06d85a37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:10:40 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-48a0f811-1402-4517-94f8-7c7e451051b7 tempest-SnapshotsActionsTest-285904011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e8fbbb9-324b-4628-a48c-3507c9ad13e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:10:40 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-48a0f811-1402-4517-94f8-7c7e451051b7 tempest-SnapshotsActionsTest-285904011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e8fbbb9-324b-4628-a48c-3507c9ad13e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:10:40 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-48a0f811-1402-4517-94f8-7c7e451051b7 tempest-SnapshotsActionsTest-285904011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d080147d-57c9-46c3-b9b2-6f510556c75e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:10:40 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-48a0f811-1402-4517-94f8-7c7e451051b7 tempest-SnapshotsActionsTest-285904011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d080147d-57c9-46c3-b9b2-6f510556c75e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '623c783b-a15c-45e5-a63a-1ff893a60ad9', 'volume_name': 'volume-623c783b-a15c-45e5-a63a-1ff893a60ad9', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:10:40 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-48a0f811-1402-4517-94f8-7c7e451051b7 tempest-SnapshotsActionsTest-285904011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d271e235-4b88-44a6-aa74-84e7fc5faddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:10:40 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-48a0f811-1402-4517-94f8-7c7e451051b7 tempest-SnapshotsActionsTest-285904011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d271e235-4b88-44a6-aa74-84e7fc5faddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:10:40 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-48a0f811-1402-4517-94f8-7c7e451051b7 tempest-SnapshotsActionsTest-285904011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (662f9e80-e832-4678-8d97-da8fff14e86c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:10:40 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-48a0f811-1402-4517-94f8-7c7e451051b7 tempest-SnapshotsActionsTest-285904011 None] Volume 623c783b-a15c-45e5-a63a-1ff893a60ad9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-623c783b-a15c-45e5-a63a-1ff893a60ad9', 'volume_size': 1}
Apr 28 22:10:40 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-48a0f811-1402-4517-94f8-7c7e451051b7 tempest-SnapshotsActionsTest-285904011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:10:40 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-48a0f811-1402-4517-94f8-7c7e451051b7 tempest-SnapshotsActionsTest-285904011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:10:40 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-48a0f811-1402-4517-94f8-7c7e451051b7 tempest-SnapshotsActionsTest-285904011 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:10:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1082916320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=623c783b-a15c-45e5-a63a-1ff893a60ad9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a5d1e18076f4ce5a83a64a26c1896f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:10:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:10:40Z,use_quota=True,user_id='58bdad7fb2484267a2d0019c06d85a37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:10:40 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-48a0f811-1402-4517-94f8-7c7e451051b7 tempest-SnapshotsActionsTest-285904011 None] Creating volume 623c783b-a15c-45e5-a63a-1ff893a60ad9 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:10:40 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-48a0f811-1402-4517-94f8-7c7e451051b7 tempest-SnapshotsActionsTest-285904011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:10:40 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-48a0f811-1402-4517-94f8-7c7e451051b7 tempest-SnapshotsActionsTest-285904011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:10:40 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-48a0f811-1402-4517-94f8-7c7e451051b7 tempest-SnapshotsActionsTest-285904011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:10:40 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-48a0f811-1402-4517-94f8-7c7e451051b7 tempest-SnapshotsActionsTest-285904011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:10:40 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-48a0f811-1402-4517-94f8-7c7e451051b7 tempest-SnapshotsActionsTest-285904011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:10:40 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-48a0f811-1402-4517-94f8-7c7e451051b7 tempest-SnapshotsActionsTest-285904011 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:10:40 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-48a0f811-1402-4517-94f8-7c7e451051b7 tempest-SnapshotsActionsTest-285904011 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:10:40 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-48a0f811-1402-4517-94f8-7c7e451051b7 tempest-SnapshotsActionsTest-285904011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:40 devstack sudo[90072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9 1073741824
Apr 28 22:10:40 devstack sudo[90072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:40 devstack sudo[90063]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:40 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-09014a0b-1bc4-4053-98fb-d16d837034d9 tempest-VolumesListAdminTestJSON-940057122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-275815b6-4b8a-4630-a08d-e130d9b310b5" returned: 0 in 1.170s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:40 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-09014a0b-1bc4-4053-98fb-d16d837034d9 tempest-VolumesListAdminTestJSON-940057122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-275815b6-4b8a-4630-a08d-e130d9b310b5 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:40 devstack sudo[90074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-275815b6-4b8a-4630-a08d-e130d9b310b5
Apr 28 22:10:40 devstack sudo[90074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:40 devstack sudo[90067]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:40 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.770s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:40 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:10:40 devstack sudo[90074]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:40 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-09014a0b-1bc4-4053-98fb-d16d837034d9 tempest-VolumesListAdminTestJSON-940057122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-275815b6-4b8a-4630-a08d-e130d9b310b5" returned: 0 in 0.678s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:40 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-09014a0b-1bc4-4053-98fb-d16d837034d9 tempest-VolumesListAdminTestJSON-940057122 None] Lock "cinder-quobyte-275815b6-4b8a-4630-a08d-e130d9b310b5" released by "delete_volume" :: held 2.010s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:10:40 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-09014a0b-1bc4-4053-98fb-d16d837034d9 tempest-VolumesListAdminTestJSON-940057122 None] Created reservations ['63d2c580-0e90-4b0d-872c-67389870720a', 'd85d58a6-36da-44c6-888c-f97314b0d549', '342a66a8-f9a2-4353-90e2-27cfcd335230', 'fce37e0b-a66a-4629-9f3e-7d19515cf41c'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:10:41 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-09014a0b-1bc4-4053-98fb-d16d837034d9 tempest-VolumesListAdminTestJSON-940057122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:10:41 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-09014a0b-1bc4-4053-98fb-d16d837034d9 tempest-VolumesListAdminTestJSON-940057122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:10:41 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-09014a0b-1bc4-4053-98fb-d16d837034d9 tempest-VolumesListAdminTestJSON-940057122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:10:41 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-09014a0b-1bc4-4053-98fb-d16d837034d9 tempest-VolumesListAdminTestJSON-940057122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:10:41 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-09014a0b-1bc4-4053-98fb-d16d837034d9 tempest-VolumesListAdminTestJSON-940057122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:10:41 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-09014a0b-1bc4-4053-98fb-d16d837034d9 tempest-VolumesListAdminTestJSON-940057122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:41 devstack sudo[90082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:10:41 devstack sudo[90082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:41 devstack sudo[90072]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:41 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-48a0f811-1402-4517-94f8-7c7e451051b7 tempest-SnapshotsActionsTest-285904011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9 1073741824" returned: 0 in 0.989s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:41 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-48a0f811-1402-4517-94f8-7c7e451051b7 tempest-SnapshotsActionsTest-285904011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:41 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-620fd767-bf50-42ff-a74a-90e438bd20bd tempest-VolumesListAdminTestJSON-940057122 None] Acquiring lock "cinder-b8b5a067-fb24-43e9-ae52-cfdbef2f75e9-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:10:41 devstack sudo[90085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9
Apr 28 22:10:41 devstack sudo[90085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:41 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-620fd767-bf50-42ff-a74a-90e438bd20bd tempest-VolumesListAdminTestJSON-940057122 None] Lock "cinder-b8b5a067-fb24-43e9-ae52-cfdbef2f75e9-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:10:41 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-620fd767-bf50-42ff-a74a-90e438bd20bd tempest-VolumesListAdminTestJSON-940057122 None] Acquiring lock "cinder-quobyte-b8b5a067-fb24-43e9-ae52-cfdbef2f75e9" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:10:41 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-620fd767-bf50-42ff-a74a-90e438bd20bd tempest-VolumesListAdminTestJSON-940057122 None] Lock "cinder-quobyte-b8b5a067-fb24-43e9-ae52-cfdbef2f75e9" acquired by "delete_volume" :: waited 0.033s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:10:41 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[756c01bc-2c21-4cdd-a6a4-4b5532ce7e9f]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:10:41 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-620fd767-bf50-42ff-a74a-90e438bd20bd tempest-VolumesListAdminTestJSON-940057122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b8b5a067-fb24-43e9-ae52-cfdbef2f75e9 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:41 devstack sudo[90087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b8b5a067-fb24-43e9-ae52-cfdbef2f75e9
Apr 28 22:10:41 devstack sudo[90087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:41 devstack sudo[90082]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:41 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-09014a0b-1bc4-4053-98fb-d16d837034d9 tempest-VolumesListAdminTestJSON-940057122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.743s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:41 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-09014a0b-1bc4-4053-98fb-d16d837034d9 tempest-VolumesListAdminTestJSON-940057122 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:10:41 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-09014a0b-1bc4-4053-98fb-d16d837034d9 tempest-VolumesListAdminTestJSON-940057122 None] Deleted volume successfully.
Apr 28 22:10:41 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-09014a0b-1bc4-4053-98fb-d16d837034d9 tempest-VolumesListAdminTestJSON-940057122 None] Lock "cinder-275815b6-4b8a-4630-a08d-e130d9b310b5-delete_volume" released by "delete_volume" :: held 3.056s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:10:42 devstack sudo[90085]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:42 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-48a0f811-1402-4517-94f8-7c7e451051b7 tempest-SnapshotsActionsTest-285904011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9" returned: 0 in 0.910s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:42 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-48a0f811-1402-4517-94f8-7c7e451051b7 tempest-SnapshotsActionsTest-285904011 None] <== create_volume: return (1977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:10:42 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-48a0f811-1402-4517-94f8-7c7e451051b7 tempest-SnapshotsActionsTest-285904011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.981s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:10:42 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-48a0f811-1402-4517-94f8-7c7e451051b7 tempest-SnapshotsActionsTest-285904011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (662f9e80-e832-4678-8d97-da8fff14e86c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-623c783b-a15c-45e5-a63a-1ff893a60ad9', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:10:42 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-48a0f811-1402-4517-94f8-7c7e451051b7 tempest-SnapshotsActionsTest-285904011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62bd4d71-2f75-433e-96f2-3980f1a00eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:10:42 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-48a0f811-1402-4517-94f8-7c7e451051b7 tempest-SnapshotsActionsTest-285904011 None] Volume volume-623c783b-a15c-45e5-a63a-1ff893a60ad9 (623c783b-a15c-45e5-a63a-1ff893a60ad9): created successfully
Apr 28 22:10:42 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-48a0f811-1402-4517-94f8-7c7e451051b7 tempest-SnapshotsActionsTest-285904011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62bd4d71-2f75-433e-96f2-3980f1a00eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:10:42 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-48a0f811-1402-4517-94f8-7c7e451051b7 tempest-SnapshotsActionsTest-285904011 None] Flow 'volume_create_manager' (236691aa-03e1-4bdd-a380-b0b8ee78a991) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:10:42 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-48a0f811-1402-4517-94f8-7c7e451051b7 tempest-SnapshotsActionsTest-285904011 None] Created volume successfully.
Apr 28 22:10:42 devstack sudo[90087]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:42 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-620fd767-bf50-42ff-a74a-90e438bd20bd tempest-VolumesListAdminTestJSON-940057122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b8b5a067-fb24-43e9-ae52-cfdbef2f75e9" returned: 0 in 0.859s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:42 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-620fd767-bf50-42ff-a74a-90e438bd20bd tempest-VolumesListAdminTestJSON-940057122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b8b5a067-fb24-43e9-ae52-cfdbef2f75e9 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:42 devstack sudo[90094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b8b5a067-fb24-43e9-ae52-cfdbef2f75e9
Apr 28 22:10:42 devstack sudo[90094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:42 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-e1dd8fe3-babe-4a93-bd77-893cd68ac94c tempest-SnapshotsActionsTest-285904011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:10:42 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-e1dd8fe3-babe-4a93-bd77-893cd68ac94c tempest-SnapshotsActionsTest-285904011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:10:42 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-e1dd8fe3-babe-4a93-bd77-893cd68ac94c tempest-SnapshotsActionsTest-285904011 None] Creating offline snapshot 1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9 of volume 623c783b-a15c-45e5-a63a-1ff893a60ad9 {{(pid=83924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 22:10:42 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d307eb9b-90ed-4e21-8152-6ea1b9e30cba]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:10:42 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e1dd8fe3-babe-4a93-bd77-893cd68ac94c tempest-SnapshotsActionsTest-285904011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:42 devstack sudo[90096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9
Apr 28 22:10:42 devstack sudo[90096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:42 devstack sudo[90094]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:42 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-620fd767-bf50-42ff-a74a-90e438bd20bd tempest-VolumesListAdminTestJSON-940057122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b8b5a067-fb24-43e9-ae52-cfdbef2f75e9" returned: 0 in 0.744s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:43 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-620fd767-bf50-42ff-a74a-90e438bd20bd tempest-VolumesListAdminTestJSON-940057122 None] Lock "cinder-quobyte-b8b5a067-fb24-43e9-ae52-cfdbef2f75e9" released by "delete_volume" :: held 1.669s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:10:43 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-620fd767-bf50-42ff-a74a-90e438bd20bd tempest-VolumesListAdminTestJSON-940057122 None] Created reservations ['bb9f5d6c-f417-40ba-890d-670876217d6c', 'd93ccab2-a6a8-4f8f-ad99-e2513cc49807', '52599f74-9898-4510-a904-a42c7003aada', 'fc7d2905-b21e-4486-8c94-a3de4df5c671'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:10:43 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-620fd767-bf50-42ff-a74a-90e438bd20bd tempest-VolumesListAdminTestJSON-940057122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:10:43 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-620fd767-bf50-42ff-a74a-90e438bd20bd tempest-VolumesListAdminTestJSON-940057122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:10:43 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-620fd767-bf50-42ff-a74a-90e438bd20bd tempest-VolumesListAdminTestJSON-940057122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:10:43 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-620fd767-bf50-42ff-a74a-90e438bd20bd tempest-VolumesListAdminTestJSON-940057122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:10:43 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-620fd767-bf50-42ff-a74a-90e438bd20bd tempest-VolumesListAdminTestJSON-940057122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:10:43 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-620fd767-bf50-42ff-a74a-90e438bd20bd tempest-VolumesListAdminTestJSON-940057122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:43 devstack sudo[90100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:10:43 devstack sudo[90100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:43 devstack sudo[90096]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:43 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e1dd8fe3-babe-4a93-bd77-893cd68ac94c tempest-SnapshotsActionsTest-285904011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9" returned: 0 in 0.831s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:43 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e1dd8fe3-babe-4a93-bd77-893cd68ac94c tempest-SnapshotsActionsTest-285904011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9 1G {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:43 devstack sudo[90105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9 1G
Apr 28 22:10:43 devstack sudo[90105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:44 devstack sudo[90100]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:44 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-620fd767-bf50-42ff-a74a-90e438bd20bd tempest-VolumesListAdminTestJSON-940057122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.868s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:44 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-620fd767-bf50-42ff-a74a-90e438bd20bd tempest-VolumesListAdminTestJSON-940057122 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:10:44 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-620fd767-bf50-42ff-a74a-90e438bd20bd tempest-VolumesListAdminTestJSON-940057122 None] Deleted volume successfully.
Apr 28 22:10:44 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-620fd767-bf50-42ff-a74a-90e438bd20bd tempest-VolumesListAdminTestJSON-940057122 None] Lock "cinder-b8b5a067-fb24-43e9-ae52-cfdbef2f75e9-delete_volume" released by "delete_volume" :: held 2.835s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:10:44 devstack sudo[90105]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:44 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e1dd8fe3-babe-4a93-bd77-893cd68ac94c tempest-SnapshotsActionsTest-285904011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9 1G" returned: 0 in 1.003s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:44 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e1dd8fe3-babe-4a93-bd77-893cd68ac94c tempest-SnapshotsActionsTest-285904011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-623c783b-a15c-45e5-a63a-1ff893a60ad9 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:44 devstack sudo[90112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-623c783b-a15c-45e5-a63a-1ff893a60ad9 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9
Apr 28 22:10:44 devstack sudo[90112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:45 devstack sudo[90112]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:45 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e1dd8fe3-babe-4a93-bd77-893cd68ac94c tempest-SnapshotsActionsTest-285904011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-623c783b-a15c-45e5-a63a-1ff893a60ad9 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9" returned: 0 in 0.797s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:45 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-e1dd8fe3-babe-4a93-bd77-893cd68ac94c tempest-SnapshotsActionsTest-285904011 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9 is being set with open permissions: ugo+rw
Apr 28 22:10:45 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e1dd8fe3-babe-4a93-bd77-893cd68ac94c tempest-SnapshotsActionsTest-285904011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:45 devstack sudo[90117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9
Apr 28 22:10:45 devstack sudo[90117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:45 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-198c9caa-e735-43e7-9744-f676e9960022 tempest-SnapshotDependencyTests-1447044764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:10:45 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-198c9caa-e735-43e7-9744-f676e9960022 tempest-SnapshotDependencyTests-1447044764 None] Flow 'volume_create_manager' (0c93151e-a7d0-454a-8bd4-e7517af1c7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:10:45 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-198c9caa-e735-43e7-9744-f676e9960022 tempest-SnapshotDependencyTests-1447044764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd989759-ff78-4dda-b316-450a7b351d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:10:46 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-198c9caa-e735-43e7-9744-f676e9960022 tempest-SnapshotDependencyTests-1447044764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd989759-ff78-4dda-b316-450a7b351d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:10:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1214041792',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57af7fe1-0af2-4602-a3e0-d0ec1aa784f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ea4e725bf5b40a7956cb88008d15728',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:10:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:10:46Z,use_quota=True,user_id='9c38579b252842b5b6d837576b2d3ed5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:10:46 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-198c9caa-e735-43e7-9744-f676e9960022 tempest-SnapshotDependencyTests-1447044764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcb28dcf-2ac0-45af-9b53-d0a604b91823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:10:46 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-198c9caa-e735-43e7-9744-f676e9960022 tempest-SnapshotDependencyTests-1447044764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcb28dcf-2ac0-45af-9b53-d0a604b91823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:10:46 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-198c9caa-e735-43e7-9744-f676e9960022 tempest-SnapshotDependencyTests-1447044764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (992b476d-30d6-45f0-a9c9-61cb51f36f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:10:46 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-198c9caa-e735-43e7-9744-f676e9960022 tempest-SnapshotDependencyTests-1447044764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (992b476d-30d6-45f0-a9c9-61cb51f36f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57af7fe1-0af2-4602-a3e0-d0ec1aa784f0', 'volume_name': 'volume-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:10:46 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-198c9caa-e735-43e7-9744-f676e9960022 tempest-SnapshotDependencyTests-1447044764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3546b9e-d998-496b-b9aa-6a47d8088b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:10:46 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-198c9caa-e735-43e7-9744-f676e9960022 tempest-SnapshotDependencyTests-1447044764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3546b9e-d998-496b-b9aa-6a47d8088b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:10:46 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-198c9caa-e735-43e7-9744-f676e9960022 tempest-SnapshotDependencyTests-1447044764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c6f1bf6-23a7-4588-8a6a-a37ea731cd90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:10:46 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-198c9caa-e735-43e7-9744-f676e9960022 tempest-SnapshotDependencyTests-1447044764 None] Volume 57af7fe1-0af2-4602-a3e0-d0ec1aa784f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0', 'volume_size': 1}
Apr 28 22:10:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-198c9caa-e735-43e7-9744-f676e9960022 tempest-SnapshotDependencyTests-1447044764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:10:46 devstack sudo[90117]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e1dd8fe3-babe-4a93-bd77-893cd68ac94c tempest-SnapshotsActionsTest-285904011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9" returned: 0 in 0.730s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e1dd8fe3-babe-4a93-bd77-893cd68ac94c tempest-SnapshotsActionsTest-285904011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.info {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:46 devstack sudo[90120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.info
Apr 28 22:10:46 devstack sudo[90120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:46 devstack sudo[90120]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e1dd8fe3-babe-4a93-bd77-893cd68ac94c tempest-SnapshotsActionsTest-285904011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.info" returned: 0 in 0.700s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:46 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-e1dd8fe3-babe-4a93-bd77-893cd68ac94c tempest-SnapshotsActionsTest-285904011 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.info is being set with open permissions: ugo+rw
Apr 28 22:10:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e1dd8fe3-babe-4a93-bd77-893cd68ac94c tempest-SnapshotsActionsTest-285904011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.info {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:46 devstack sudo[90123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.info
Apr 28 22:10:46 devstack sudo[90123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:47 devstack sudo[90123]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:47 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e1dd8fe3-babe-4a93-bd77-893cd68ac94c tempest-SnapshotsActionsTest-285904011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.info" returned: 0 in 0.612s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:47 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-e1dd8fe3-babe-4a93-bd77-893cd68ac94c tempest-SnapshotsActionsTest-285904011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.783s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:10:47 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-198c9caa-e735-43e7-9744-f676e9960022 tempest-SnapshotDependencyTests-1447044764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.392s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:10:47 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-198c9caa-e735-43e7-9744-f676e9960022 tempest-SnapshotDependencyTests-1447044764 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:10:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1214041792',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57af7fe1-0af2-4602-a3e0-d0ec1aa784f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ea4e725bf5b40a7956cb88008d15728',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:10:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:10:46Z,use_quota=True,user_id='9c38579b252842b5b6d837576b2d3ed5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:10:47 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-198c9caa-e735-43e7-9744-f676e9960022 tempest-SnapshotDependencyTests-1447044764 None] Creating volume 57af7fe1-0af2-4602-a3e0-d0ec1aa784f0 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:10:47 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-198c9caa-e735-43e7-9744-f676e9960022 tempest-SnapshotDependencyTests-1447044764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:10:47 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-198c9caa-e735-43e7-9744-f676e9960022 tempest-SnapshotDependencyTests-1447044764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:10:47 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-198c9caa-e735-43e7-9744-f676e9960022 tempest-SnapshotDependencyTests-1447044764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:10:47 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-198c9caa-e735-43e7-9744-f676e9960022 tempest-SnapshotDependencyTests-1447044764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:10:47 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-198c9caa-e735-43e7-9744-f676e9960022 tempest-SnapshotDependencyTests-1447044764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:10:47 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-198c9caa-e735-43e7-9744-f676e9960022 tempest-SnapshotDependencyTests-1447044764 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:10:47 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-198c9caa-e735-43e7-9744-f676e9960022 tempest-SnapshotDependencyTests-1447044764 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:10:47 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-198c9caa-e735-43e7-9744-f676e9960022 tempest-SnapshotDependencyTests-1447044764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:47 devstack sudo[90126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0 1073741824
Apr 28 22:10:47 devstack sudo[90126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:47 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-e1dd8fe3-babe-4a93-bd77-893cd68ac94c tempest-SnapshotsActionsTest-285904011 None] Create snapshot completed successfully
Apr 28 22:10:48 devstack sudo[90126]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:48 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-198c9caa-e735-43e7-9744-f676e9960022 tempest-SnapshotDependencyTests-1447044764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0 1073741824" returned: 0 in 0.854s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:48 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-198c9caa-e735-43e7-9744-f676e9960022 tempest-SnapshotDependencyTests-1447044764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:48 devstack sudo[90132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0
Apr 28 22:10:48 devstack sudo[90132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:48 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-ff7fea52-6637-4d5d-9c34-b4eb363c54c7 tempest-SnapshotsActionsTest-285904011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:10:48 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-33c1ecd9-363f-4766-b356-f7e897c0f2f4 tempest-SnapshotMetadataTestJSON-651854129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:10:48 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-33c1ecd9-363f-4766-b356-f7e897c0f2f4 tempest-SnapshotMetadataTestJSON-651854129 None] Flow 'volume_create_manager' (66910bfd-2990-4fcf-af4e-d4f048221930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:10:48 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-33c1ecd9-363f-4766-b356-f7e897c0f2f4 tempest-SnapshotMetadataTestJSON-651854129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (768b45c6-0acb-4b29-8d5d-8b94db64ce33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:10:48 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-33c1ecd9-363f-4766-b356-f7e897c0f2f4 tempest-SnapshotMetadataTestJSON-651854129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (768b45c6-0acb-4b29-8d5d-8b94db64ce33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:10:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1763367178',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e96294e9cd874b5cb6665e900ed05809',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:10:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:10:49Z,use_quota=True,user_id='5aa3a1e6583840d4865a57c82e7efc05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:10:48 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-33c1ecd9-363f-4766-b356-f7e897c0f2f4 tempest-SnapshotMetadataTestJSON-651854129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad5ee1c6-9c14-4bcb-ae0e-a7edfed9ce15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:10:48 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-33c1ecd9-363f-4766-b356-f7e897c0f2f4 tempest-SnapshotMetadataTestJSON-651854129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad5ee1c6-9c14-4bcb-ae0e-a7edfed9ce15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:10:48 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-33c1ecd9-363f-4766-b356-f7e897c0f2f4 tempest-SnapshotMetadataTestJSON-651854129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d5fe97a-5480-48b3-99ee-8b20859cbeb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:10:48 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-33c1ecd9-363f-4766-b356-f7e897c0f2f4 tempest-SnapshotMetadataTestJSON-651854129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d5fe97a-5480-48b3-99ee-8b20859cbeb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69', 'volume_name': 'volume-92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:10:48 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-33c1ecd9-363f-4766-b356-f7e897c0f2f4 tempest-SnapshotMetadataTestJSON-651854129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41d0cf37-c6a5-4ed3-9a74-e59ebd068a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:10:48 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-33c1ecd9-363f-4766-b356-f7e897c0f2f4 tempest-SnapshotMetadataTestJSON-651854129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41d0cf37-c6a5-4ed3-9a74-e59ebd068a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:10:48 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-33c1ecd9-363f-4766-b356-f7e897c0f2f4 tempest-SnapshotMetadataTestJSON-651854129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06c5c3f2-54e2-4f09-9df3-623dbc32ac10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:10:48 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-33c1ecd9-363f-4766-b356-f7e897c0f2f4 tempest-SnapshotMetadataTestJSON-651854129 None] Volume 92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69', 'volume_size': 1}
Apr 28 22:10:48 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-33c1ecd9-363f-4766-b356-f7e897c0f2f4 tempest-SnapshotMetadataTestJSON-651854129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:10:48 devstack sudo[90132]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:48 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-198c9caa-e735-43e7-9744-f676e9960022 tempest-SnapshotDependencyTests-1447044764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0" returned: 0 in 0.619s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:48 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-198c9caa-e735-43e7-9744-f676e9960022 tempest-SnapshotDependencyTests-1447044764 None] <== create_volume: return (1521ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:10:48 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-198c9caa-e735-43e7-9744-f676e9960022 tempest-SnapshotDependencyTests-1447044764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.523s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:10:48 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-ff7fea52-6637-4d5d-9c34-b4eb363c54c7 tempest-SnapshotsActionsTest-285904011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.220s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:10:48 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-ff7fea52-6637-4d5d-9c34-b4eb363c54c7 tempest-SnapshotsActionsTest-285904011 None] Creating offline snapshot a3910f1d-16a3-4e03-9a8d-c1be6752babb of volume 623c783b-a15c-45e5-a63a-1ff893a60ad9 {{(pid=83924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 22:10:49 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-198c9caa-e735-43e7-9744-f676e9960022 tempest-SnapshotDependencyTests-1447044764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c6f1bf6-23a7-4588-8a6a-a37ea731cd90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:10:49 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-198c9caa-e735-43e7-9744-f676e9960022 tempest-SnapshotDependencyTests-1447044764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a925f2e0-e77c-442d-a009-6b76f425234f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:10:49 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[60bb2ec2-cf55-47ac-b76a-1f03d2fddf8f]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:10:49 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-ff7fea52-6637-4d5d-9c34-b4eb363c54c7 tempest-SnapshotsActionsTest-285904011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:49 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-198c9caa-e735-43e7-9744-f676e9960022 tempest-SnapshotDependencyTests-1447044764 None] Volume volume-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0 (57af7fe1-0af2-4602-a3e0-d0ec1aa784f0): created successfully
Apr 28 22:10:49 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-198c9caa-e735-43e7-9744-f676e9960022 tempest-SnapshotDependencyTests-1447044764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a925f2e0-e77c-442d-a009-6b76f425234f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:10:49 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-198c9caa-e735-43e7-9744-f676e9960022 tempest-SnapshotDependencyTests-1447044764 None] Flow 'volume_create_manager' (0c93151e-a7d0-454a-8bd4-e7517af1c7c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:10:49 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-198c9caa-e735-43e7-9744-f676e9960022 tempest-SnapshotDependencyTests-1447044764 None] Created volume successfully.
Apr 28 22:10:49 devstack sudo[90136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9
Apr 28 22:10:49 devstack sudo[90136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:49 devstack sudo[90136]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:49 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-ff7fea52-6637-4d5d-9c34-b4eb363c54c7 tempest-SnapshotsActionsTest-285904011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9" returned: 0 in 0.691s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:49 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-ff7fea52-6637-4d5d-9c34-b4eb363c54c7 tempest-SnapshotsActionsTest-285904011 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-623c783b-a15c-45e5-a63a-1ff893a60ad9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 22:10:49 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-ff7fea52-6637-4d5d-9c34-b4eb363c54c7 tempest-SnapshotsActionsTest-285904011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.a3910f1d-16a3-4e03-9a8d-c1be6752babb 1G {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:49 devstack sudo[90141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.a3910f1d-16a3-4e03-9a8d-c1be6752babb 1G
Apr 28 22:10:49 devstack sudo[90141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:50 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f48e0895-2428-4815-a7db-926c3e5bba31 tempest-SnapshotDependencyTests-1447044764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:10:50 devstack sudo[90141]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:50 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-ff7fea52-6637-4d5d-9c34-b4eb363c54c7 tempest-SnapshotsActionsTest-285904011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.a3910f1d-16a3-4e03-9a8d-c1be6752babb 1G" returned: 0 in 0.824s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:50 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-ff7fea52-6637-4d5d-9c34-b4eb363c54c7 tempest-SnapshotsActionsTest-285904011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.a3910f1d-16a3-4e03-9a8d-c1be6752babb {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:50 devstack sudo[90147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.a3910f1d-16a3-4e03-9a8d-c1be6752babb
Apr 28 22:10:50 devstack sudo[90147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:51 devstack sudo[90147]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-ff7fea52-6637-4d5d-9c34-b4eb363c54c7 tempest-SnapshotsActionsTest-285904011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.a3910f1d-16a3-4e03-9a8d-c1be6752babb" returned: 0 in 0.660s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:51 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-ff7fea52-6637-4d5d-9c34-b4eb363c54c7 tempest-SnapshotsActionsTest-285904011 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.a3910f1d-16a3-4e03-9a8d-c1be6752babb is being set with open permissions: ugo+rw
Apr 28 22:10:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-ff7fea52-6637-4d5d-9c34-b4eb363c54c7 tempest-SnapshotsActionsTest-285904011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.a3910f1d-16a3-4e03-9a8d-c1be6752babb {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:51 devstack sudo[90152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.a3910f1d-16a3-4e03-9a8d-c1be6752babb
Apr 28 22:10:51 devstack sudo[90152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:51 devstack sudo[90152]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-ff7fea52-6637-4d5d-9c34-b4eb363c54c7 tempest-SnapshotsActionsTest-285904011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.a3910f1d-16a3-4e03-9a8d-c1be6752babb" returned: 0 in 0.638s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-ff7fea52-6637-4d5d-9c34-b4eb363c54c7 tempest-SnapshotsActionsTest-285904011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.918s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:10:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-33c1ecd9-363f-4766-b356-f7e897c0f2f4 tempest-SnapshotMetadataTestJSON-651854129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.056s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:10:51 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-33c1ecd9-363f-4766-b356-f7e897c0f2f4 tempest-SnapshotMetadataTestJSON-651854129 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:10:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1763367178',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e96294e9cd874b5cb6665e900ed05809',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:10:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:10:49Z,use_quota=True,user_id='5aa3a1e6583840d4865a57c82e7efc05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:10:51 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-33c1ecd9-363f-4766-b356-f7e897c0f2f4 tempest-SnapshotMetadataTestJSON-651854129 None] Creating volume 92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:10:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-33c1ecd9-363f-4766-b356-f7e897c0f2f4 tempest-SnapshotMetadataTestJSON-651854129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:10:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-33c1ecd9-363f-4766-b356-f7e897c0f2f4 tempest-SnapshotMetadataTestJSON-651854129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:10:51 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-33c1ecd9-363f-4766-b356-f7e897c0f2f4 tempest-SnapshotMetadataTestJSON-651854129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:10:51 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-33c1ecd9-363f-4766-b356-f7e897c0f2f4 tempest-SnapshotMetadataTestJSON-651854129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:10:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-33c1ecd9-363f-4766-b356-f7e897c0f2f4 tempest-SnapshotMetadataTestJSON-651854129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:10:51 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-33c1ecd9-363f-4766-b356-f7e897c0f2f4 tempest-SnapshotMetadataTestJSON-651854129 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:10:51 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-33c1ecd9-363f-4766-b356-f7e897c0f2f4 tempest-SnapshotMetadataTestJSON-651854129 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:10:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-33c1ecd9-363f-4766-b356-f7e897c0f2f4 tempest-SnapshotMetadataTestJSON-651854129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:51 devstack sudo[90155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69 1073741824
Apr 28 22:10:51 devstack sudo[90155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:51 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-ff7fea52-6637-4d5d-9c34-b4eb363c54c7 tempest-SnapshotsActionsTest-285904011 None] Create snapshot completed successfully
Apr 28 22:10:52 devstack sudo[90155]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:52 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-33c1ecd9-363f-4766-b356-f7e897c0f2f4 tempest-SnapshotMetadataTestJSON-651854129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69 1073741824" returned: 0 in 0.783s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:52 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-33c1ecd9-363f-4766-b356-f7e897c0f2f4 tempest-SnapshotMetadataTestJSON-651854129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:52 devstack sudo[90160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69
Apr 28 22:10:52 devstack sudo[90160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:53 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-7dc17209-61a6-4f06-af34-ec11dc7ec562 tempest-SnapshotsActionsTest-568208414 None] Acquiring lock "cinder-a3910f1d-16a3-4e03-9a8d-c1be6752babb-delete_snapshot" by "delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:10:53 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-7dc17209-61a6-4f06-af34-ec11dc7ec562 tempest-SnapshotsActionsTest-568208414 None] Lock "cinder-a3910f1d-16a3-4e03-9a8d-c1be6752babb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:10:53 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-7dc17209-61a6-4f06-af34-ec11dc7ec562 tempest-SnapshotsActionsTest-568208414 None] Acquiring lock "cinder-quobyte-623c783b-a15c-45e5-a63a-1ff893a60ad9" by "delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:10:53 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-7dc17209-61a6-4f06-af34-ec11dc7ec562 tempest-SnapshotsActionsTest-568208414 None] Lock "cinder-quobyte-623c783b-a15c-45e5-a63a-1ff893a60ad9" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:10:53 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-7dc17209-61a6-4f06-af34-ec11dc7ec562 tempest-SnapshotsActionsTest-568208414 None] Acquiring lock "cinder-quobyte-a3910f1d-16a3-4e03-9a8d-c1be6752babb" by "_delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:10:53 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-7dc17209-61a6-4f06-af34-ec11dc7ec562 tempest-SnapshotsActionsTest-568208414 None] Lock "cinder-quobyte-a3910f1d-16a3-4e03-9a8d-c1be6752babb" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:10:53 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-7dc17209-61a6-4f06-af34-ec11dc7ec562 tempest-SnapshotsActionsTest-568208414 None] Deleting offline snapshot a3910f1d-16a3-4e03-9a8d-c1be6752babb of volume 623c783b-a15c-45e5-a63a-1ff893a60ad9 {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 22:10:53 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-7dc17209-61a6-4f06-af34-ec11dc7ec562 tempest-SnapshotsActionsTest-568208414 None] snapshot_file for this snap is: volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.a3910f1d-16a3-4e03-9a8d-c1be6752babb {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 22:10:53 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[8961eccd-57a7-4ebc-b2e2-835cdc09e267]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:10:53 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7dc17209-61a6-4f06-af34-ec11dc7ec562 tempest-SnapshotsActionsTest-568208414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.a3910f1d-16a3-4e03-9a8d-c1be6752babb {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:53 devstack sudo[90163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.a3910f1d-16a3-4e03-9a8d-c1be6752babb
Apr 28 22:10:53 devstack sudo[90163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:53 devstack sudo[90160]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:53 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-33c1ecd9-363f-4766-b356-f7e897c0f2f4 tempest-SnapshotMetadataTestJSON-651854129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69" returned: 0 in 0.634s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:53 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-33c1ecd9-363f-4766-b356-f7e897c0f2f4 tempest-SnapshotMetadataTestJSON-651854129 None] <== create_volume: return (1517ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:10:53 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-33c1ecd9-363f-4766-b356-f7e897c0f2f4 tempest-SnapshotMetadataTestJSON-651854129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.519s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:10:53 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f48e0895-2428-4815-a7db-926c3e5bba31 tempest-SnapshotDependencyTests-1447044764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.941s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:10:53 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-33c1ecd9-363f-4766-b356-f7e897c0f2f4 tempest-SnapshotMetadataTestJSON-651854129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06c5c3f2-54e2-4f09-9df3-623dbc32ac10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:10:53 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-33c1ecd9-363f-4766-b356-f7e897c0f2f4 tempest-SnapshotMetadataTestJSON-651854129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18c82544-85da-473a-b2c9-d6fd9a03678f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:10:53 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-f48e0895-2428-4815-a7db-926c3e5bba31 tempest-SnapshotDependencyTests-1447044764 None] Creating offline snapshot f49ecbd5-ad60-4d90-8255-25a1f8990caf of volume 57af7fe1-0af2-4602-a3e0-d0ec1aa784f0 {{(pid=83924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 22:10:53 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-33c1ecd9-363f-4766-b356-f7e897c0f2f4 tempest-SnapshotMetadataTestJSON-651854129 None] Volume volume-92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69 (92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69): created successfully
Apr 28 22:10:53 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-33c1ecd9-363f-4766-b356-f7e897c0f2f4 tempest-SnapshotMetadataTestJSON-651854129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18c82544-85da-473a-b2c9-d6fd9a03678f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:10:53 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-33c1ecd9-363f-4766-b356-f7e897c0f2f4 tempest-SnapshotMetadataTestJSON-651854129 None] Flow 'volume_create_manager' (66910bfd-2990-4fcf-af4e-d4f048221930) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:10:53 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f19838-b222-46d4-a8e8-45a7d922047f]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:10:53 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f48e0895-2428-4815-a7db-926c3e5bba31 tempest-SnapshotDependencyTests-1447044764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:53 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-33c1ecd9-363f-4766-b356-f7e897c0f2f4 tempest-SnapshotMetadataTestJSON-651854129 None] Created volume successfully.
Apr 28 22:10:53 devstack sudo[90166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0
Apr 28 22:10:53 devstack sudo[90166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:53 devstack sudo[90163]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:53 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7dc17209-61a6-4f06-af34-ec11dc7ec562 tempest-SnapshotsActionsTest-568208414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.a3910f1d-16a3-4e03-9a8d-c1be6752babb" returned: 0 in 0.817s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:53 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-7dc17209-61a6-4f06-af34-ec11dc7ec562 tempest-SnapshotsActionsTest-568208414 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-623c783b-a15c-45e5-a63a-1ff893a60ad9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 22:10:53 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3276a58-d093-4f5e-b2fa-40fe6aea34de]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:10:53 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7dc17209-61a6-4f06-af34-ec11dc7ec562 tempest-SnapshotsActionsTest-568208414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:54 devstack sudo[90171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9
Apr 28 22:10:54 devstack sudo[90171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:54 devstack sudo[90166]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:54 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f48e0895-2428-4815-a7db-926c3e5bba31 tempest-SnapshotDependencyTests-1447044764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0" returned: 0 in 0.816s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:54 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f48e0895-2428-4815-a7db-926c3e5bba31 tempest-SnapshotDependencyTests-1447044764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0.f49ecbd5-ad60-4d90-8255-25a1f8990caf 1G {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:54 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-4944c26e-254b-4baa-b4bd-18c83daf5322 tempest-SnapshotMetadataTestJSON-651854129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:10:54 devstack sudo[90176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0.f49ecbd5-ad60-4d90-8255-25a1f8990caf 1G
Apr 28 22:10:54 devstack sudo[90176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:54 devstack sudo[90171]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:54 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7dc17209-61a6-4f06-af34-ec11dc7ec562 tempest-SnapshotsActionsTest-568208414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9" returned: 0 in 0.857s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:54 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-7dc17209-61a6-4f06-af34-ec11dc7ec562 tempest-SnapshotsActionsTest-568208414 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-623c783b-a15c-45e5-a63a-1ff893a60ad9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 22:10:54 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7dc17209-61a6-4f06-af34-ec11dc7ec562 tempest-SnapshotsActionsTest-568208414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.a3910f1d-16a3-4e03-9a8d-c1be6752babb {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:54 devstack sudo[90181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.a3910f1d-16a3-4e03-9a8d-c1be6752babb
Apr 28 22:10:54 devstack sudo[90181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:55 devstack sudo[90176]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:55 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f48e0895-2428-4815-a7db-926c3e5bba31 tempest-SnapshotDependencyTests-1447044764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0.f49ecbd5-ad60-4d90-8255-25a1f8990caf 1G" returned: 0 in 0.807s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:55 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f48e0895-2428-4815-a7db-926c3e5bba31 tempest-SnapshotDependencyTests-1447044764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0.f49ecbd5-ad60-4d90-8255-25a1f8990caf {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:55 devstack sudo[90186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0.f49ecbd5-ad60-4d90-8255-25a1f8990caf
Apr 28 22:10:55 devstack sudo[90186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:55 devstack sudo[90181]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:55 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7dc17209-61a6-4f06-af34-ec11dc7ec562 tempest-SnapshotsActionsTest-568208414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.a3910f1d-16a3-4e03-9a8d-c1be6752babb" returned: 0 in 0.720s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:55 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7dc17209-61a6-4f06-af34-ec11dc7ec562 tempest-SnapshotsActionsTest-568208414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.a3910f1d-16a3-4e03-9a8d-c1be6752babb {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:55 devstack sudo[90191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.a3910f1d-16a3-4e03-9a8d-c1be6752babb
Apr 28 22:10:55 devstack sudo[90191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:55 devstack sudo[90186]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:55 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f48e0895-2428-4815-a7db-926c3e5bba31 tempest-SnapshotDependencyTests-1447044764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0.f49ecbd5-ad60-4d90-8255-25a1f8990caf" returned: 0 in 0.672s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:55 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-f48e0895-2428-4815-a7db-926c3e5bba31 tempest-SnapshotDependencyTests-1447044764 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0.f49ecbd5-ad60-4d90-8255-25a1f8990caf is being set with open permissions: ugo+rw
Apr 28 22:10:55 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f48e0895-2428-4815-a7db-926c3e5bba31 tempest-SnapshotDependencyTests-1447044764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0.f49ecbd5-ad60-4d90-8255-25a1f8990caf {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:55 devstack sudo[90196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0.f49ecbd5-ad60-4d90-8255-25a1f8990caf
Apr 28 22:10:55 devstack sudo[90196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:56 devstack sudo[90191]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:56 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7dc17209-61a6-4f06-af34-ec11dc7ec562 tempest-SnapshotsActionsTest-568208414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.a3910f1d-16a3-4e03-9a8d-c1be6752babb" returned: 0 in 0.603s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:56 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-7dc17209-61a6-4f06-af34-ec11dc7ec562 tempest-SnapshotsActionsTest-568208414 None] Lock "cinder-quobyte-a3910f1d-16a3-4e03-9a8d-c1be6752babb" released by "_delete_snapshot" :: held 3.118s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:10:56 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-7dc17209-61a6-4f06-af34-ec11dc7ec562 tempest-SnapshotsActionsTest-568208414 None] Lock "cinder-quobyte-623c783b-a15c-45e5-a63a-1ff893a60ad9" released by "delete_snapshot" :: held 3.146s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:10:56 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-7dc17209-61a6-4f06-af34-ec11dc7ec562 tempest-SnapshotsActionsTest-568208414 None] Created reservations ['cddf816a-61fc-413f-a4da-5b2f8da7cbe2', '9667feff-5492-41a1-8388-1596cc2c8d7f', '3d9d5316-5cac-4be7-8caa-1825aecb8d9c', 'f8625195-e8b0-4483-a461-a18f1f968ab5'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:10:56 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-7dc17209-61a6-4f06-af34-ec11dc7ec562 tempest-SnapshotsActionsTest-568208414 None] Delete snapshot completed successfully.
Apr 28 22:10:56 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-7dc17209-61a6-4f06-af34-ec11dc7ec562 tempest-SnapshotsActionsTest-568208414 None] Lock "cinder-a3910f1d-16a3-4e03-9a8d-c1be6752babb-delete_snapshot" released by "delete_snapshot" :: held 3.309s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:10:56 devstack sudo[90196]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:56 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f48e0895-2428-4815-a7db-926c3e5bba31 tempest-SnapshotDependencyTests-1447044764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0.f49ecbd5-ad60-4d90-8255-25a1f8990caf" returned: 0 in 0.624s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:56 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f48e0895-2428-4815-a7db-926c3e5bba31 tempest-SnapshotDependencyTests-1447044764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0.info {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:56 devstack sudo[90200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0.info
Apr 28 22:10:56 devstack sudo[90200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:57 devstack sudo[90200]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:57 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f48e0895-2428-4815-a7db-926c3e5bba31 tempest-SnapshotDependencyTests-1447044764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0.info" returned: 0 in 0.578s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:57 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-f48e0895-2428-4815-a7db-926c3e5bba31 tempest-SnapshotDependencyTests-1447044764 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0.info is being set with open permissions: ugo+rw
Apr 28 22:10:57 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f48e0895-2428-4815-a7db-926c3e5bba31 tempest-SnapshotDependencyTests-1447044764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0.info {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:57 devstack sudo[90203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0.info
Apr 28 22:10:57 devstack sudo[90203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:57 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-686b90f7-57ce-4f86-a4e9-8980058fbc1d tempest-SnapshotsActionsTest-285904011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:10:57 devstack sudo[90203]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:57 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f48e0895-2428-4815-a7db-926c3e5bba31 tempest-SnapshotDependencyTests-1447044764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0.info" returned: 0 in 0.647s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:57 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f48e0895-2428-4815-a7db-926c3e5bba31 tempest-SnapshotDependencyTests-1447044764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.262s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:10:57 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-4944c26e-254b-4baa-b4bd-18c83daf5322 tempest-SnapshotMetadataTestJSON-651854129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.370s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:10:57 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-4944c26e-254b-4baa-b4bd-18c83daf5322 tempest-SnapshotMetadataTestJSON-651854129 None] Creating offline snapshot 4e4b2693-2f4b-4f08-9efa-54fd139cb47b of volume 92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69 {{(pid=83924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 22:10:57 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-f48e0895-2428-4815-a7db-926c3e5bba31 tempest-SnapshotDependencyTests-1447044764 None] Create snapshot completed successfully
Apr 28 22:10:57 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[de427a6f-0dd4-4cd4-ad0f-01e2aaed3a48]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:10:57 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4944c26e-254b-4baa-b4bd-18c83daf5322 tempest-SnapshotMetadataTestJSON-651854129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:57 devstack sudo[90206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69
Apr 28 22:10:57 devstack sudo[90206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:58 devstack sudo[90206]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:58 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4944c26e-254b-4baa-b4bd-18c83daf5322 tempest-SnapshotMetadataTestJSON-651854129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69" returned: 0 in 0.701s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:58 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4944c26e-254b-4baa-b4bd-18c83daf5322 tempest-SnapshotMetadataTestJSON-651854129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69.4e4b2693-2f4b-4f08-9efa-54fd139cb47b 1G {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:58 devstack sudo[90211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69.4e4b2693-2f4b-4f08-9efa-54fd139cb47b 1G
Apr 28 22:10:58 devstack sudo[90211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:59 devstack sudo[90211]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:59 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4944c26e-254b-4baa-b4bd-18c83daf5322 tempest-SnapshotMetadataTestJSON-651854129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69.4e4b2693-2f4b-4f08-9efa-54fd139cb47b 1G" returned: 0 in 0.835s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:59 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4944c26e-254b-4baa-b4bd-18c83daf5322 tempest-SnapshotMetadataTestJSON-651854129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69.4e4b2693-2f4b-4f08-9efa-54fd139cb47b {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:59 devstack sudo[90218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69.4e4b2693-2f4b-4f08-9efa-54fd139cb47b
Apr 28 22:10:59 devstack sudo[90218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:10:59 devstack cinder-volume[83924]: DEBUG dbcounter [-] [83924] Writing DB stats cinder:SELECT=112,cinder:INSERT=30,cinder:UPDATE=109,cinder:DELETE=9 {{(pid=83924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 28 22:10:59 devstack cinder-volume[83924]: DEBUG dbcounter [-] [83924] Writing DB stats cinder:SELECT=92,cinder:UPDATE=135,cinder:DELETE=11,cinder:INSERT=27 {{(pid=83924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 28 22:10:59 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0e615f3-a84c-4058-85d4-cdba4a4568c0 tempest-SnapshotDependencyTests-1447044764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:10:59 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b0e615f3-a84c-4058-85d4-cdba4a4568c0 tempest-SnapshotDependencyTests-1447044764 None] Flow 'volume_create_manager' (b98a6a57-5fa2-4100-83a4-e0ce2163088b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:10:59 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b0e615f3-a84c-4058-85d4-cdba4a4568c0 tempest-SnapshotDependencyTests-1447044764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffbcc666-3a87-4968-ba41-85144b2d1e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:10:59 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b0e615f3-a84c-4058-85d4-cdba4a4568c0 tempest-SnapshotDependencyTests-1447044764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffbcc666-3a87-4968-ba41-85144b2d1e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:10:59Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4db1673a-8b7f-4333-9004-c3434f1e6d73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ea4e725bf5b40a7956cb88008d15728',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:10:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f49ecbd5-ad60-4d90-8255-25a1f8990caf,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:10:59Z,use_quota=True,user_id='9c38579b252842b5b6d837576b2d3ed5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:10:59 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b0e615f3-a84c-4058-85d4-cdba4a4568c0 tempest-SnapshotDependencyTests-1447044764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edb9e714-3363-4c8f-9729-1f8c857ea9b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:10:59 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b0e615f3-a84c-4058-85d4-cdba4a4568c0 tempest-SnapshotDependencyTests-1447044764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edb9e714-3363-4c8f-9729-1f8c857ea9b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:10:59 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b0e615f3-a84c-4058-85d4-cdba4a4568c0 tempest-SnapshotDependencyTests-1447044764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d1fe2e5-12a4-4d50-9290-098a4d5a07e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:10:59 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b0e615f3-a84c-4058-85d4-cdba4a4568c0 tempest-SnapshotDependencyTests-1447044764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d1fe2e5-12a4-4d50-9290-098a4d5a07e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4db1673a-8b7f-4333-9004-c3434f1e6d73', 'volume_name': 'volume-4db1673a-8b7f-4333-9004-c3434f1e6d73', 'volume_size': 1, 'snapshot_id': 'f49ecbd5-ad60-4d90-8255-25a1f8990caf'}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:10:59 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b0e615f3-a84c-4058-85d4-cdba4a4568c0 tempest-SnapshotDependencyTests-1447044764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae24d003-20ab-4665-98bd-8d1f3f810d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:10:59 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b0e615f3-a84c-4058-85d4-cdba4a4568c0 tempest-SnapshotDependencyTests-1447044764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae24d003-20ab-4665-98bd-8d1f3f810d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:10:59 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b0e615f3-a84c-4058-85d4-cdba4a4568c0 tempest-SnapshotDependencyTests-1447044764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (187b6c58-35ca-4640-b2c3-4a4a9c66c9d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:10:59 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-b0e615f3-a84c-4058-85d4-cdba4a4568c0 tempest-SnapshotDependencyTests-1447044764 None] Volume 4db1673a-8b7f-4333-9004-c3434f1e6d73: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4db1673a-8b7f-4333-9004-c3434f1e6d73', 'volume_size': 1, 'snapshot_id': 'f49ecbd5-ad60-4d90-8255-25a1f8990caf'}
Apr 28 22:10:59 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b0e615f3-a84c-4058-85d4-cdba4a4568c0 tempest-SnapshotDependencyTests-1447044764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:10:59 devstack sudo[90218]: pam_unix(sudo:session): session closed for user root
Apr 28 22:10:59 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4944c26e-254b-4baa-b4bd-18c83daf5322 tempest-SnapshotMetadataTestJSON-651854129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69.4e4b2693-2f4b-4f08-9efa-54fd139cb47b" returned: 0 in 0.676s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:10:59 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-4944c26e-254b-4baa-b4bd-18c83daf5322 tempest-SnapshotMetadataTestJSON-651854129 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69.4e4b2693-2f4b-4f08-9efa-54fd139cb47b is being set with open permissions: ugo+rw
Apr 28 22:10:59 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4944c26e-254b-4baa-b4bd-18c83daf5322 tempest-SnapshotMetadataTestJSON-651854129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69.4e4b2693-2f4b-4f08-9efa-54fd139cb47b {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:10:59 devstack sudo[90223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69.4e4b2693-2f4b-4f08-9efa-54fd139cb47b
Apr 28 22:10:59 devstack sudo[90223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:11:00 devstack sudo[90223]: pam_unix(sudo:session): session closed for user root
Apr 28 22:11:00 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4944c26e-254b-4baa-b4bd-18c83daf5322 tempest-SnapshotMetadataTestJSON-651854129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69.4e4b2693-2f4b-4f08-9efa-54fd139cb47b" returned: 0 in 0.559s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:11:00 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4944c26e-254b-4baa-b4bd-18c83daf5322 tempest-SnapshotMetadataTestJSON-651854129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69.info {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:11:00 devstack sudo[90226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69.info
Apr 28 22:11:00 devstack sudo[90226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:11:01 devstack sudo[90226]: pam_unix(sudo:session): session closed for user root
Apr 28 22:11:01 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4944c26e-254b-4baa-b4bd-18c83daf5322 tempest-SnapshotMetadataTestJSON-651854129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69.info" returned: 0 in 0.569s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:11:01 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-4944c26e-254b-4baa-b4bd-18c83daf5322 tempest-SnapshotMetadataTestJSON-651854129 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69.info is being set with open permissions: ugo+rw
Apr 28 22:11:01 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4944c26e-254b-4baa-b4bd-18c83daf5322 tempest-SnapshotMetadataTestJSON-651854129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69.info {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:11:01 devstack sudo[90229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69.info
Apr 28 22:11:01 devstack sudo[90229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:11:01 devstack sudo[90229]: pam_unix(sudo:session): session closed for user root
Apr 28 22:11:01 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4944c26e-254b-4baa-b4bd-18c83daf5322 tempest-SnapshotMetadataTestJSON-651854129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69.info" returned: 0 in 0.637s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:11:01 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-4944c26e-254b-4baa-b4bd-18c83daf5322 tempest-SnapshotMetadataTestJSON-651854129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.075s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:11:01 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-686b90f7-57ce-4f86-a4e9-8980058fbc1d tempest-SnapshotsActionsTest-285904011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.151s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:11:01 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-686b90f7-57ce-4f86-a4e9-8980058fbc1d tempest-SnapshotsActionsTest-285904011 None] Creating offline snapshot d434493c-d012-485f-95ac-e47ae7307b65 of volume 623c783b-a15c-45e5-a63a-1ff893a60ad9 {{(pid=83924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 22:11:01 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-4944c26e-254b-4baa-b4bd-18c83daf5322 tempest-SnapshotMetadataTestJSON-651854129 None] Create snapshot completed successfully
Apr 28 22:11:01 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff7ad98-916d-4560-a568-23ef63dcb136]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:11:01 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-686b90f7-57ce-4f86-a4e9-8980058fbc1d tempest-SnapshotsActionsTest-285904011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:11:01 devstack sudo[90232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9
Apr 28 22:11:01 devstack sudo[90232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:11:02 devstack sudo[90232]: pam_unix(sudo:session): session closed for user root
Apr 28 22:11:02 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-686b90f7-57ce-4f86-a4e9-8980058fbc1d tempest-SnapshotsActionsTest-285904011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9" returned: 0 in 0.734s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:11:02 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-686b90f7-57ce-4f86-a4e9-8980058fbc1d tempest-SnapshotsActionsTest-285904011 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-623c783b-a15c-45e5-a63a-1ff893a60ad9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 22:11:02 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-686b90f7-57ce-4f86-a4e9-8980058fbc1d tempest-SnapshotsActionsTest-285904011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.d434493c-d012-485f-95ac-e47ae7307b65 1G {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:11:02 devstack sudo[90237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.d434493c-d012-485f-95ac-e47ae7307b65 1G
Apr 28 22:11:02 devstack sudo[90237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:11:03 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-86a35525-9693-4c57-96f1-04de41d3b871 tempest-SnapshotMetadataTestJSON-651854129 None] Acquiring lock "cinder-4e4b2693-2f4b-4f08-9efa-54fd139cb47b-delete_snapshot" by "delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:11:03 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-86a35525-9693-4c57-96f1-04de41d3b871 tempest-SnapshotMetadataTestJSON-651854129 None] Lock "cinder-4e4b2693-2f4b-4f08-9efa-54fd139cb47b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:11:03 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-86a35525-9693-4c57-96f1-04de41d3b871 tempest-SnapshotMetadataTestJSON-651854129 None] Acquiring lock "cinder-quobyte-92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69" by "delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:11:03 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-86a35525-9693-4c57-96f1-04de41d3b871 tempest-SnapshotMetadataTestJSON-651854129 None] Lock "cinder-quobyte-92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69" acquired by "delete_snapshot" :: waited 0.021s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:11:03 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-86a35525-9693-4c57-96f1-04de41d3b871 tempest-SnapshotMetadataTestJSON-651854129 None] Acquiring lock "cinder-quobyte-4e4b2693-2f4b-4f08-9efa-54fd139cb47b" by "_delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:11:03 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-86a35525-9693-4c57-96f1-04de41d3b871 tempest-SnapshotMetadataTestJSON-651854129 None] Lock "cinder-quobyte-4e4b2693-2f4b-4f08-9efa-54fd139cb47b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:11:03 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-86a35525-9693-4c57-96f1-04de41d3b871 tempest-SnapshotMetadataTestJSON-651854129 None] Deleting offline snapshot 4e4b2693-2f4b-4f08-9efa-54fd139cb47b of volume 92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69 {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 22:11:03 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-86a35525-9693-4c57-96f1-04de41d3b871 tempest-SnapshotMetadataTestJSON-651854129 None] snapshot_file for this snap is: volume-92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69.4e4b2693-2f4b-4f08-9efa-54fd139cb47b {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 22:11:03 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[462769c0-04c2-4e32-9b7e-939bea033766]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:11:03 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-86a35525-9693-4c57-96f1-04de41d3b871 tempest-SnapshotMetadataTestJSON-651854129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69.4e4b2693-2f4b-4f08-9efa-54fd139cb47b {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:11:03 devstack sudo[90237]: pam_unix(sudo:session): session closed for user root
Apr 28 22:11:03 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-686b90f7-57ce-4f86-a4e9-8980058fbc1d tempest-SnapshotsActionsTest-285904011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.d434493c-d012-485f-95ac-e47ae7307b65 1G" returned: 0 in 0.982s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:11:03 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-686b90f7-57ce-4f86-a4e9-8980058fbc1d tempest-SnapshotsActionsTest-285904011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.d434493c-d012-485f-95ac-e47ae7307b65 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:11:03 devstack sudo[90244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.d434493c-d012-485f-95ac-e47ae7307b65
Apr 28 22:11:03 devstack sudo[90244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:11:03 devstack sudo[90243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69.4e4b2693-2f4b-4f08-9efa-54fd139cb47b
Apr 28 22:11:03 devstack sudo[90243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:11:04 devstack sudo[90243]: pam_unix(sudo:session): session closed for user root
Apr 28 22:11:04 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-86a35525-9693-4c57-96f1-04de41d3b871 tempest-SnapshotMetadataTestJSON-651854129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69.4e4b2693-2f4b-4f08-9efa-54fd139cb47b" returned: 0 in 0.748s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:11:04 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-86a35525-9693-4c57-96f1-04de41d3b871 tempest-SnapshotMetadataTestJSON-651854129 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 22:11:04 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[445deff6-1e50-43a6-9b8d-57abe0ffcb96]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:11:04 devstack sudo[90244]: pam_unix(sudo:session): session closed for user root
Apr 28 22:11:04 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-86a35525-9693-4c57-96f1-04de41d3b871 tempest-SnapshotMetadataTestJSON-651854129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:11:04 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-686b90f7-57ce-4f86-a4e9-8980058fbc1d tempest-SnapshotsActionsTest-285904011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.d434493c-d012-485f-95ac-e47ae7307b65" returned: 0 in 0.729s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:11:04 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-686b90f7-57ce-4f86-a4e9-8980058fbc1d tempest-SnapshotsActionsTest-285904011 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.d434493c-d012-485f-95ac-e47ae7307b65 is being set with open permissions: ugo+rw
Apr 28 22:11:04 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-686b90f7-57ce-4f86-a4e9-8980058fbc1d tempest-SnapshotsActionsTest-285904011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.d434493c-d012-485f-95ac-e47ae7307b65 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:11:04 devstack sudo[90254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.d434493c-d012-485f-95ac-e47ae7307b65
Apr 28 22:11:04 devstack sudo[90254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:11:04 devstack sudo[90253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69
Apr 28 22:11:04 devstack sudo[90253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:11:04 devstack sudo[90254]: pam_unix(sudo:session): session closed for user root
Apr 28 22:11:04 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-686b90f7-57ce-4f86-a4e9-8980058fbc1d tempest-SnapshotsActionsTest-285904011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.d434493c-d012-485f-95ac-e47ae7307b65" returned: 0 in 0.687s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:11:04 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-686b90f7-57ce-4f86-a4e9-8980058fbc1d tempest-SnapshotsActionsTest-285904011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.238s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:11:04 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b0e615f3-a84c-4058-85d4-cdba4a4568c0 tempest-SnapshotDependencyTests-1447044764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.491s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:11:04 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-b0e615f3-a84c-4058-85d4-cdba4a4568c0 tempest-SnapshotDependencyTests-1447044764 None] Acquiring lock "cinder-quobyte-f49ecbd5-ad60-4d90-8255-25a1f8990caf-4db1673a-8b7f-4333-9004-c3434f1e6d73" by "_create_volume_from_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:11:05 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-b0e615f3-a84c-4058-85d4-cdba4a4568c0 tempest-SnapshotDependencyTests-1447044764 None] Lock "cinder-quobyte-f49ecbd5-ad60-4d90-8255-25a1f8990caf-4db1673a-8b7f-4333-9004-c3434f1e6d73" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:11:05 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-b0e615f3-a84c-4058-85d4-cdba4a4568c0 tempest-SnapshotDependencyTests-1447044764 None] Creating volume 4db1673a-8b7f-4333-9004-c3434f1e6d73 from snapshot f49ecbd5-ad60-4d90-8255-25a1f8990caf {{(pid=83924) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 28 22:11:05 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b0e615f3-a84c-4058-85d4-cdba4a4568c0 tempest-SnapshotDependencyTests-1447044764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:11:05 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b0e615f3-a84c-4058-85d4-cdba4a4568c0 tempest-SnapshotDependencyTests-1447044764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:11:05 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-b0e615f3-a84c-4058-85d4-cdba4a4568c0 tempest-SnapshotDependencyTests-1447044764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:11:05 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-b0e615f3-a84c-4058-85d4-cdba4a4568c0 tempest-SnapshotDependencyTests-1447044764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:11:05 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b0e615f3-a84c-4058-85d4-cdba4a4568c0 tempest-SnapshotDependencyTests-1447044764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:11:05 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-b0e615f3-a84c-4058-85d4-cdba4a4568c0 tempest-SnapshotDependencyTests-1447044764 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:11:05 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-b0e615f3-a84c-4058-85d4-cdba4a4568c0 tempest-SnapshotDependencyTests-1447044764 None] Acquiring lock "cinder-quobyte-4db1673a-8b7f-4333-9004-c3434f1e6d73" by "_copy_volume_from_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:11:05 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-686b90f7-57ce-4f86-a4e9-8980058fbc1d tempest-SnapshotsActionsTest-285904011 None] Create snapshot completed successfully
Apr 28 22:11:05 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-b0e615f3-a84c-4058-85d4-cdba4a4568c0 tempest-SnapshotDependencyTests-1447044764 None] Lock "cinder-quobyte-4db1673a-8b7f-4333-9004-c3434f1e6d73" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:11:05 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-b0e615f3-a84c-4058-85d4-cdba4a4568c0 tempest-SnapshotDependencyTests-1447044764 None] snapshot: f49ecbd5-ad60-4d90-8255-25a1f8990caf, volume: 4db1673a-8b7f-4333-9004-c3434f1e6d73,  {{(pid=83924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 28 22:11:05 devstack sudo[90253]: pam_unix(sudo:session): session closed for user root
Apr 28 22:11:05 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b0e615f3-a84c-4058-85d4-cdba4a4568c0 tempest-SnapshotDependencyTests-1447044764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:11:05 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b0e615f3-a84c-4058-85d4-cdba4a4568c0 tempest-SnapshotDependencyTests-1447044764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:11:05 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-b0e615f3-a84c-4058-85d4-cdba4a4568c0 tempest-SnapshotDependencyTests-1447044764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:11:05 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-b0e615f3-a84c-4058-85d4-cdba4a4568c0 tempest-SnapshotDependencyTests-1447044764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:11:05 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b0e615f3-a84c-4058-85d4-cdba4a4568c0 tempest-SnapshotDependencyTests-1447044764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:11:05 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-86a35525-9693-4c57-96f1-04de41d3b871 tempest-SnapshotMetadataTestJSON-651854129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69" returned: 0 in 0.822s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:11:05 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-86a35525-9693-4c57-96f1-04de41d3b871 tempest-SnapshotMetadataTestJSON-651854129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69.4e4b2693-2f4b-4f08-9efa-54fd139cb47b {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:11:05 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc6b762-d6c0-4e8e-a460-9f3127849375]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:11:05 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b0e615f3-a84c-4058-85d4-cdba4a4568c0 tempest-SnapshotDependencyTests-1447044764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0.f49ecbd5-ad60-4d90-8255-25a1f8990caf {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:11:05 devstack sudo[90261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69.4e4b2693-2f4b-4f08-9efa-54fd139cb47b
Apr 28 22:11:05 devstack sudo[90261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:11:05 devstack sudo[90262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0.f49ecbd5-ad60-4d90-8255-25a1f8990caf
Apr 28 22:11:05 devstack sudo[90262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:11:05 devstack sudo[90261]: pam_unix(sudo:session): session closed for user root
Apr 28 22:11:05 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-86a35525-9693-4c57-96f1-04de41d3b871 tempest-SnapshotMetadataTestJSON-651854129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69.4e4b2693-2f4b-4f08-9efa-54fd139cb47b" returned: 0 in 0.733s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:11:05 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-86a35525-9693-4c57-96f1-04de41d3b871 tempest-SnapshotMetadataTestJSON-651854129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69.4e4b2693-2f4b-4f08-9efa-54fd139cb47b {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:11:05 devstack sudo[90271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69.4e4b2693-2f4b-4f08-9efa-54fd139cb47b
Apr 28 22:11:05 devstack sudo[90271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:11:05 devstack sudo[90262]: pam_unix(sudo:session): session closed for user root
Apr 28 22:11:05 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b0e615f3-a84c-4058-85d4-cdba4a4568c0 tempest-SnapshotDependencyTests-1447044764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0.f49ecbd5-ad60-4d90-8255-25a1f8990caf" returned: 0 in 0.781s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:11:05 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-b0e615f3-a84c-4058-85d4-cdba4a4568c0 tempest-SnapshotDependencyTests-1447044764 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 22:11:05 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-b0e615f3-a84c-4058-85d4-cdba4a4568c0 tempest-SnapshotDependencyTests-1447044764 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0 {{(pid=83924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 28 22:11:05 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-b0e615f3-a84c-4058-85d4-cdba4a4568c0 tempest-SnapshotDependencyTests-1447044764 None] Creating direct copy from snapshot {{(pid=83924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 28 22:11:05 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13e0e4a-07d1-4a93-b250-5c025ca18071]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:11:05 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b0e615f3-a84c-4058-85d4-cdba4a4568c0 tempest-SnapshotDependencyTests-1447044764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:11:06 devstack sudo[90273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0
Apr 28 22:11:06 devstack sudo[90273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:11:06 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-0c595c60-8ded-4d60-a57b-d93d65a21724 tempest-SnapshotsActionsTest-568208414 None] Acquiring lock "cinder-d434493c-d012-485f-95ac-e47ae7307b65-delete_snapshot" by "delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:11:06 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-0c595c60-8ded-4d60-a57b-d93d65a21724 tempest-SnapshotsActionsTest-568208414 None] Lock "cinder-d434493c-d012-485f-95ac-e47ae7307b65-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:11:06 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-0c595c60-8ded-4d60-a57b-d93d65a21724 tempest-SnapshotsActionsTest-568208414 None] Acquiring lock "cinder-quobyte-623c783b-a15c-45e5-a63a-1ff893a60ad9" by "delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:11:06 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-0c595c60-8ded-4d60-a57b-d93d65a21724 tempest-SnapshotsActionsTest-568208414 None] Lock "cinder-quobyte-623c783b-a15c-45e5-a63a-1ff893a60ad9" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:11:06 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-0c595c60-8ded-4d60-a57b-d93d65a21724 tempest-SnapshotsActionsTest-568208414 None] Acquiring lock "cinder-quobyte-d434493c-d012-485f-95ac-e47ae7307b65" by "_delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:11:06 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-0c595c60-8ded-4d60-a57b-d93d65a21724 tempest-SnapshotsActionsTest-568208414 None] Lock "cinder-quobyte-d434493c-d012-485f-95ac-e47ae7307b65" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:11:06 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-0c595c60-8ded-4d60-a57b-d93d65a21724 tempest-SnapshotsActionsTest-568208414 None] Deleting offline snapshot d434493c-d012-485f-95ac-e47ae7307b65 of volume 623c783b-a15c-45e5-a63a-1ff893a60ad9 {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 22:11:06 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-0c595c60-8ded-4d60-a57b-d93d65a21724 tempest-SnapshotsActionsTest-568208414 None] snapshot_file for this snap is: volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.d434493c-d012-485f-95ac-e47ae7307b65 {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 22:11:06 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[254dc83e-dccc-44a5-b17d-7b150413869d]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:11:06 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-0c595c60-8ded-4d60-a57b-d93d65a21724 tempest-SnapshotsActionsTest-568208414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.d434493c-d012-485f-95ac-e47ae7307b65 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:11:06 devstack sudo[90275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.d434493c-d012-485f-95ac-e47ae7307b65
Apr 28 22:11:06 devstack sudo[90275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:11:06 devstack sudo[90271]: pam_unix(sudo:session): session closed for user root
Apr 28 22:11:06 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-86a35525-9693-4c57-96f1-04de41d3b871 tempest-SnapshotMetadataTestJSON-651854129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69.4e4b2693-2f4b-4f08-9efa-54fd139cb47b" returned: 0 in 0.661s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:11:06 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-86a35525-9693-4c57-96f1-04de41d3b871 tempest-SnapshotMetadataTestJSON-651854129 None] Lock "cinder-quobyte-4e4b2693-2f4b-4f08-9efa-54fd139cb47b" released by "_delete_snapshot" :: held 3.104s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:11:06 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-86a35525-9693-4c57-96f1-04de41d3b871 tempest-SnapshotMetadataTestJSON-651854129 None] Lock "cinder-quobyte-92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69" released by "delete_snapshot" :: held 3.130s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:11:06 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-86a35525-9693-4c57-96f1-04de41d3b871 tempest-SnapshotMetadataTestJSON-651854129 None] Created reservations ['c21f2abe-5cf2-4bb4-9132-8d7a0b2b8fa1', 'ab8f35e9-9544-4ae1-9785-b58e7f92e3a9', 'e0b406ba-f9c1-4b37-be82-43d4f2457c32', 'a6b9f90b-7a0f-463f-8613-78b95ba3eaef'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:11:06 devstack sudo[90273]: pam_unix(sudo:session): session closed for user root
Apr 28 22:11:06 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b0e615f3-a84c-4058-85d4-cdba4a4568c0 tempest-SnapshotDependencyTests-1447044764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0" returned: 0 in 0.788s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:11:06 devstack cinder-volume[83924]: DEBUG cinder.utils [None req-b0e615f3-a84c-4058-85d4-cdba4a4568c0 tempest-SnapshotDependencyTests-1447044764 None] Path /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-4db1673a-8b7f-4333-9004-c3434f1e6d73 not found in is_blk_device check {{(pid=83924) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 28 22:11:06 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b0e615f3-a84c-4058-85d4-cdba4a4568c0 tempest-SnapshotDependencyTests-1447044764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-4db1673a-8b7f-4333-9004-c3434f1e6d73 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:11:06 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-86a35525-9693-4c57-96f1-04de41d3b871 tempest-SnapshotMetadataTestJSON-651854129 None] Delete snapshot completed successfully.
Apr 28 22:11:06 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-86a35525-9693-4c57-96f1-04de41d3b871 tempest-SnapshotMetadataTestJSON-651854129 None] Lock "cinder-4e4b2693-2f4b-4f08-9efa-54fd139cb47b-delete_snapshot" released by "delete_snapshot" :: held 3.328s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:11:06 devstack sudo[90282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-4db1673a-8b7f-4333-9004-c3434f1e6d73
Apr 28 22:11:06 devstack sudo[90282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:11:06 devstack sudo[90275]: pam_unix(sudo:session): session closed for user root
Apr 28 22:11:06 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-0c595c60-8ded-4d60-a57b-d93d65a21724 tempest-SnapshotsActionsTest-568208414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.d434493c-d012-485f-95ac-e47ae7307b65" returned: 0 in 0.806s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:11:06 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-0c595c60-8ded-4d60-a57b-d93d65a21724 tempest-SnapshotsActionsTest-568208414 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-623c783b-a15c-45e5-a63a-1ff893a60ad9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 22:11:06 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cde0b53-8ad6-4279-a596-33c89ba65691]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:11:06 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-0c595c60-8ded-4d60-a57b-d93d65a21724 tempest-SnapshotsActionsTest-568208414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:11:07 devstack sudo[90287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9
Apr 28 22:11:07 devstack sudo[90287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:11:07 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-27150701-cfc4-47fa-9b8a-526e15468471 tempest-SnapshotMetadataTestJSON-651854129 None] Acquiring lock "cinder-92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:11:07 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-27150701-cfc4-47fa-9b8a-526e15468471 tempest-SnapshotMetadataTestJSON-651854129 None] Lock "cinder-92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:11:07 devstack sudo[90287]: pam_unix(sudo:session): session closed for user root
Apr 28 22:11:07 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-0c595c60-8ded-4d60-a57b-d93d65a21724 tempest-SnapshotsActionsTest-568208414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9" returned: 0 in 0.987s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:11:07 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-0c595c60-8ded-4d60-a57b-d93d65a21724 tempest-SnapshotsActionsTest-568208414 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-623c783b-a15c-45e5-a63a-1ff893a60ad9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 22:11:07 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-0c595c60-8ded-4d60-a57b-d93d65a21724 tempest-SnapshotsActionsTest-568208414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.d434493c-d012-485f-95ac-e47ae7307b65 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:11:08 devstack sudo[90303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.d434493c-d012-485f-95ac-e47ae7307b65
Apr 28 22:11:08 devstack sudo[90303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:11:08 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-27150701-cfc4-47fa-9b8a-526e15468471 tempest-SnapshotMetadataTestJSON-651854129 None] Acquiring lock "cinder-quobyte-92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:11:08 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-27150701-cfc4-47fa-9b8a-526e15468471 tempest-SnapshotMetadataTestJSON-651854129 None] Lock "cinder-quobyte-92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69" acquired by "delete_volume" :: waited 0.023s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:11:08 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b526a30c-35e7-416f-a2c0-8fc71e30287b]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:11:08 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-27150701-cfc4-47fa-9b8a-526e15468471 tempest-SnapshotMetadataTestJSON-651854129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:11:08 devstack sudo[90305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69
Apr 28 22:11:08 devstack sudo[90305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:11:09 devstack sudo[90305]: pam_unix(sudo:session): session closed for user root
Apr 28 22:11:09 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-27150701-cfc4-47fa-9b8a-526e15468471 tempest-SnapshotMetadataTestJSON-651854129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69" returned: 0 in 1.229s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:11:09 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-27150701-cfc4-47fa-9b8a-526e15468471 tempest-SnapshotMetadataTestJSON-651854129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:11:09 devstack sudo[90310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69
Apr 28 22:11:09 devstack sudo[90310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:11:10 devstack sudo[90310]: pam_unix(sudo:session): session closed for user root
Apr 28 22:11:10 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-27150701-cfc4-47fa-9b8a-526e15468471 tempest-SnapshotMetadataTestJSON-651854129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69" returned: 0 in 1.081s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:11:10 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-27150701-cfc4-47fa-9b8a-526e15468471 tempest-SnapshotMetadataTestJSON-651854129 None] Lock "cinder-quobyte-92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69" released by "delete_volume" :: held 2.466s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:11:10 devstack sudo[90303]: pam_unix(sudo:session): session closed for user root
Apr 28 22:11:10 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-0c595c60-8ded-4d60-a57b-d93d65a21724 tempest-SnapshotsActionsTest-568208414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.d434493c-d012-485f-95ac-e47ae7307b65" returned: 0 in 2.612s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:11:10 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-0c595c60-8ded-4d60-a57b-d93d65a21724 tempest-SnapshotsActionsTest-568208414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.d434493c-d012-485f-95ac-e47ae7307b65 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:11:10 devstack sudo[90316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.d434493c-d012-485f-95ac-e47ae7307b65
Apr 28 22:11:10 devstack sudo[90316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:11:10 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-27150701-cfc4-47fa-9b8a-526e15468471 tempest-SnapshotMetadataTestJSON-651854129 None] Created reservations ['68754bb3-c579-4c35-a6e0-20fb1bc8bc11', 'f2bedb13-6be6-4aca-b01d-835561ea3204', '7795362d-0a22-431c-b581-0400b85c405a', '0f7abbfe-d7bf-4d01-8b95-f4432fa913a6'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:11:10 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-27150701-cfc4-47fa-9b8a-526e15468471 tempest-SnapshotMetadataTestJSON-651854129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:11:10 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-27150701-cfc4-47fa-9b8a-526e15468471 tempest-SnapshotMetadataTestJSON-651854129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:11:10 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-27150701-cfc4-47fa-9b8a-526e15468471 tempest-SnapshotMetadataTestJSON-651854129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:11:10 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-27150701-cfc4-47fa-9b8a-526e15468471 tempest-SnapshotMetadataTestJSON-651854129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:11:10 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-27150701-cfc4-47fa-9b8a-526e15468471 tempest-SnapshotMetadataTestJSON-651854129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:11:10 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-27150701-cfc4-47fa-9b8a-526e15468471 tempest-SnapshotMetadataTestJSON-651854129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:11:10 devstack sudo[90318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:11:10 devstack sudo[90318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:11:11 devstack sudo[90318]: pam_unix(sudo:session): session closed for user root
Apr 28 22:11:12 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-27150701-cfc4-47fa-9b8a-526e15468471 tempest-SnapshotMetadataTestJSON-651854129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 1.109s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:11:12 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-27150701-cfc4-47fa-9b8a-526e15468471 tempest-SnapshotMetadataTestJSON-651854129 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:11:12 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-27150701-cfc4-47fa-9b8a-526e15468471 tempest-SnapshotMetadataTestJSON-651854129 None] Deleted volume successfully.
Apr 28 22:11:12 devstack sudo[90316]: pam_unix(sudo:session): session closed for user root
Apr 28 22:11:12 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-27150701-cfc4-47fa-9b8a-526e15468471 tempest-SnapshotMetadataTestJSON-651854129 None] Lock "cinder-92b3f6cd-cb0d-46e2-b6d0-9c5b752f7d69-delete_volume" released by "delete_volume" :: held 4.164s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:11:12 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-0c595c60-8ded-4d60-a57b-d93d65a21724 tempest-SnapshotsActionsTest-568208414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.d434493c-d012-485f-95ac-e47ae7307b65" returned: 0 in 1.485s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:11:12 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-0c595c60-8ded-4d60-a57b-d93d65a21724 tempest-SnapshotsActionsTest-568208414 None] Lock "cinder-quobyte-d434493c-d012-485f-95ac-e47ae7307b65" released by "_delete_snapshot" :: held 6.008s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:11:12 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-0c595c60-8ded-4d60-a57b-d93d65a21724 tempest-SnapshotsActionsTest-568208414 None] Lock "cinder-quobyte-623c783b-a15c-45e5-a63a-1ff893a60ad9" released by "delete_snapshot" :: held 6.044s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:11:12 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-0c595c60-8ded-4d60-a57b-d93d65a21724 tempest-SnapshotsActionsTest-568208414 None] Created reservations ['e38ea2c4-234c-48c7-afce-55a9d15c3df9', 'cb519056-d31e-4019-a9e3-b7aaa1c5e48d', '483ffddc-fb36-42dd-bb4a-beabc97c3c57', 'd95770c8-dbd3-4d68-942d-24a8b7cde7c7'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:11:12 devstack sudo[90282]: pam_unix(sudo:session): session closed for user root
Apr 28 22:11:12 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b0e615f3-a84c-4058-85d4-cdba4a4568c0 tempest-SnapshotDependencyTests-1447044764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-4db1673a-8b7f-4333-9004-c3434f1e6d73" returned: 0 in 5.566s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:11:12 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[7048a204-bdf2-47b7-a4fa-d9d2b40fcf98]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:11:12 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b0e615f3-a84c-4058-85d4-cdba4a4568c0 tempest-SnapshotDependencyTests-1447044764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:11:12 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-0c595c60-8ded-4d60-a57b-d93d65a21724 tempest-SnapshotsActionsTest-568208414 None] Delete snapshot completed successfully.
Apr 28 22:11:12 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-0c595c60-8ded-4d60-a57b-d93d65a21724 tempest-SnapshotsActionsTest-568208414 None] Lock "cinder-d434493c-d012-485f-95ac-e47ae7307b65-delete_snapshot" released by "delete_snapshot" :: held 6.212s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:11:12 devstack sudo[90322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0
Apr 28 22:11:12 devstack sudo[90322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:11:12 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b28ab0d3-c56a-4062-befc-688ebf3204ee tempest-SnapshotsActionsTest-285904011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:11:13 devstack sudo[90322]: pam_unix(sudo:session): session closed for user root
Apr 28 22:11:13 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b0e615f3-a84c-4058-85d4-cdba4a4568c0 tempest-SnapshotDependencyTests-1447044764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0" returned: 0 in 0.964s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:11:13 devstack cinder-volume[83924]: DEBUG cinder.image.image_utils [None req-b0e615f3-a84c-4058-85d4-cdba4a4568c0 tempest-SnapshotDependencyTests-1447044764 None] Image conversion details: src /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0, size 1024.00 MB, duration 5.57 sec, destination /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-4db1673a-8b7f-4333-9004-c3434f1e6d73 {{(pid=83924) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 28 22:11:13 devstack cinder-volume[83924]: INFO cinder.image.image_utils [None req-b0e615f3-a84c-4058-85d4-cdba4a4568c0 tempest-SnapshotDependencyTests-1447044764 None] Converted 1024.00 MB image at 183.94 MB/s
Apr 28 22:11:13 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-b0e615f3-a84c-4058-85d4-cdba4a4568c0 tempest-SnapshotDependencyTests-1447044764 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-4db1673a-8b7f-4333-9004-c3434f1e6d73 is being set with open permissions: ugo+rw
Apr 28 22:11:13 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b0e615f3-a84c-4058-85d4-cdba4a4568c0 tempest-SnapshotDependencyTests-1447044764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-4db1673a-8b7f-4333-9004-c3434f1e6d73 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:11:13 devstack sudo[90329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-4db1673a-8b7f-4333-9004-c3434f1e6d73
Apr 28 22:11:13 devstack sudo[90329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:11:13 devstack sudo[90329]: pam_unix(sudo:session): session closed for user root
Apr 28 22:11:13 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b0e615f3-a84c-4058-85d4-cdba4a4568c0 tempest-SnapshotDependencyTests-1447044764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-4db1673a-8b7f-4333-9004-c3434f1e6d73" returned: 0 in 0.635s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:11:13 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-b0e615f3-a84c-4058-85d4-cdba4a4568c0 tempest-SnapshotDependencyTests-1447044764 None] Lock "cinder-quobyte-4db1673a-8b7f-4333-9004-c3434f1e6d73" released by "_copy_volume_from_snapshot" :: held 8.843s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:11:13 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-b0e615f3-a84c-4058-85d4-cdba4a4568c0 tempest-SnapshotDependencyTests-1447044764 None] Lock "cinder-quobyte-f49ecbd5-ad60-4d90-8255-25a1f8990caf-4db1673a-8b7f-4333-9004-c3434f1e6d73" released by "_create_volume_from_snapshot" :: held 8.886s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:11:13 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b0e615f3-a84c-4058-85d4-cdba4a4568c0 tempest-SnapshotDependencyTests-1447044764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.909s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:11:13 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b28ab0d3-c56a-4062-befc-688ebf3204ee tempest-SnapshotsActionsTest-285904011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.012s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:11:13 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-b28ab0d3-c56a-4062-befc-688ebf3204ee tempest-SnapshotsActionsTest-285904011 None] Creating offline snapshot 45146878-515f-44cf-bce4-7905249d7a54 of volume 623c783b-a15c-45e5-a63a-1ff893a60ad9 {{(pid=83924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 22:11:13 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b0e615f3-a84c-4058-85d4-cdba4a4568c0 tempest-SnapshotDependencyTests-1447044764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (187b6c58-35ca-4640-b2c3-4a4a9c66c9d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4db1673a-8b7f-4333-9004-c3434f1e6d73', 'volume_size': 1, 'snapshot_id': 'f49ecbd5-ad60-4d90-8255-25a1f8990caf'}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:11:13 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b0e615f3-a84c-4058-85d4-cdba4a4568c0 tempest-SnapshotDependencyTests-1447044764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cad74e9-9185-4d3b-9a02-6eb708f60d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:11:14 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[eecabdb0-3cbc-4faf-819b-7956d4c724f8]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:11:14 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b28ab0d3-c56a-4062-befc-688ebf3204ee tempest-SnapshotsActionsTest-285904011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:11:14 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-b0e615f3-a84c-4058-85d4-cdba4a4568c0 tempest-SnapshotDependencyTests-1447044764 None] Volume volume-4db1673a-8b7f-4333-9004-c3434f1e6d73 (4db1673a-8b7f-4333-9004-c3434f1e6d73): created successfully
Apr 28 22:11:14 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b0e615f3-a84c-4058-85d4-cdba4a4568c0 tempest-SnapshotDependencyTests-1447044764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cad74e9-9185-4d3b-9a02-6eb708f60d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:11:14 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b0e615f3-a84c-4058-85d4-cdba4a4568c0 tempest-SnapshotDependencyTests-1447044764 None] Flow 'volume_create_manager' (b98a6a57-5fa2-4100-83a4-e0ce2163088b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:11:14 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-b0e615f3-a84c-4058-85d4-cdba4a4568c0 tempest-SnapshotDependencyTests-1447044764 None] Created volume successfully.
Apr 28 22:11:14 devstack sudo[90332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9
Apr 28 22:11:14 devstack sudo[90332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:11:14 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-a90790e2-df0c-4166-82b4-a2c0c1607594 tempest-SnapshotDependencyTests-1447044764 None] Acquiring lock "cinder-f49ecbd5-ad60-4d90-8255-25a1f8990caf-delete_snapshot" by "delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:11:14 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-a90790e2-df0c-4166-82b4-a2c0c1607594 tempest-SnapshotDependencyTests-1447044764 None] Lock "cinder-f49ecbd5-ad60-4d90-8255-25a1f8990caf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:11:14 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-a90790e2-df0c-4166-82b4-a2c0c1607594 tempest-SnapshotDependencyTests-1447044764 None] Acquiring lock "cinder-quobyte-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0" by "delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:11:14 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-a90790e2-df0c-4166-82b4-a2c0c1607594 tempest-SnapshotDependencyTests-1447044764 None] Lock "cinder-quobyte-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0" acquired by "delete_snapshot" :: waited 0.020s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:11:14 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-a90790e2-df0c-4166-82b4-a2c0c1607594 tempest-SnapshotDependencyTests-1447044764 None] Acquiring lock "cinder-quobyte-f49ecbd5-ad60-4d90-8255-25a1f8990caf" by "_delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:11:14 devstack sudo[90332]: pam_unix(sudo:session): session closed for user root
Apr 28 22:11:14 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b28ab0d3-c56a-4062-befc-688ebf3204ee tempest-SnapshotsActionsTest-285904011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9" returned: 0 in 0.914s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:11:14 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-b28ab0d3-c56a-4062-befc-688ebf3204ee tempest-SnapshotsActionsTest-285904011 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-623c783b-a15c-45e5-a63a-1ff893a60ad9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 22:11:14 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b28ab0d3-c56a-4062-befc-688ebf3204ee tempest-SnapshotsActionsTest-285904011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.45146878-515f-44cf-bce4-7905249d7a54 1G {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:11:14 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-a90790e2-df0c-4166-82b4-a2c0c1607594 tempest-SnapshotDependencyTests-1447044764 None] Lock "cinder-quobyte-f49ecbd5-ad60-4d90-8255-25a1f8990caf" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:11:14 devstack sudo[90337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.45146878-515f-44cf-bce4-7905249d7a54 1G
Apr 28 22:11:14 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-a90790e2-df0c-4166-82b4-a2c0c1607594 tempest-SnapshotDependencyTests-1447044764 None] Deleting offline snapshot f49ecbd5-ad60-4d90-8255-25a1f8990caf of volume 57af7fe1-0af2-4602-a3e0-d0ec1aa784f0 {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 22:11:14 devstack sudo[90337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:11:14 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-a90790e2-df0c-4166-82b4-a2c0c1607594 tempest-SnapshotDependencyTests-1447044764 None] snapshot_file for this snap is: volume-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0.f49ecbd5-ad60-4d90-8255-25a1f8990caf {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 22:11:14 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef9ffa2-c363-4e29-90cb-d7ad243cfc2c]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:11:14 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a90790e2-df0c-4166-82b4-a2c0c1607594 tempest-SnapshotDependencyTests-1447044764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0.f49ecbd5-ad60-4d90-8255-25a1f8990caf {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:11:15 devstack sudo[90339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0.f49ecbd5-ad60-4d90-8255-25a1f8990caf
Apr 28 22:11:15 devstack sudo[90339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:11:15 devstack sudo[90339]: pam_unix(sudo:session): session closed for user root
Apr 28 22:11:15 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a90790e2-df0c-4166-82b4-a2c0c1607594 tempest-SnapshotDependencyTests-1447044764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0.f49ecbd5-ad60-4d90-8255-25a1f8990caf" returned: 0 in 0.828s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:11:15 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-a90790e2-df0c-4166-82b4-a2c0c1607594 tempest-SnapshotDependencyTests-1447044764 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 22:11:15 devstack sudo[90337]: pam_unix(sudo:session): session closed for user root
Apr 28 22:11:15 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b28ab0d3-c56a-4062-befc-688ebf3204ee tempest-SnapshotsActionsTest-285904011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.45146878-515f-44cf-bce4-7905249d7a54 1G" returned: 0 in 0.959s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:11:15 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b28ab0d3-c56a-4062-befc-688ebf3204ee tempest-SnapshotsActionsTest-285904011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.45146878-515f-44cf-bce4-7905249d7a54 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:11:15 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1525531b-8d3f-4eb6-af64-526fc4e4c86b]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:11:15 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a90790e2-df0c-4166-82b4-a2c0c1607594 tempest-SnapshotDependencyTests-1447044764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:11:15 devstack sudo[90348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.45146878-515f-44cf-bce4-7905249d7a54
Apr 28 22:11:15 devstack sudo[90348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:11:15 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca8b49f4-ad64-46d7-bd29-d921fd40ddc7 tempest-AbsoluteLimitsTests-1685046059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:11:16 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-ca8b49f4-ad64-46d7-bd29-d921fd40ddc7 tempest-AbsoluteLimitsTests-1685046059 None] Flow 'volume_create_manager' (202e72a3-4577-47b9-b719-a4ec73816503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:11:16 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-ca8b49f4-ad64-46d7-bd29-d921fd40ddc7 tempest-AbsoluteLimitsTests-1685046059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (813e3c27-8d63-48bd-b4e9-6036df14c4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:11:16 devstack sudo[90349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0
Apr 28 22:11:16 devstack sudo[90349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:11:16 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-ca8b49f4-ad64-46d7-bd29-d921fd40ddc7 tempest-AbsoluteLimitsTests-1685046059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (813e3c27-8d63-48bd-b4e9-6036df14c4c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:11:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-573593948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b19aec69-830d-497d-ba79-4fedf70ce303,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa0fda5ae7924a24a488ce51cc1577c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:11:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:11:16Z,use_quota=True,user_id='d21259d5173044589374c8c28572b8c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:11:16 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-ca8b49f4-ad64-46d7-bd29-d921fd40ddc7 tempest-AbsoluteLimitsTests-1685046059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a50542b-dbfa-444c-a1e5-69e8e00f5e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:11:16 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-ca8b49f4-ad64-46d7-bd29-d921fd40ddc7 tempest-AbsoluteLimitsTests-1685046059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a50542b-dbfa-444c-a1e5-69e8e00f5e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:11:16 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-ca8b49f4-ad64-46d7-bd29-d921fd40ddc7 tempest-AbsoluteLimitsTests-1685046059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40d45251-97c6-4c00-a048-d2834cef7d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:11:16 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-ca8b49f4-ad64-46d7-bd29-d921fd40ddc7 tempest-AbsoluteLimitsTests-1685046059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40d45251-97c6-4c00-a048-d2834cef7d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b19aec69-830d-497d-ba79-4fedf70ce303', 'volume_name': 'volume-b19aec69-830d-497d-ba79-4fedf70ce303', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:11:16 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-ca8b49f4-ad64-46d7-bd29-d921fd40ddc7 tempest-AbsoluteLimitsTests-1685046059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b2f8a8e-f949-4ecf-baa8-289d639e5f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:11:16 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-ca8b49f4-ad64-46d7-bd29-d921fd40ddc7 tempest-AbsoluteLimitsTests-1685046059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b2f8a8e-f949-4ecf-baa8-289d639e5f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:11:16 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-ca8b49f4-ad64-46d7-bd29-d921fd40ddc7 tempest-AbsoluteLimitsTests-1685046059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97abdb02-933a-4621-b180-9d883a6ef160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:11:16 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-ca8b49f4-ad64-46d7-bd29-d921fd40ddc7 tempest-AbsoluteLimitsTests-1685046059 None] Volume b19aec69-830d-497d-ba79-4fedf70ce303: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b19aec69-830d-497d-ba79-4fedf70ce303', 'volume_size': 1}
Apr 28 22:11:16 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-ca8b49f4-ad64-46d7-bd29-d921fd40ddc7 tempest-AbsoluteLimitsTests-1685046059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:11:16 devstack sudo[90348]: pam_unix(sudo:session): session closed for user root
Apr 28 22:11:16 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b28ab0d3-c56a-4062-befc-688ebf3204ee tempest-SnapshotsActionsTest-285904011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.45146878-515f-44cf-bce4-7905249d7a54" returned: 0 in 0.650s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:11:16 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-b28ab0d3-c56a-4062-befc-688ebf3204ee tempest-SnapshotsActionsTest-285904011 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.45146878-515f-44cf-bce4-7905249d7a54 is being set with open permissions: ugo+rw
Apr 28 22:11:16 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b28ab0d3-c56a-4062-befc-688ebf3204ee tempest-SnapshotsActionsTest-285904011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.45146878-515f-44cf-bce4-7905249d7a54 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:11:16 devstack sudo[90355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.45146878-515f-44cf-bce4-7905249d7a54
Apr 28 22:11:16 devstack sudo[90355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:11:16 devstack sudo[90349]: pam_unix(sudo:session): session closed for user root
Apr 28 22:11:16 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a90790e2-df0c-4166-82b4-a2c0c1607594 tempest-SnapshotDependencyTests-1447044764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0" returned: 0 in 0.774s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:11:16 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a90790e2-df0c-4166-82b4-a2c0c1607594 tempest-SnapshotDependencyTests-1447044764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0.f49ecbd5-ad60-4d90-8255-25a1f8990caf {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:11:16 devstack sudo[90360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0.f49ecbd5-ad60-4d90-8255-25a1f8990caf
Apr 28 22:11:16 devstack sudo[90360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:11:17 devstack sudo[90355]: pam_unix(sudo:session): session closed for user root
Apr 28 22:11:17 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b28ab0d3-c56a-4062-befc-688ebf3204ee tempest-SnapshotsActionsTest-285904011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.45146878-515f-44cf-bce4-7905249d7a54" returned: 0 in 0.599s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:11:17 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b28ab0d3-c56a-4062-befc-688ebf3204ee tempest-SnapshotsActionsTest-285904011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.246s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:11:17 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-ca8b49f4-ad64-46d7-bd29-d921fd40ddc7 tempest-AbsoluteLimitsTests-1685046059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.070s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:11:17 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-ca8b49f4-ad64-46d7-bd29-d921fd40ddc7 tempest-AbsoluteLimitsTests-1685046059 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:11:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-573593948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b19aec69-830d-497d-ba79-4fedf70ce303,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa0fda5ae7924a24a488ce51cc1577c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:11:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:11:16Z,use_quota=True,user_id='d21259d5173044589374c8c28572b8c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:11:17 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-ca8b49f4-ad64-46d7-bd29-d921fd40ddc7 tempest-AbsoluteLimitsTests-1685046059 None] Creating volume b19aec69-830d-497d-ba79-4fedf70ce303 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:11:17 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-ca8b49f4-ad64-46d7-bd29-d921fd40ddc7 tempest-AbsoluteLimitsTests-1685046059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:11:17 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-ca8b49f4-ad64-46d7-bd29-d921fd40ddc7 tempest-AbsoluteLimitsTests-1685046059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:11:17 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-ca8b49f4-ad64-46d7-bd29-d921fd40ddc7 tempest-AbsoluteLimitsTests-1685046059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:11:17 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-ca8b49f4-ad64-46d7-bd29-d921fd40ddc7 tempest-AbsoluteLimitsTests-1685046059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:11:17 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-ca8b49f4-ad64-46d7-bd29-d921fd40ddc7 tempest-AbsoluteLimitsTests-1685046059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:11:17 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-ca8b49f4-ad64-46d7-bd29-d921fd40ddc7 tempest-AbsoluteLimitsTests-1685046059 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:11:17 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-ca8b49f4-ad64-46d7-bd29-d921fd40ddc7 tempest-AbsoluteLimitsTests-1685046059 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:11:17 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-ca8b49f4-ad64-46d7-bd29-d921fd40ddc7 tempest-AbsoluteLimitsTests-1685046059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b19aec69-830d-497d-ba79-4fedf70ce303 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:11:17 devstack sudo[90363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b19aec69-830d-497d-ba79-4fedf70ce303 1073741824
Apr 28 22:11:17 devstack sudo[90363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:11:17 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-b28ab0d3-c56a-4062-befc-688ebf3204ee tempest-SnapshotsActionsTest-285904011 None] Create snapshot completed successfully
Apr 28 22:11:17 devstack sudo[90360]: pam_unix(sudo:session): session closed for user root
Apr 28 22:11:17 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a90790e2-df0c-4166-82b4-a2c0c1607594 tempest-SnapshotDependencyTests-1447044764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0.f49ecbd5-ad60-4d90-8255-25a1f8990caf" returned: 0 in 0.730s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:11:17 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a90790e2-df0c-4166-82b4-a2c0c1607594 tempest-SnapshotDependencyTests-1447044764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0.f49ecbd5-ad60-4d90-8255-25a1f8990caf {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:11:17 devstack sudo[90368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0.f49ecbd5-ad60-4d90-8255-25a1f8990caf
Apr 28 22:11:17 devstack sudo[90368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:11:18 devstack sudo[90368]: pam_unix(sudo:session): session closed for user root
Apr 28 22:11:18 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a90790e2-df0c-4166-82b4-a2c0c1607594 tempest-SnapshotDependencyTests-1447044764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0.f49ecbd5-ad60-4d90-8255-25a1f8990caf" returned: 0 in 0.615s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:11:18 devstack sudo[90363]: pam_unix(sudo:session): session closed for user root
Apr 28 22:11:18 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-ca8b49f4-ad64-46d7-bd29-d921fd40ddc7 tempest-AbsoluteLimitsTests-1685046059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b19aec69-830d-497d-ba79-4fedf70ce303 1073741824" returned: 0 in 0.863s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:11:18 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-a90790e2-df0c-4166-82b4-a2c0c1607594 tempest-SnapshotDependencyTests-1447044764 None] Lock "cinder-quobyte-f49ecbd5-ad60-4d90-8255-25a1f8990caf" released by "_delete_snapshot" :: held 3.149s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:11:18 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-a90790e2-df0c-4166-82b4-a2c0c1607594 tempest-SnapshotDependencyTests-1447044764 None] Lock "cinder-quobyte-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0" released by "delete_snapshot" :: held 3.193s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:11:18 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-ca8b49f4-ad64-46d7-bd29-d921fd40ddc7 tempest-AbsoluteLimitsTests-1685046059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b19aec69-830d-497d-ba79-4fedf70ce303 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:11:18 devstack sudo[90375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b19aec69-830d-497d-ba79-4fedf70ce303
Apr 28 22:11:18 devstack sudo[90375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:11:18 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-a90790e2-df0c-4166-82b4-a2c0c1607594 tempest-SnapshotDependencyTests-1447044764 None] Created reservations ['9b619bb2-6bd2-4518-89fc-04188cfddc26', '303df15c-539e-467f-b2a9-76b0d811b2de', '069c147e-acfd-4156-9030-3ce98148952f', '2541d0d1-c8b5-4bfc-81ff-5a5260838ab7'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:11:18 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-2da8235b-ae06-4be2-a59f-b7d5272814d9 tempest-SnapshotsActionsTest-568208414 None] Acquiring lock "cinder-45146878-515f-44cf-bce4-7905249d7a54-delete_snapshot" by "delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:11:18 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-a90790e2-df0c-4166-82b4-a2c0c1607594 tempest-SnapshotDependencyTests-1447044764 None] Delete snapshot completed successfully.
Apr 28 22:11:18 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-a90790e2-df0c-4166-82b4-a2c0c1607594 tempest-SnapshotDependencyTests-1447044764 None] Lock "cinder-f49ecbd5-ad60-4d90-8255-25a1f8990caf-delete_snapshot" released by "delete_snapshot" :: held 3.395s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:11:18 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-2da8235b-ae06-4be2-a59f-b7d5272814d9 tempest-SnapshotsActionsTest-568208414 None] Lock "cinder-45146878-515f-44cf-bce4-7905249d7a54-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:11:18 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-2da8235b-ae06-4be2-a59f-b7d5272814d9 tempest-SnapshotsActionsTest-568208414 None] Acquiring lock "cinder-quobyte-623c783b-a15c-45e5-a63a-1ff893a60ad9" by "delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:11:18 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-2da8235b-ae06-4be2-a59f-b7d5272814d9 tempest-SnapshotsActionsTest-568208414 None] Lock "cinder-quobyte-623c783b-a15c-45e5-a63a-1ff893a60ad9" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:11:18 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-2da8235b-ae06-4be2-a59f-b7d5272814d9 tempest-SnapshotsActionsTest-568208414 None] Acquiring lock "cinder-quobyte-45146878-515f-44cf-bce4-7905249d7a54" by "_delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:11:18 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-2da8235b-ae06-4be2-a59f-b7d5272814d9 tempest-SnapshotsActionsTest-568208414 None] Lock "cinder-quobyte-45146878-515f-44cf-bce4-7905249d7a54" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:11:18 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-2da8235b-ae06-4be2-a59f-b7d5272814d9 tempest-SnapshotsActionsTest-568208414 None] Deleting offline snapshot 45146878-515f-44cf-bce4-7905249d7a54 of volume 623c783b-a15c-45e5-a63a-1ff893a60ad9 {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 22:11:18 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-2da8235b-ae06-4be2-a59f-b7d5272814d9 tempest-SnapshotsActionsTest-568208414 None] snapshot_file for this snap is: volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.45146878-515f-44cf-bce4-7905249d7a54 {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 22:11:18 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[55bcbd05-ef1f-4d17-a1fd-6c310bbd5271]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:11:18 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-2da8235b-ae06-4be2-a59f-b7d5272814d9 tempest-SnapshotsActionsTest-568208414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.45146878-515f-44cf-bce4-7905249d7a54 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:11:18 devstack sudo[90377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.45146878-515f-44cf-bce4-7905249d7a54
Apr 28 22:11:18 devstack sudo[90377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:11:18 devstack sudo[90375]: pam_unix(sudo:session): session closed for user root
Apr 28 22:11:18 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-ca8b49f4-ad64-46d7-bd29-d921fd40ddc7 tempest-AbsoluteLimitsTests-1685046059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b19aec69-830d-497d-ba79-4fedf70ce303" returned: 0 in 0.642s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:11:18 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-ca8b49f4-ad64-46d7-bd29-d921fd40ddc7 tempest-AbsoluteLimitsTests-1685046059 None] <== create_volume: return (1604ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:11:18 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-ca8b49f4-ad64-46d7-bd29-d921fd40ddc7 tempest-AbsoluteLimitsTests-1685046059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.608s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:11:18 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-ca8b49f4-ad64-46d7-bd29-d921fd40ddc7 tempest-AbsoluteLimitsTests-1685046059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97abdb02-933a-4621-b180-9d883a6ef160) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b19aec69-830d-497d-ba79-4fedf70ce303', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:11:18 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-ca8b49f4-ad64-46d7-bd29-d921fd40ddc7 tempest-AbsoluteLimitsTests-1685046059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (125a061f-fc5e-411c-8468-800fdd878ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:11:18 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-ca8b49f4-ad64-46d7-bd29-d921fd40ddc7 tempest-AbsoluteLimitsTests-1685046059 None] Volume volume-b19aec69-830d-497d-ba79-4fedf70ce303 (b19aec69-830d-497d-ba79-4fedf70ce303): created successfully
Apr 28 22:11:18 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-ca8b49f4-ad64-46d7-bd29-d921fd40ddc7 tempest-AbsoluteLimitsTests-1685046059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (125a061f-fc5e-411c-8468-800fdd878ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:11:18 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-ca8b49f4-ad64-46d7-bd29-d921fd40ddc7 tempest-AbsoluteLimitsTests-1685046059 None] Flow 'volume_create_manager' (202e72a3-4577-47b9-b719-a4ec73816503) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:11:18 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-ca8b49f4-ad64-46d7-bd29-d921fd40ddc7 tempest-AbsoluteLimitsTests-1685046059 None] Created volume successfully.
Apr 28 22:11:19 devstack sudo[90377]: pam_unix(sudo:session): session closed for user root
Apr 28 22:11:19 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-2da8235b-ae06-4be2-a59f-b7d5272814d9 tempest-SnapshotsActionsTest-568208414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.45146878-515f-44cf-bce4-7905249d7a54" returned: 0 in 0.797s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:11:19 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-2da8235b-ae06-4be2-a59f-b7d5272814d9 tempest-SnapshotsActionsTest-568208414 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-623c783b-a15c-45e5-a63a-1ff893a60ad9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 22:11:19 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-763887a0-47dc-4bb9-890a-65a011642f4c tempest-SnapshotDependencyTests-1447044764 None] Acquiring lock "cinder-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:11:19 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc536d5-fdae-471f-b1aa-4e39d9b73d03]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:11:19 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-2da8235b-ae06-4be2-a59f-b7d5272814d9 tempest-SnapshotsActionsTest-568208414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:11:19 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-763887a0-47dc-4bb9-890a-65a011642f4c tempest-SnapshotDependencyTests-1447044764 None] Lock "cinder-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:11:19 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-763887a0-47dc-4bb9-890a-65a011642f4c tempest-SnapshotDependencyTests-1447044764 None] Acquiring lock "cinder-quobyte-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:11:19 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-763887a0-47dc-4bb9-890a-65a011642f4c tempest-SnapshotDependencyTests-1447044764 None] Lock "cinder-quobyte-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0" acquired by "delete_volume" :: waited 0.021s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:11:19 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa5f70d-f045-48d9-98d7-41fd1ceef3be]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:11:19 devstack sudo[90383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9
Apr 28 22:11:19 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-763887a0-47dc-4bb9-890a-65a011642f4c tempest-SnapshotDependencyTests-1447044764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:11:19 devstack sudo[90383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:11:19 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-3960297a-c718-4e9a-a6eb-b9e6c1c32958 tempest-AbsoluteLimitsTests-1685046059 None] Acquiring lock "cinder-b19aec69-830d-497d-ba79-4fedf70ce303-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:11:19 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-3960297a-c718-4e9a-a6eb-b9e6c1c32958 tempest-AbsoluteLimitsTests-1685046059 None] Lock "cinder-b19aec69-830d-497d-ba79-4fedf70ce303-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:11:19 devstack sudo[90385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0
Apr 28 22:11:19 devstack sudo[90385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:11:19 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-3960297a-c718-4e9a-a6eb-b9e6c1c32958 tempest-AbsoluteLimitsTests-1685046059 None] Acquiring lock "cinder-quobyte-b19aec69-830d-497d-ba79-4fedf70ce303" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:11:19 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-3960297a-c718-4e9a-a6eb-b9e6c1c32958 tempest-AbsoluteLimitsTests-1685046059 None] Lock "cinder-quobyte-b19aec69-830d-497d-ba79-4fedf70ce303" acquired by "delete_volume" :: waited 0.039s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:11:19 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2c0840-31d1-4f11-9cd1-73a2af076718]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:11:19 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-3960297a-c718-4e9a-a6eb-b9e6c1c32958 tempest-AbsoluteLimitsTests-1685046059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b19aec69-830d-497d-ba79-4fedf70ce303 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:11:19 devstack sudo[90401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b19aec69-830d-497d-ba79-4fedf70ce303
Apr 28 22:11:19 devstack sudo[90401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:11:20 devstack sudo[90383]: pam_unix(sudo:session): session closed for user root
Apr 28 22:11:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-2da8235b-ae06-4be2-a59f-b7d5272814d9 tempest-SnapshotsActionsTest-568208414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9" returned: 0 in 0.958s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:11:20 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-2da8235b-ae06-4be2-a59f-b7d5272814d9 tempest-SnapshotsActionsTest-568208414 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-623c783b-a15c-45e5-a63a-1ff893a60ad9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 22:11:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-2da8235b-ae06-4be2-a59f-b7d5272814d9 tempest-SnapshotsActionsTest-568208414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.45146878-515f-44cf-bce4-7905249d7a54 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:11:20 devstack sudo[90431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.45146878-515f-44cf-bce4-7905249d7a54
Apr 28 22:11:20 devstack sudo[90431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:11:20 devstack sudo[90385]: pam_unix(sudo:session): session closed for user root
Apr 28 22:11:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-763887a0-47dc-4bb9-890a-65a011642f4c tempest-SnapshotDependencyTests-1447044764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0" returned: 0 in 0.902s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:11:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-763887a0-47dc-4bb9-890a-65a011642f4c tempest-SnapshotDependencyTests-1447044764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:11:20 devstack sudo[90433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0
Apr 28 22:11:20 devstack sudo[90433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:11:20 devstack sudo[90401]: pam_unix(sudo:session): session closed for user root
Apr 28 22:11:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-3960297a-c718-4e9a-a6eb-b9e6c1c32958 tempest-AbsoluteLimitsTests-1685046059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b19aec69-830d-497d-ba79-4fedf70ce303" returned: 0 in 0.885s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:11:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-3960297a-c718-4e9a-a6eb-b9e6c1c32958 tempest-AbsoluteLimitsTests-1685046059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b19aec69-830d-497d-ba79-4fedf70ce303 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:11:20 devstack sudo[90438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b19aec69-830d-497d-ba79-4fedf70ce303
Apr 28 22:11:20 devstack sudo[90438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:11:20 devstack sudo[90433]: pam_unix(sudo:session): session closed for user root
Apr 28 22:11:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-763887a0-47dc-4bb9-890a-65a011642f4c tempest-SnapshotDependencyTests-1447044764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0" returned: 0 in 0.666s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:11:20 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-763887a0-47dc-4bb9-890a-65a011642f4c tempest-SnapshotDependencyTests-1447044764 None] Lock "cinder-quobyte-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0" released by "delete_volume" :: held 1.653s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:11:20 devstack sudo[90431]: pam_unix(sudo:session): session closed for user root
Apr 28 22:11:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-2da8235b-ae06-4be2-a59f-b7d5272814d9 tempest-SnapshotsActionsTest-568208414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.45146878-515f-44cf-bce4-7905249d7a54" returned: 0 in 0.800s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:11:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-2da8235b-ae06-4be2-a59f-b7d5272814d9 tempest-SnapshotsActionsTest-568208414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.45146878-515f-44cf-bce4-7905249d7a54 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:11:20 devstack sudo[90444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.45146878-515f-44cf-bce4-7905249d7a54
Apr 28 22:11:20 devstack sudo[90444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:11:21 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-763887a0-47dc-4bb9-890a-65a011642f4c tempest-SnapshotDependencyTests-1447044764 None] Created reservations ['40c401ae-cb4a-4747-8989-6ae823c6d2ab', '38c8b87f-2d6d-4bac-af1b-82c15129d270', '65146222-2809-43fa-9cf6-ce1f7e4207db', '067506a5-e68f-466a-9314-ec4ddac168f1'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:11:21 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-763887a0-47dc-4bb9-890a-65a011642f4c tempest-SnapshotDependencyTests-1447044764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:11:21 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-763887a0-47dc-4bb9-890a-65a011642f4c tempest-SnapshotDependencyTests-1447044764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:11:21 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-763887a0-47dc-4bb9-890a-65a011642f4c tempest-SnapshotDependencyTests-1447044764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:11:21 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-763887a0-47dc-4bb9-890a-65a011642f4c tempest-SnapshotDependencyTests-1447044764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:11:21 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-763887a0-47dc-4bb9-890a-65a011642f4c tempest-SnapshotDependencyTests-1447044764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:11:21 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-763887a0-47dc-4bb9-890a-65a011642f4c tempest-SnapshotDependencyTests-1447044764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:11:21 devstack sudo[90438]: pam_unix(sudo:session): session closed for user root
Apr 28 22:11:21 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-3960297a-c718-4e9a-a6eb-b9e6c1c32958 tempest-AbsoluteLimitsTests-1685046059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b19aec69-830d-497d-ba79-4fedf70ce303" returned: 0 in 0.661s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:11:21 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-3960297a-c718-4e9a-a6eb-b9e6c1c32958 tempest-AbsoluteLimitsTests-1685046059 None] Lock "cinder-quobyte-b19aec69-830d-497d-ba79-4fedf70ce303" released by "delete_volume" :: held 1.603s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:11:21 devstack sudo[90447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:11:21 devstack sudo[90447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:11:21 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-3960297a-c718-4e9a-a6eb-b9e6c1c32958 tempest-AbsoluteLimitsTests-1685046059 None] Created reservations ['aaaf3da7-53ca-4e6b-849b-2b04f281a5e2', '8b5b63c6-bbe1-45d3-8cfb-b495d48cd6db', '64be5161-d97b-4c29-be89-f12a4d975b03', '0eec8f3b-fc7e-4de1-85a5-a97e95058564'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:11:21 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-3960297a-c718-4e9a-a6eb-b9e6c1c32958 tempest-AbsoluteLimitsTests-1685046059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:11:21 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-3960297a-c718-4e9a-a6eb-b9e6c1c32958 tempest-AbsoluteLimitsTests-1685046059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:11:21 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-3960297a-c718-4e9a-a6eb-b9e6c1c32958 tempest-AbsoluteLimitsTests-1685046059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:11:21 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-3960297a-c718-4e9a-a6eb-b9e6c1c32958 tempest-AbsoluteLimitsTests-1685046059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:11:21 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-3960297a-c718-4e9a-a6eb-b9e6c1c32958 tempest-AbsoluteLimitsTests-1685046059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:11:21 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-3960297a-c718-4e9a-a6eb-b9e6c1c32958 tempest-AbsoluteLimitsTests-1685046059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:11:21 devstack sudo[90449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:11:21 devstack sudo[90449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:11:21 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-5a50c6b1-6688-4b1a-a21b-a96d0c66a794 tempest-SnapshotDependencyTests-1447044764 None] Acquiring lock "cinder-4db1673a-8b7f-4333-9004-c3434f1e6d73-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:11:21 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-5a50c6b1-6688-4b1a-a21b-a96d0c66a794 tempest-SnapshotDependencyTests-1447044764 None] Lock "cinder-4db1673a-8b7f-4333-9004-c3434f1e6d73-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:11:21 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-5a50c6b1-6688-4b1a-a21b-a96d0c66a794 tempest-SnapshotDependencyTests-1447044764 None] Acquiring lock "cinder-quobyte-4db1673a-8b7f-4333-9004-c3434f1e6d73" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:11:21 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-5a50c6b1-6688-4b1a-a21b-a96d0c66a794 tempest-SnapshotDependencyTests-1447044764 None] Lock "cinder-quobyte-4db1673a-8b7f-4333-9004-c3434f1e6d73" acquired by "delete_volume" :: waited 0.029s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:11:21 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[3697461e-4a7f-4d91-9a39-fbcb491f7f4a]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:11:21 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5a50c6b1-6688-4b1a-a21b-a96d0c66a794 tempest-SnapshotDependencyTests-1447044764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-4db1673a-8b7f-4333-9004-c3434f1e6d73 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:11:21 devstack sudo[90444]: pam_unix(sudo:session): session closed for user root
Apr 28 22:11:21 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-2da8235b-ae06-4be2-a59f-b7d5272814d9 tempest-SnapshotsActionsTest-568208414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.45146878-515f-44cf-bce4-7905249d7a54" returned: 0 in 0.819s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:11:21 devstack sudo[90452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-4db1673a-8b7f-4333-9004-c3434f1e6d73
Apr 28 22:11:21 devstack sudo[90452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:11:21 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-2da8235b-ae06-4be2-a59f-b7d5272814d9 tempest-SnapshotsActionsTest-568208414 None] Lock "cinder-quobyte-45146878-515f-44cf-bce4-7905249d7a54" released by "_delete_snapshot" :: held 3.517s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:11:21 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-2da8235b-ae06-4be2-a59f-b7d5272814d9 tempest-SnapshotsActionsTest-568208414 None] Lock "cinder-quobyte-623c783b-a15c-45e5-a63a-1ff893a60ad9" released by "delete_snapshot" :: held 3.546s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:11:21 devstack sudo[90447]: pam_unix(sudo:session): session closed for user root
Apr 28 22:11:21 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-763887a0-47dc-4bb9-890a-65a011642f4c tempest-SnapshotDependencyTests-1447044764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.755s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:11:21 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-763887a0-47dc-4bb9-890a-65a011642f4c tempest-SnapshotDependencyTests-1447044764 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:11:21 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-763887a0-47dc-4bb9-890a-65a011642f4c tempest-SnapshotDependencyTests-1447044764 None] Deleted volume successfully.
Apr 28 22:11:21 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-763887a0-47dc-4bb9-890a-65a011642f4c tempest-SnapshotDependencyTests-1447044764 None] Lock "cinder-57af7fe1-0af2-4602-a3e0-d0ec1aa784f0-delete_volume" released by "delete_volume" :: held 2.683s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:11:21 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-2da8235b-ae06-4be2-a59f-b7d5272814d9 tempest-SnapshotsActionsTest-568208414 None] Created reservations ['d01a3ea7-84fa-4aba-b480-3ca469d03a22', '28a52922-ef13-414d-92d5-90b411551f6b', 'ef943c08-7ae7-48fe-9fd1-f0a6920892f2', 'ab403d63-dbbe-4694-88de-9ff929906d5b'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:11:22 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-2da8235b-ae06-4be2-a59f-b7d5272814d9 tempest-SnapshotsActionsTest-568208414 None] Delete snapshot completed successfully.
Apr 28 22:11:22 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-2da8235b-ae06-4be2-a59f-b7d5272814d9 tempest-SnapshotsActionsTest-568208414 None] Lock "cinder-45146878-515f-44cf-bce4-7905249d7a54-delete_snapshot" released by "delete_snapshot" :: held 3.756s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:11:22 devstack sudo[90449]: pam_unix(sudo:session): session closed for user root
Apr 28 22:11:22 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-3960297a-c718-4e9a-a6eb-b9e6c1c32958 tempest-AbsoluteLimitsTests-1685046059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.781s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:11:22 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-3960297a-c718-4e9a-a6eb-b9e6c1c32958 tempest-AbsoluteLimitsTests-1685046059 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:11:22 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-3960297a-c718-4e9a-a6eb-b9e6c1c32958 tempest-AbsoluteLimitsTests-1685046059 None] Deleted volume successfully.
Apr 28 22:11:22 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-3960297a-c718-4e9a-a6eb-b9e6c1c32958 tempest-AbsoluteLimitsTests-1685046059 None] Lock "cinder-b19aec69-830d-497d-ba79-4fedf70ce303-delete_volume" released by "delete_volume" :: held 2.642s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:11:22 devstack sudo[90452]: pam_unix(sudo:session): session closed for user root
Apr 28 22:11:22 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5a50c6b1-6688-4b1a-a21b-a96d0c66a794 tempest-SnapshotDependencyTests-1447044764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-4db1673a-8b7f-4333-9004-c3434f1e6d73" returned: 0 in 0.911s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:11:22 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5a50c6b1-6688-4b1a-a21b-a96d0c66a794 tempest-SnapshotDependencyTests-1447044764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-4db1673a-8b7f-4333-9004-c3434f1e6d73 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:11:22 devstack sudo[90459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-4db1673a-8b7f-4333-9004-c3434f1e6d73
Apr 28 22:11:22 devstack sudo[90459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:11:22 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f1d6e797-51b8-4a95-a666-4b413afa0b49 tempest-SnapshotsActionsTest-285904011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:11:22 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f1d6e797-51b8-4a95-a666-4b413afa0b49 tempest-SnapshotsActionsTest-285904011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:11:22 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-f1d6e797-51b8-4a95-a666-4b413afa0b49 tempest-SnapshotsActionsTest-285904011 None] Creating offline snapshot 2be0a17c-63a4-4a4b-82fb-261f7218ba02 of volume 623c783b-a15c-45e5-a63a-1ff893a60ad9 {{(pid=83924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 22:11:23 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c654c8-a75a-42b5-95d6-6f37b228a780]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:11:23 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f1d6e797-51b8-4a95-a666-4b413afa0b49 tempest-SnapshotsActionsTest-285904011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:11:23 devstack sudo[90462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9
Apr 28 22:11:23 devstack sudo[90462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:11:23 devstack sudo[90459]: pam_unix(sudo:session): session closed for user root
Apr 28 22:11:23 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5a50c6b1-6688-4b1a-a21b-a96d0c66a794 tempest-SnapshotDependencyTests-1447044764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-4db1673a-8b7f-4333-9004-c3434f1e6d73" returned: 0 in 0.837s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:11:23 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-5a50c6b1-6688-4b1a-a21b-a96d0c66a794 tempest-SnapshotDependencyTests-1447044764 None] Lock "cinder-quobyte-4db1673a-8b7f-4333-9004-c3434f1e6d73" released by "delete_volume" :: held 1.823s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:11:23 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-5a50c6b1-6688-4b1a-a21b-a96d0c66a794 tempest-SnapshotDependencyTests-1447044764 None] Created reservations ['450004de-7626-4b87-ba89-43cb77cf9c9a', 'e9f7ad8a-42ca-4615-8e2c-60700dbea401', '68537a8d-d753-4742-8421-04c7bf5b145f', 'f2388bbe-1d7b-45f8-a994-c8b52a5cd0b3'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:11:23 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-5a50c6b1-6688-4b1a-a21b-a96d0c66a794 tempest-SnapshotDependencyTests-1447044764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:11:23 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-5a50c6b1-6688-4b1a-a21b-a96d0c66a794 tempest-SnapshotDependencyTests-1447044764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:11:23 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-5a50c6b1-6688-4b1a-a21b-a96d0c66a794 tempest-SnapshotDependencyTests-1447044764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:11:23 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-5a50c6b1-6688-4b1a-a21b-a96d0c66a794 tempest-SnapshotDependencyTests-1447044764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:11:23 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-5a50c6b1-6688-4b1a-a21b-a96d0c66a794 tempest-SnapshotDependencyTests-1447044764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:11:23 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5a50c6b1-6688-4b1a-a21b-a96d0c66a794 tempest-SnapshotDependencyTests-1447044764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:11:23 devstack sudo[90465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:11:23 devstack sudo[90465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:11:24 devstack sudo[90462]: pam_unix(sudo:session): session closed for user root
Apr 28 22:11:24 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f1d6e797-51b8-4a95-a666-4b413afa0b49 tempest-SnapshotsActionsTest-285904011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9" returned: 0 in 1.025s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:11:24 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-f1d6e797-51b8-4a95-a666-4b413afa0b49 tempest-SnapshotsActionsTest-285904011 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-623c783b-a15c-45e5-a63a-1ff893a60ad9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 22:11:24 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f1d6e797-51b8-4a95-a666-4b413afa0b49 tempest-SnapshotsActionsTest-285904011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.2be0a17c-63a4-4a4b-82fb-261f7218ba02 1G {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:11:24 devstack sudo[90470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.2be0a17c-63a4-4a4b-82fb-261f7218ba02 1G
Apr 28 22:11:24 devstack sudo[90470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:11:24 devstack sudo[90465]: pam_unix(sudo:session): session closed for user root
Apr 28 22:11:24 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5a50c6b1-6688-4b1a-a21b-a96d0c66a794 tempest-SnapshotDependencyTests-1447044764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.925s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:11:24 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-5a50c6b1-6688-4b1a-a21b-a96d0c66a794 tempest-SnapshotDependencyTests-1447044764 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:11:24 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-5a50c6b1-6688-4b1a-a21b-a96d0c66a794 tempest-SnapshotDependencyTests-1447044764 None] Deleted volume successfully.
Apr 28 22:11:24 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-5a50c6b1-6688-4b1a-a21b-a96d0c66a794 tempest-SnapshotDependencyTests-1447044764 None] Lock "cinder-4db1673a-8b7f-4333-9004-c3434f1e6d73-delete_volume" released by "delete_volume" :: held 3.071s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:11:25 devstack sudo[90470]: pam_unix(sudo:session): session closed for user root
Apr 28 22:11:25 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f1d6e797-51b8-4a95-a666-4b413afa0b49 tempest-SnapshotsActionsTest-285904011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.2be0a17c-63a4-4a4b-82fb-261f7218ba02 1G" returned: 0 in 1.208s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:11:25 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f1d6e797-51b8-4a95-a666-4b413afa0b49 tempest-SnapshotsActionsTest-285904011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.2be0a17c-63a4-4a4b-82fb-261f7218ba02 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:11:25 devstack sudo[90484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.2be0a17c-63a4-4a4b-82fb-261f7218ba02
Apr 28 22:11:25 devstack sudo[90484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:11:25 devstack sudo[90484]: pam_unix(sudo:session): session closed for user root
Apr 28 22:11:25 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f1d6e797-51b8-4a95-a666-4b413afa0b49 tempest-SnapshotsActionsTest-285904011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.2be0a17c-63a4-4a4b-82fb-261f7218ba02" returned: 0 in 0.713s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:11:25 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-f1d6e797-51b8-4a95-a666-4b413afa0b49 tempest-SnapshotsActionsTest-285904011 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.2be0a17c-63a4-4a4b-82fb-261f7218ba02 is being set with open permissions: ugo+rw
Apr 28 22:11:25 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f1d6e797-51b8-4a95-a666-4b413afa0b49 tempest-SnapshotsActionsTest-285904011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.2be0a17c-63a4-4a4b-82fb-261f7218ba02 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:11:26 devstack sudo[90490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.2be0a17c-63a4-4a4b-82fb-261f7218ba02
Apr 28 22:11:26 devstack sudo[90490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:11:26 devstack sudo[90490]: pam_unix(sudo:session): session closed for user root
Apr 28 22:11:26 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f1d6e797-51b8-4a95-a666-4b413afa0b49 tempest-SnapshotsActionsTest-285904011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.2be0a17c-63a4-4a4b-82fb-261f7218ba02" returned: 0 in 0.676s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:11:26 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f1d6e797-51b8-4a95-a666-4b413afa0b49 tempest-SnapshotsActionsTest-285904011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.760s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:11:26 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-f1d6e797-51b8-4a95-a666-4b413afa0b49 tempest-SnapshotsActionsTest-285904011 None] Create snapshot completed successfully
Apr 28 22:11:27 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-ca94623c-74b0-4869-9375-b9b6a902afcf tempest-SnapshotsActionsTest-568208414 None] Acquiring lock "cinder-2be0a17c-63a4-4a4b-82fb-261f7218ba02-delete_snapshot" by "delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:11:27 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-ca94623c-74b0-4869-9375-b9b6a902afcf tempest-SnapshotsActionsTest-568208414 None] Lock "cinder-2be0a17c-63a4-4a4b-82fb-261f7218ba02-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:11:27 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-ca94623c-74b0-4869-9375-b9b6a902afcf tempest-SnapshotsActionsTest-568208414 None] Acquiring lock "cinder-quobyte-623c783b-a15c-45e5-a63a-1ff893a60ad9" by "delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:11:27 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-ca94623c-74b0-4869-9375-b9b6a902afcf tempest-SnapshotsActionsTest-568208414 None] Lock "cinder-quobyte-623c783b-a15c-45e5-a63a-1ff893a60ad9" acquired by "delete_snapshot" :: waited 0.040s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:11:27 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-ca94623c-74b0-4869-9375-b9b6a902afcf tempest-SnapshotsActionsTest-568208414 None] Acquiring lock "cinder-quobyte-2be0a17c-63a4-4a4b-82fb-261f7218ba02" by "_delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:11:27 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-ca94623c-74b0-4869-9375-b9b6a902afcf tempest-SnapshotsActionsTest-568208414 None] Lock "cinder-quobyte-2be0a17c-63a4-4a4b-82fb-261f7218ba02" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:11:27 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-ca94623c-74b0-4869-9375-b9b6a902afcf tempest-SnapshotsActionsTest-568208414 None] Deleting offline snapshot 2be0a17c-63a4-4a4b-82fb-261f7218ba02 of volume 623c783b-a15c-45e5-a63a-1ff893a60ad9 {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 22:11:27 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-ca94623c-74b0-4869-9375-b9b6a902afcf tempest-SnapshotsActionsTest-568208414 None] snapshot_file for this snap is: volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.2be0a17c-63a4-4a4b-82fb-261f7218ba02 {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 22:11:27 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e32cef-aa24-4f57-a8cd-18364045ed45]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:11:27 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-ca94623c-74b0-4869-9375-b9b6a902afcf tempest-SnapshotsActionsTest-568208414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.2be0a17c-63a4-4a4b-82fb-261f7218ba02 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:11:27 devstack sudo[90493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.2be0a17c-63a4-4a4b-82fb-261f7218ba02
Apr 28 22:11:27 devstack sudo[90493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:11:28 devstack sudo[90493]: pam_unix(sudo:session): session closed for user root
Apr 28 22:11:28 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-ca94623c-74b0-4869-9375-b9b6a902afcf tempest-SnapshotsActionsTest-568208414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.2be0a17c-63a4-4a4b-82fb-261f7218ba02" returned: 0 in 0.845s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:11:28 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-ca94623c-74b0-4869-9375-b9b6a902afcf tempest-SnapshotsActionsTest-568208414 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-623c783b-a15c-45e5-a63a-1ff893a60ad9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 22:11:28 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12ce6fe-597f-44d6-a4f0-0dc3db409a80]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:11:28 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-ca94623c-74b0-4869-9375-b9b6a902afcf tempest-SnapshotsActionsTest-568208414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:11:28 devstack sudo[90499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9
Apr 28 22:11:28 devstack sudo[90499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:11:29 devstack sudo[90499]: pam_unix(sudo:session): session closed for user root
Apr 28 22:11:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-ca94623c-74b0-4869-9375-b9b6a902afcf tempest-SnapshotsActionsTest-568208414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9" returned: 0 in 0.924s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:11:29 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-ca94623c-74b0-4869-9375-b9b6a902afcf tempest-SnapshotsActionsTest-568208414 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-623c783b-a15c-45e5-a63a-1ff893a60ad9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 22:11:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-ca94623c-74b0-4869-9375-b9b6a902afcf tempest-SnapshotsActionsTest-568208414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.2be0a17c-63a4-4a4b-82fb-261f7218ba02 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:11:29 devstack sudo[90504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.2be0a17c-63a4-4a4b-82fb-261f7218ba02
Apr 28 22:11:29 devstack sudo[90504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:11:30 devstack sudo[90504]: pam_unix(sudo:session): session closed for user root
Apr 28 22:11:30 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-ca94623c-74b0-4869-9375-b9b6a902afcf tempest-SnapshotsActionsTest-568208414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.2be0a17c-63a4-4a4b-82fb-261f7218ba02" returned: 0 in 0.856s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:11:30 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-ca94623c-74b0-4869-9375-b9b6a902afcf tempest-SnapshotsActionsTest-568208414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.2be0a17c-63a4-4a4b-82fb-261f7218ba02 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:11:30 devstack sudo[90510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.2be0a17c-63a4-4a4b-82fb-261f7218ba02
Apr 28 22:11:30 devstack sudo[90510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:11:30 devstack sudo[90510]: pam_unix(sudo:session): session closed for user root
Apr 28 22:11:30 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-ca94623c-74b0-4869-9375-b9b6a902afcf tempest-SnapshotsActionsTest-568208414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.2be0a17c-63a4-4a4b-82fb-261f7218ba02" returned: 0 in 0.644s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:11:30 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-ca94623c-74b0-4869-9375-b9b6a902afcf tempest-SnapshotsActionsTest-568208414 None] Lock "cinder-quobyte-2be0a17c-63a4-4a4b-82fb-261f7218ba02" released by "_delete_snapshot" :: held 3.446s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:11:30 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-ca94623c-74b0-4869-9375-b9b6a902afcf tempest-SnapshotsActionsTest-568208414 None] Lock "cinder-quobyte-623c783b-a15c-45e5-a63a-1ff893a60ad9" released by "delete_snapshot" :: held 3.485s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:11:30 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-ca94623c-74b0-4869-9375-b9b6a902afcf tempest-SnapshotsActionsTest-568208414 None] Created reservations ['cefce650-ca21-4535-83d6-32a6bec0b71c', 'ccf87ee9-4baa-4d7d-90b0-1e28242012d7', 'bc7b371e-38ce-41ae-9aa8-929cb72b14bb', '7a16fd49-bae9-4eb1-86c0-8a36d298d8b8'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:11:31 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-ca94623c-74b0-4869-9375-b9b6a902afcf tempest-SnapshotsActionsTest-568208414 None] Delete snapshot completed successfully.
Apr 28 22:11:31 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-ca94623c-74b0-4869-9375-b9b6a902afcf tempest-SnapshotsActionsTest-568208414 None] Lock "cinder-2be0a17c-63a4-4a4b-82fb-261f7218ba02-delete_snapshot" released by "delete_snapshot" :: held 3.674s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:11:32 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-b8b35cc2-2775-48b0-97f1-282d9fadcffe tempest-SnapshotsActionsTest-285904011 None] Acquiring lock "cinder-1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9-delete_snapshot" by "delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:11:32 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-b8b35cc2-2775-48b0-97f1-282d9fadcffe tempest-SnapshotsActionsTest-285904011 None] Lock "cinder-1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:11:32 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-b8b35cc2-2775-48b0-97f1-282d9fadcffe tempest-SnapshotsActionsTest-285904011 None] Acquiring lock "cinder-quobyte-623c783b-a15c-45e5-a63a-1ff893a60ad9" by "delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:11:32 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-b8b35cc2-2775-48b0-97f1-282d9fadcffe tempest-SnapshotsActionsTest-285904011 None] Lock "cinder-quobyte-623c783b-a15c-45e5-a63a-1ff893a60ad9" acquired by "delete_snapshot" :: waited 0.034s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:11:32 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-b8b35cc2-2775-48b0-97f1-282d9fadcffe tempest-SnapshotsActionsTest-285904011 None] Acquiring lock "cinder-quobyte-1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9" by "_delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:11:32 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-b8b35cc2-2775-48b0-97f1-282d9fadcffe tempest-SnapshotsActionsTest-285904011 None] Lock "cinder-quobyte-1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:11:32 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-b8b35cc2-2775-48b0-97f1-282d9fadcffe tempest-SnapshotsActionsTest-285904011 None] Deleting offline snapshot 1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9 of volume 623c783b-a15c-45e5-a63a-1ff893a60ad9 {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 22:11:32 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-b8b35cc2-2775-48b0-97f1-282d9fadcffe tempest-SnapshotsActionsTest-285904011 None] snapshot_file for this snap is: volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9 {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 22:11:32 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4380f54-25ed-467f-85ab-4005af5cdad9]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:11:32 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b8b35cc2-2775-48b0-97f1-282d9fadcffe tempest-SnapshotsActionsTest-285904011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:11:32 devstack sudo[90515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9
Apr 28 22:11:32 devstack sudo[90515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:11:33 devstack sudo[90515]: pam_unix(sudo:session): session closed for user root
Apr 28 22:11:33 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b8b35cc2-2775-48b0-97f1-282d9fadcffe tempest-SnapshotsActionsTest-285904011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9" returned: 0 in 0.936s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:11:33 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-b8b35cc2-2775-48b0-97f1-282d9fadcffe tempest-SnapshotsActionsTest-285904011 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-623c783b-a15c-45e5-a63a-1ff893a60ad9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 22:11:33 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a3d1f7-27a2-4c1e-ae2d-cee280ac4832]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:11:33 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b8b35cc2-2775-48b0-97f1-282d9fadcffe tempest-SnapshotsActionsTest-285904011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:11:33 devstack sudo[90522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9
Apr 28 22:11:33 devstack sudo[90522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:11:34 devstack sudo[90522]: pam_unix(sudo:session): session closed for user root
Apr 28 22:11:34 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b8b35cc2-2775-48b0-97f1-282d9fadcffe tempest-SnapshotsActionsTest-285904011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9" returned: 0 in 0.904s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:11:34 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b8b35cc2-2775-48b0-97f1-282d9fadcffe tempest-SnapshotsActionsTest-285904011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:11:34 devstack sudo[90527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9
Apr 28 22:11:34 devstack sudo[90527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:11:34 devstack sudo[90527]: pam_unix(sudo:session): session closed for user root
Apr 28 22:11:34 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b8b35cc2-2775-48b0-97f1-282d9fadcffe tempest-SnapshotsActionsTest-285904011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9" returned: 0 in 0.829s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:11:34 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b8b35cc2-2775-48b0-97f1-282d9fadcffe tempest-SnapshotsActionsTest-285904011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:11:35 devstack sudo[90534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9
Apr 28 22:11:35 devstack sudo[90534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:11:35 devstack sudo[90534]: pam_unix(sudo:session): session closed for user root
Apr 28 22:11:35 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b8b35cc2-2775-48b0-97f1-282d9fadcffe tempest-SnapshotsActionsTest-285904011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9.1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9" returned: 0 in 0.888s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:11:35 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-b8b35cc2-2775-48b0-97f1-282d9fadcffe tempest-SnapshotsActionsTest-285904011 None] Lock "cinder-quobyte-1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9" released by "_delete_snapshot" :: held 3.720s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:11:35 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-b8b35cc2-2775-48b0-97f1-282d9fadcffe tempest-SnapshotsActionsTest-285904011 None] Lock "cinder-quobyte-623c783b-a15c-45e5-a63a-1ff893a60ad9" released by "delete_snapshot" :: held 3.751s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:11:36 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-b8b35cc2-2775-48b0-97f1-282d9fadcffe tempest-SnapshotsActionsTest-285904011 None] Created reservations ['d065da82-2ad7-4c82-b515-0bb5865af8d4', 'b070ebda-4d0b-4d87-ad1c-957103119372', 'b7613e8d-6ad3-4a1a-bff7-bd79aa55e896', '1590f167-d144-4b1d-8b79-3a34efabc818'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:11:36 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-b8b35cc2-2775-48b0-97f1-282d9fadcffe tempest-SnapshotsActionsTest-285904011 None] Delete snapshot completed successfully.
Apr 28 22:11:36 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-b8b35cc2-2775-48b0-97f1-282d9fadcffe tempest-SnapshotsActionsTest-285904011 None] Lock "cinder-1adbc0f8-77c0-4edc-9bbc-1ed7bda04bc9-delete_snapshot" released by "delete_snapshot" :: held 4.089s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:11:36 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-dc4c0e32-30d0-4004-be5a-576c89d7caad tempest-SnapshotsActionsTest-285904011 None] Acquiring lock "cinder-623c783b-a15c-45e5-a63a-1ff893a60ad9-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:11:36 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-dc4c0e32-30d0-4004-be5a-576c89d7caad tempest-SnapshotsActionsTest-285904011 None] Lock "cinder-623c783b-a15c-45e5-a63a-1ff893a60ad9-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:11:36 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-dc4c0e32-30d0-4004-be5a-576c89d7caad tempest-SnapshotsActionsTest-285904011 None] Acquiring lock "cinder-quobyte-623c783b-a15c-45e5-a63a-1ff893a60ad9" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:11:36 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-dc4c0e32-30d0-4004-be5a-576c89d7caad tempest-SnapshotsActionsTest-285904011 None] Lock "cinder-quobyte-623c783b-a15c-45e5-a63a-1ff893a60ad9" acquired by "delete_volume" :: waited 0.023s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:11:36 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9396adde-9517-471e-aeac-880609285af6]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:11:36 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-dc4c0e32-30d0-4004-be5a-576c89d7caad tempest-SnapshotsActionsTest-285904011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:11:36 devstack sudo[90538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9
Apr 28 22:11:36 devstack sudo[90538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:11:37 devstack sudo[90538]: pam_unix(sudo:session): session closed for user root
Apr 28 22:11:37 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-703f3c87-e195-48e4-be87-caae48c09882 tempest-VolumesActionsTest-153568153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:11:37 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-703f3c87-e195-48e4-be87-caae48c09882 tempest-VolumesActionsTest-153568153 None] Flow 'volume_create_manager' (bbf27c84-e9b7-49cd-aca2-8eb1c40344ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:11:37 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-703f3c87-e195-48e4-be87-caae48c09882 tempest-VolumesActionsTest-153568153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db3d680a-9352-43b3-8985-09b18efb0819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:11:37 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-dc4c0e32-30d0-4004-be5a-576c89d7caad tempest-SnapshotsActionsTest-285904011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9" returned: 0 in 1.136s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:11:37 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-dc4c0e32-30d0-4004-be5a-576c89d7caad tempest-SnapshotsActionsTest-285904011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:11:37 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-703f3c87-e195-48e4-be87-caae48c09882 tempest-VolumesActionsTest-153568153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db3d680a-9352-43b3-8985-09b18efb0819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:11:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1436540545',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bdcdad7-d5b2-462a-b86e-96f97226d282,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='415a53ffc68540f1a1d4a9713beb54ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:11:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:11:38Z,use_quota=True,user_id='1bcc459429d64f318ff287087a02bf48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:11:37 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-703f3c87-e195-48e4-be87-caae48c09882 tempest-VolumesActionsTest-153568153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a17db453-a189-402f-a343-1e6f61c7d294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:11:37 devstack sudo[90543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9
Apr 28 22:11:37 devstack sudo[90543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:11:37 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-703f3c87-e195-48e4-be87-caae48c09882 tempest-VolumesActionsTest-153568153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a17db453-a189-402f-a343-1e6f61c7d294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:11:37 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-703f3c87-e195-48e4-be87-caae48c09882 tempest-VolumesActionsTest-153568153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f39bee45-24bb-48c0-8e64-db42c9b0d69e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:11:37 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-703f3c87-e195-48e4-be87-caae48c09882 tempest-VolumesActionsTest-153568153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f39bee45-24bb-48c0-8e64-db42c9b0d69e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bdcdad7-d5b2-462a-b86e-96f97226d282', 'volume_name': 'volume-7bdcdad7-d5b2-462a-b86e-96f97226d282', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:11:37 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-703f3c87-e195-48e4-be87-caae48c09882 tempest-VolumesActionsTest-153568153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d92e372f-4792-42ab-a8da-36124dddd1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:11:37 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-703f3c87-e195-48e4-be87-caae48c09882 tempest-VolumesActionsTest-153568153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d92e372f-4792-42ab-a8da-36124dddd1c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:11:37 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-703f3c87-e195-48e4-be87-caae48c09882 tempest-VolumesActionsTest-153568153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (291e3dcd-12aa-49e2-9193-56c29fb1f95f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:11:37 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-703f3c87-e195-48e4-be87-caae48c09882 tempest-VolumesActionsTest-153568153 None] Volume 7bdcdad7-d5b2-462a-b86e-96f97226d282: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bdcdad7-d5b2-462a-b86e-96f97226d282', 'volume_size': 1}
Apr 28 22:11:37 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-703f3c87-e195-48e4-be87-caae48c09882 tempest-VolumesActionsTest-153568153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:11:37 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-703f3c87-e195-48e4-be87-caae48c09882 tempest-VolumesActionsTest-153568153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:11:37 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-703f3c87-e195-48e4-be87-caae48c09882 tempest-VolumesActionsTest-153568153 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:11:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1436540545',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bdcdad7-d5b2-462a-b86e-96f97226d282,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='415a53ffc68540f1a1d4a9713beb54ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:11:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:11:38Z,use_quota=True,user_id='1bcc459429d64f318ff287087a02bf48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:11:37 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-703f3c87-e195-48e4-be87-caae48c09882 tempest-VolumesActionsTest-153568153 None] Creating volume 7bdcdad7-d5b2-462a-b86e-96f97226d282 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:11:37 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-703f3c87-e195-48e4-be87-caae48c09882 tempest-VolumesActionsTest-153568153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:11:37 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-703f3c87-e195-48e4-be87-caae48c09882 tempest-VolumesActionsTest-153568153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:11:37 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-703f3c87-e195-48e4-be87-caae48c09882 tempest-VolumesActionsTest-153568153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:11:37 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-703f3c87-e195-48e4-be87-caae48c09882 tempest-VolumesActionsTest-153568153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:11:37 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-703f3c87-e195-48e4-be87-caae48c09882 tempest-VolumesActionsTest-153568153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:11:37 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-703f3c87-e195-48e4-be87-caae48c09882 tempest-VolumesActionsTest-153568153 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:11:37 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-703f3c87-e195-48e4-be87-caae48c09882 tempest-VolumesActionsTest-153568153 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:11:37 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-703f3c87-e195-48e4-be87-caae48c09882 tempest-VolumesActionsTest-153568153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7bdcdad7-d5b2-462a-b86e-96f97226d282 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:11:38 devstack sudo[90545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7bdcdad7-d5b2-462a-b86e-96f97226d282 1073741824
Apr 28 22:11:38 devstack sudo[90545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:11:38 devstack sudo[90543]: pam_unix(sudo:session): session closed for user root
Apr 28 22:11:38 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-dc4c0e32-30d0-4004-be5a-576c89d7caad tempest-SnapshotsActionsTest-285904011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-623c783b-a15c-45e5-a63a-1ff893a60ad9" returned: 0 in 0.825s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:11:38 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-dc4c0e32-30d0-4004-be5a-576c89d7caad tempest-SnapshotsActionsTest-285904011 None] Lock "cinder-quobyte-623c783b-a15c-45e5-a63a-1ff893a60ad9" released by "delete_volume" :: held 2.087s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:11:38 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-dc4c0e32-30d0-4004-be5a-576c89d7caad tempest-SnapshotsActionsTest-285904011 None] Created reservations ['878bbbbf-dbd5-4857-859e-2f1f807bf1ed', 'a95ca11b-4138-4830-9630-d1675d4b32fd', 'd40f88fe-6a40-462d-8218-1db433f0f796', '10f5bd2f-b1e2-47c1-9340-7e1f844c9381'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:11:38 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-dc4c0e32-30d0-4004-be5a-576c89d7caad tempest-SnapshotsActionsTest-285904011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:11:38 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-dc4c0e32-30d0-4004-be5a-576c89d7caad tempest-SnapshotsActionsTest-285904011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:11:38 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-dc4c0e32-30d0-4004-be5a-576c89d7caad tempest-SnapshotsActionsTest-285904011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:11:38 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-dc4c0e32-30d0-4004-be5a-576c89d7caad tempest-SnapshotsActionsTest-285904011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:11:38 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-dc4c0e32-30d0-4004-be5a-576c89d7caad tempest-SnapshotsActionsTest-285904011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:11:38 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-dc4c0e32-30d0-4004-be5a-576c89d7caad tempest-SnapshotsActionsTest-285904011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:11:38 devstack sudo[90552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:11:38 devstack sudo[90552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:11:39 devstack sudo[90545]: pam_unix(sudo:session): session closed for user root
Apr 28 22:11:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-703f3c87-e195-48e4-be87-caae48c09882 tempest-VolumesActionsTest-153568153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7bdcdad7-d5b2-462a-b86e-96f97226d282 1073741824" returned: 0 in 1.077s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:11:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-703f3c87-e195-48e4-be87-caae48c09882 tempest-VolumesActionsTest-153568153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7bdcdad7-d5b2-462a-b86e-96f97226d282 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:11:39 devstack sudo[90554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7bdcdad7-d5b2-462a-b86e-96f97226d282
Apr 28 22:11:39 devstack sudo[90554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:11:39 devstack sudo[90552]: pam_unix(sudo:session): session closed for user root
Apr 28 22:11:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-dc4c0e32-30d0-4004-be5a-576c89d7caad tempest-SnapshotsActionsTest-285904011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.664s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:11:39 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-dc4c0e32-30d0-4004-be5a-576c89d7caad tempest-SnapshotsActionsTest-285904011 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:11:39 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-dc4c0e32-30d0-4004-be5a-576c89d7caad tempest-SnapshotsActionsTest-285904011 None] Deleted volume successfully.
Apr 28 22:11:39 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-dc4c0e32-30d0-4004-be5a-576c89d7caad tempest-SnapshotsActionsTest-285904011 None] Lock "cinder-623c783b-a15c-45e5-a63a-1ff893a60ad9-delete_volume" released by "delete_volume" :: held 3.060s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:11:39 devstack cinder-volume[83924]: DEBUG oslo_service.periodic_task [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83924) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 28 22:11:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:11:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:11:39 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:11:39 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:11:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:11:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:11:39 devstack sudo[90558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:11:39 devstack sudo[90558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:11:39 devstack sudo[90554]: pam_unix(sudo:session): session closed for user root
Apr 28 22:11:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-703f3c87-e195-48e4-be87-caae48c09882 tempest-VolumesActionsTest-153568153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7bdcdad7-d5b2-462a-b86e-96f97226d282" returned: 0 in 0.643s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:11:39 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-703f3c87-e195-48e4-be87-caae48c09882 tempest-VolumesActionsTest-153568153 None] <== create_volume: return (1768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:11:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-703f3c87-e195-48e4-be87-caae48c09882 tempest-VolumesActionsTest-153568153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.771s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:11:39 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-703f3c87-e195-48e4-be87-caae48c09882 tempest-VolumesActionsTest-153568153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (291e3dcd-12aa-49e2-9193-56c29fb1f95f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bdcdad7-d5b2-462a-b86e-96f97226d282', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:11:39 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-703f3c87-e195-48e4-be87-caae48c09882 tempest-VolumesActionsTest-153568153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82d73c09-7157-406f-8730-e0918df06e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:11:39 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-703f3c87-e195-48e4-be87-caae48c09882 tempest-VolumesActionsTest-153568153 None] Volume volume-7bdcdad7-d5b2-462a-b86e-96f97226d282 (7bdcdad7-d5b2-462a-b86e-96f97226d282): created successfully
Apr 28 22:11:39 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-703f3c87-e195-48e4-be87-caae48c09882 tempest-VolumesActionsTest-153568153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82d73c09-7157-406f-8730-e0918df06e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:11:39 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-703f3c87-e195-48e4-be87-caae48c09882 tempest-VolumesActionsTest-153568153 None] Flow 'volume_create_manager' (bbf27c84-e9b7-49cd-aca2-8eb1c40344ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:11:39 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-703f3c87-e195-48e4-be87-caae48c09882 tempest-VolumesActionsTest-153568153 None] Created volume successfully.
Apr 28 22:11:40 devstack sudo[90558]: pam_unix(sudo:session): session closed for user root
Apr 28 22:11:40 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.613s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:11:40 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:11:49 devstack cinder-volume[83924]: DEBUG dbcounter [-] [83924] Writing DB stats cinder:SELECT=71,cinder:UPDATE=85,cinder:INSERT=23,cinder:DELETE=5 {{(pid=83924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 28 22:11:49 devstack cinder-volume[83924]: DEBUG dbcounter [-] [83924] Writing DB stats cinder:SELECT=70,cinder:UPDATE=83,cinder:DELETE=7,cinder:INSERT=24 {{(pid=83924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 28 22:11:51 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-74f3d55d-14cb-4d1d-8657-765f60600a88 tempest-VolumesServicesTestJSON-1067545175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:11:51 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-74f3d55d-14cb-4d1d-8657-765f60600a88 tempest-VolumesServicesTestJSON-1067545175 None] Flow 'volume_create_manager' (d3bd5e90-6c36-4143-ae5b-2d61627ea716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:11:51 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-74f3d55d-14cb-4d1d-8657-765f60600a88 tempest-VolumesServicesTestJSON-1067545175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4df33eef-0249-437c-b618-4b03fcea1105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:11:51 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-74f3d55d-14cb-4d1d-8657-765f60600a88 tempest-VolumesServicesTestJSON-1067545175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4df33eef-0249-437c-b618-4b03fcea1105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:11:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1176716826',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fd86b0a-b957-48be-8768-33ebb1e2f5eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b20aca00a78466a826384b07a456187',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:11:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:11:51Z,use_quota=True,user_id='e67c8999ea0c474f9b2d8ad502704f4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:11:51 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-74f3d55d-14cb-4d1d-8657-765f60600a88 tempest-VolumesServicesTestJSON-1067545175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ad412d3-c3c0-4104-b97f-1004e9220144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:11:51 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-74f3d55d-14cb-4d1d-8657-765f60600a88 tempest-VolumesServicesTestJSON-1067545175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ad412d3-c3c0-4104-b97f-1004e9220144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:11:51 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-74f3d55d-14cb-4d1d-8657-765f60600a88 tempest-VolumesServicesTestJSON-1067545175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9183668f-5b4c-4553-8e30-fcc02ac9716a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:11:51 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-74f3d55d-14cb-4d1d-8657-765f60600a88 tempest-VolumesServicesTestJSON-1067545175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9183668f-5b4c-4553-8e30-fcc02ac9716a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fd86b0a-b957-48be-8768-33ebb1e2f5eb', 'volume_name': 'volume-5fd86b0a-b957-48be-8768-33ebb1e2f5eb', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:11:51 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-74f3d55d-14cb-4d1d-8657-765f60600a88 tempest-VolumesServicesTestJSON-1067545175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c80a60b-c495-4b50-bff3-124c6d805cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:11:51 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-74f3d55d-14cb-4d1d-8657-765f60600a88 tempest-VolumesServicesTestJSON-1067545175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c80a60b-c495-4b50-bff3-124c6d805cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:11:51 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-74f3d55d-14cb-4d1d-8657-765f60600a88 tempest-VolumesServicesTestJSON-1067545175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (858827d5-9eaa-4795-a78a-71980ba7c3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:11:51 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-74f3d55d-14cb-4d1d-8657-765f60600a88 tempest-VolumesServicesTestJSON-1067545175 None] Volume 5fd86b0a-b957-48be-8768-33ebb1e2f5eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fd86b0a-b957-48be-8768-33ebb1e2f5eb', 'volume_size': 1}
Apr 28 22:11:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-74f3d55d-14cb-4d1d-8657-765f60600a88 tempest-VolumesServicesTestJSON-1067545175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:11:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-74f3d55d-14cb-4d1d-8657-765f60600a88 tempest-VolumesServicesTestJSON-1067545175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:11:51 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-74f3d55d-14cb-4d1d-8657-765f60600a88 tempest-VolumesServicesTestJSON-1067545175 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:11:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1176716826',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fd86b0a-b957-48be-8768-33ebb1e2f5eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b20aca00a78466a826384b07a456187',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:11:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:11:51Z,use_quota=True,user_id='e67c8999ea0c474f9b2d8ad502704f4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:11:51 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-74f3d55d-14cb-4d1d-8657-765f60600a88 tempest-VolumesServicesTestJSON-1067545175 None] Creating volume 5fd86b0a-b957-48be-8768-33ebb1e2f5eb {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:11:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-74f3d55d-14cb-4d1d-8657-765f60600a88 tempest-VolumesServicesTestJSON-1067545175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:11:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-74f3d55d-14cb-4d1d-8657-765f60600a88 tempest-VolumesServicesTestJSON-1067545175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:11:51 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-74f3d55d-14cb-4d1d-8657-765f60600a88 tempest-VolumesServicesTestJSON-1067545175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:11:51 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-74f3d55d-14cb-4d1d-8657-765f60600a88 tempest-VolumesServicesTestJSON-1067545175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:11:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-74f3d55d-14cb-4d1d-8657-765f60600a88 tempest-VolumesServicesTestJSON-1067545175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:11:51 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-74f3d55d-14cb-4d1d-8657-765f60600a88 tempest-VolumesServicesTestJSON-1067545175 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:11:51 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-74f3d55d-14cb-4d1d-8657-765f60600a88 tempest-VolumesServicesTestJSON-1067545175 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:11:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-74f3d55d-14cb-4d1d-8657-765f60600a88 tempest-VolumesServicesTestJSON-1067545175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-5fd86b0a-b957-48be-8768-33ebb1e2f5eb 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:11:51 devstack sudo[90585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-5fd86b0a-b957-48be-8768-33ebb1e2f5eb 1073741824
Apr 28 22:11:51 devstack sudo[90585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:11:52 devstack sudo[90585]: pam_unix(sudo:session): session closed for user root
Apr 28 22:11:52 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-74f3d55d-14cb-4d1d-8657-765f60600a88 tempest-VolumesServicesTestJSON-1067545175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-5fd86b0a-b957-48be-8768-33ebb1e2f5eb 1073741824" returned: 0 in 0.798s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:11:52 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-74f3d55d-14cb-4d1d-8657-765f60600a88 tempest-VolumesServicesTestJSON-1067545175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-5fd86b0a-b957-48be-8768-33ebb1e2f5eb {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:11:52 devstack sudo[90591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-5fd86b0a-b957-48be-8768-33ebb1e2f5eb
Apr 28 22:11:52 devstack sudo[90591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:11:53 devstack sudo[90591]: pam_unix(sudo:session): session closed for user root
Apr 28 22:11:53 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-74f3d55d-14cb-4d1d-8657-765f60600a88 tempest-VolumesServicesTestJSON-1067545175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-5fd86b0a-b957-48be-8768-33ebb1e2f5eb" returned: 0 in 0.817s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:11:53 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-74f3d55d-14cb-4d1d-8657-765f60600a88 tempest-VolumesServicesTestJSON-1067545175 None] <== create_volume: return (1663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:11:53 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-74f3d55d-14cb-4d1d-8657-765f60600a88 tempest-VolumesServicesTestJSON-1067545175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.665s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:11:53 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-74f3d55d-14cb-4d1d-8657-765f60600a88 tempest-VolumesServicesTestJSON-1067545175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (858827d5-9eaa-4795-a78a-71980ba7c3ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fd86b0a-b957-48be-8768-33ebb1e2f5eb', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:11:53 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-74f3d55d-14cb-4d1d-8657-765f60600a88 tempest-VolumesServicesTestJSON-1067545175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0c134c1-7113-4524-ab2f-95ca39f215ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:11:53 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-74f3d55d-14cb-4d1d-8657-765f60600a88 tempest-VolumesServicesTestJSON-1067545175 None] Volume volume-5fd86b0a-b957-48be-8768-33ebb1e2f5eb (5fd86b0a-b957-48be-8768-33ebb1e2f5eb): created successfully
Apr 28 22:11:53 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-74f3d55d-14cb-4d1d-8657-765f60600a88 tempest-VolumesServicesTestJSON-1067545175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0c134c1-7113-4524-ab2f-95ca39f215ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:11:53 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-74f3d55d-14cb-4d1d-8657-765f60600a88 tempest-VolumesServicesTestJSON-1067545175 None] Flow 'volume_create_manager' (d3bd5e90-6c36-4143-ae5b-2d61627ea716) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:11:53 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-74f3d55d-14cb-4d1d-8657-765f60600a88 tempest-VolumesServicesTestJSON-1067545175 None] Created volume successfully.
Apr 28 22:11:53 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-e887b07c-1f8f-4315-be41-be9aec900c87 tempest-VolumesServicesTestJSON-1067545175 None] Acquiring lock "cinder-5fd86b0a-b957-48be-8768-33ebb1e2f5eb-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:11:53 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-e887b07c-1f8f-4315-be41-be9aec900c87 tempest-VolumesServicesTestJSON-1067545175 None] Lock "cinder-5fd86b0a-b957-48be-8768-33ebb1e2f5eb-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:11:53 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-e887b07c-1f8f-4315-be41-be9aec900c87 tempest-VolumesServicesTestJSON-1067545175 None] Acquiring lock "cinder-quobyte-5fd86b0a-b957-48be-8768-33ebb1e2f5eb" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:11:53 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-e887b07c-1f8f-4315-be41-be9aec900c87 tempest-VolumesServicesTestJSON-1067545175 None] Lock "cinder-quobyte-5fd86b0a-b957-48be-8768-33ebb1e2f5eb" acquired by "delete_volume" :: waited 0.022s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:11:53 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0a1ce0-7d1f-4834-b780-df5cac521a7d]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:11:53 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e887b07c-1f8f-4315-be41-be9aec900c87 tempest-VolumesServicesTestJSON-1067545175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-5fd86b0a-b957-48be-8768-33ebb1e2f5eb {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:11:54 devstack sudo[90658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-5fd86b0a-b957-48be-8768-33ebb1e2f5eb
Apr 28 22:11:54 devstack sudo[90658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:11:54 devstack sudo[90658]: pam_unix(sudo:session): session closed for user root
Apr 28 22:11:54 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e887b07c-1f8f-4315-be41-be9aec900c87 tempest-VolumesServicesTestJSON-1067545175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-5fd86b0a-b957-48be-8768-33ebb1e2f5eb" returned: 0 in 0.872s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:11:54 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e887b07c-1f8f-4315-be41-be9aec900c87 tempest-VolumesServicesTestJSON-1067545175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-5fd86b0a-b957-48be-8768-33ebb1e2f5eb {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:11:54 devstack sudo[90664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-5fd86b0a-b957-48be-8768-33ebb1e2f5eb
Apr 28 22:11:54 devstack sudo[90664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:11:55 devstack sudo[90664]: pam_unix(sudo:session): session closed for user root
Apr 28 22:11:55 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e887b07c-1f8f-4315-be41-be9aec900c87 tempest-VolumesServicesTestJSON-1067545175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-5fd86b0a-b957-48be-8768-33ebb1e2f5eb" returned: 0 in 0.683s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:11:55 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-e887b07c-1f8f-4315-be41-be9aec900c87 tempest-VolumesServicesTestJSON-1067545175 None] Lock "cinder-quobyte-5fd86b0a-b957-48be-8768-33ebb1e2f5eb" released by "delete_volume" :: held 1.604s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:11:55 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-e887b07c-1f8f-4315-be41-be9aec900c87 tempest-VolumesServicesTestJSON-1067545175 None] Created reservations ['036de843-b3f5-48b1-b1fa-6963238667ad', '4f5daf48-24fa-4e08-8229-7e01edb2b506', 'a2de1f2b-9c59-443a-baff-9f4b6392d2c3', '0de7738a-f49d-4924-a894-f417d0fd464e'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:11:55 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-38601b44-f181-41fc-9d14-41079555e220 tempest-VolumesActionsTest-153568153 None] Acquiring lock "cinder-7bdcdad7-d5b2-462a-b86e-96f97226d282" by "attach_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:11:55 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-38601b44-f181-41fc-9d14-41079555e220 tempest-VolumesActionsTest-153568153 None] Lock "cinder-7bdcdad7-d5b2-462a-b86e-96f97226d282" acquired by "attach_volume" :: waited 0.032s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:11:55 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-e887b07c-1f8f-4315-be41-be9aec900c87 tempest-VolumesServicesTestJSON-1067545175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:11:55 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-e887b07c-1f8f-4315-be41-be9aec900c87 tempest-VolumesServicesTestJSON-1067545175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:11:55 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-e887b07c-1f8f-4315-be41-be9aec900c87 tempest-VolumesServicesTestJSON-1067545175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:11:55 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-e887b07c-1f8f-4315-be41-be9aec900c87 tempest-VolumesServicesTestJSON-1067545175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:11:55 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-e887b07c-1f8f-4315-be41-be9aec900c87 tempest-VolumesServicesTestJSON-1067545175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:11:55 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e887b07c-1f8f-4315-be41-be9aec900c87 tempest-VolumesServicesTestJSON-1067545175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:11:55 devstack sudo[90667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:11:55 devstack sudo[90667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:11:55 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-38601b44-f181-41fc-9d14-41079555e220 tempest-VolumesActionsTest-153568153 None] Attaching volume 7bdcdad7-d5b2-462a-b86e-96f97226d282 to instance 3ff349f9-26dc-4474-aa2e-b8cd9f97c9c9 at mountpoint /dev/vdb on host None.
Apr 28 22:11:55 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-38601b44-f181-41fc-9d14-41079555e220 tempest-VolumesActionsTest-153568153 None] Attach volume completed successfully.
Apr 28 22:11:55 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-38601b44-f181-41fc-9d14-41079555e220 tempest-VolumesActionsTest-153568153 None] Lock "cinder-7bdcdad7-d5b2-462a-b86e-96f97226d282" released by "attach_volume" :: held 0.164s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:11:56 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-2f3a037a-1a49-417f-811c-bd892cf6831a tempest-VolumesActionsTest-153568153 None] Acquiring lock "cinder-7bdcdad7-d5b2-462a-b86e-96f97226d282-detach_volume" by "detach_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:11:56 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-2f3a037a-1a49-417f-811c-bd892cf6831a tempest-VolumesActionsTest-153568153 None] Lock "cinder-7bdcdad7-d5b2-462a-b86e-96f97226d282-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:11:56 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-2f3a037a-1a49-417f-811c-bd892cf6831a tempest-VolumesActionsTest-153568153 None] Detaching volume 7bdcdad7-d5b2-462a-b86e-96f97226d282 from instance 3ff349f9-26dc-4474-aa2e-b8cd9f97c9c9.
Apr 28 22:11:56 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-2f3a037a-1a49-417f-811c-bd892cf6831a tempest-VolumesActionsTest-153568153 None] Detach volume completed successfully.
Apr 28 22:11:56 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-2f3a037a-1a49-417f-811c-bd892cf6831a tempest-VolumesActionsTest-153568153 None] Lock "cinder-7bdcdad7-d5b2-462a-b86e-96f97226d282-detach_volume" released by "detach_volume" :: held 0.108s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:11:56 devstack sudo[90667]: pam_unix(sudo:session): session closed for user root
Apr 28 22:11:56 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e887b07c-1f8f-4315-be41-be9aec900c87 tempest-VolumesServicesTestJSON-1067545175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.827s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:11:56 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-e887b07c-1f8f-4315-be41-be9aec900c87 tempest-VolumesServicesTestJSON-1067545175 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:11:56 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-e887b07c-1f8f-4315-be41-be9aec900c87 tempest-VolumesServicesTestJSON-1067545175 None] Deleted volume successfully.
Apr 28 22:11:56 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-e887b07c-1f8f-4315-be41-be9aec900c87 tempest-VolumesServicesTestJSON-1067545175 None] Lock "cinder-5fd86b0a-b957-48be-8768-33ebb1e2f5eb-delete_volume" released by "delete_volume" :: held 2.727s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:12:06 devstack cinder-volume[83924]: DEBUG dbcounter [-] [83924] Writing DB stats cinder:UPDATE=14,cinder:SELECT=15,cinder:INSERT=4,cinder:DELETE=1 {{(pid=83924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 28 22:12:06 devstack cinder-volume[83924]: DEBUG dbcounter [-] [83924] Writing DB stats cinder:SELECT=12,cinder:UPDATE=14,cinder:INSERT=3,cinder:DELETE=1 {{(pid=83924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 28 22:12:25 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-1e3a9f5b-e1a0-4f04-bf5e-42e01c47f531 tempest-VolumesActionsTest-153568153 None] Acquiring lock "cinder-7bdcdad7-d5b2-462a-b86e-96f97226d282" by "attach_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:12:25 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-1e3a9f5b-e1a0-4f04-bf5e-42e01c47f531 tempest-VolumesActionsTest-153568153 None] Lock "cinder-7bdcdad7-d5b2-462a-b86e-96f97226d282" acquired by "attach_volume" :: waited 0.023s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:12:25 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-1e3a9f5b-e1a0-4f04-bf5e-42e01c47f531 tempest-VolumesActionsTest-153568153 None] Attaching volume 7bdcdad7-d5b2-462a-b86e-96f97226d282 to instance 3043ade7-c034-43cd-b611-013390a3dcaf at mountpoint /dev/vdb on host None.
Apr 28 22:12:25 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-1e3a9f5b-e1a0-4f04-bf5e-42e01c47f531 tempest-VolumesActionsTest-153568153 None] Attach volume completed successfully.
Apr 28 22:12:25 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-1e3a9f5b-e1a0-4f04-bf5e-42e01c47f531 tempest-VolumesActionsTest-153568153 None] Lock "cinder-7bdcdad7-d5b2-462a-b86e-96f97226d282" released by "attach_volume" :: held 0.139s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:12:26 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-7df9873b-5ca0-49fd-841e-b7060ccab65f tempest-VolumesActionsTest-153568153 None] Acquiring lock "cinder-7bdcdad7-d5b2-462a-b86e-96f97226d282-detach_volume" by "detach_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:12:26 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-7df9873b-5ca0-49fd-841e-b7060ccab65f tempest-VolumesActionsTest-153568153 None] Lock "cinder-7bdcdad7-d5b2-462a-b86e-96f97226d282-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:12:26 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-7df9873b-5ca0-49fd-841e-b7060ccab65f tempest-VolumesActionsTest-153568153 None] Detaching volume 7bdcdad7-d5b2-462a-b86e-96f97226d282 from instance 3043ade7-c034-43cd-b611-013390a3dcaf.
Apr 28 22:12:26 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-7df9873b-5ca0-49fd-841e-b7060ccab65f tempest-VolumesActionsTest-153568153 None] Detach volume completed successfully.
Apr 28 22:12:26 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-7df9873b-5ca0-49fd-841e-b7060ccab65f tempest-VolumesActionsTest-153568153 None] Lock "cinder-7bdcdad7-d5b2-462a-b86e-96f97226d282-detach_volume" released by "detach_volume" :: held 0.119s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:12:35 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-ad642c4e-d372-4982-ae38-41df7e5f59db tempest-VolumesActionsTest-153568153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:12:35 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-ad642c4e-d372-4982-ae38-41df7e5f59db tempest-VolumesActionsTest-153568153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:12:35 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b3d94d-1945-454f-9137-cd293f4516c8]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:12:35 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-ad642c4e-d372-4982-ae38-41df7e5f59db tempest-VolumesActionsTest-153568153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7bdcdad7-d5b2-462a-b86e-96f97226d282 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:12:36 devstack sudo[90945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7bdcdad7-d5b2-462a-b86e-96f97226d282
Apr 28 22:12:36 devstack sudo[90945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:12:36 devstack cinder-volume[83924]: DEBUG dbcounter [-] [83924] Writing DB stats cinder:SELECT=5,cinder:INSERT=2,cinder:UPDATE=2 {{(pid=83924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 28 22:12:36 devstack sudo[90945]: pam_unix(sudo:session): session closed for user root
Apr 28 22:12:36 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-ad642c4e-d372-4982-ae38-41df7e5f59db tempest-VolumesActionsTest-153568153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7bdcdad7-d5b2-462a-b86e-96f97226d282" returned: 0 in 0.708s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:12:36 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4ed444-b2b2-48b3-b5f6-b756e2d61e28]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:12:36 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-ad642c4e-d372-4982-ae38-41df7e5f59db tempest-VolumesActionsTest-153568153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7bdcdad7-d5b2-462a-b86e-96f97226d282 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:12:36 devstack sudo[90950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7bdcdad7-d5b2-462a-b86e-96f97226d282
Apr 28 22:12:36 devstack sudo[90950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:12:37 devstack sudo[90950]: pam_unix(sudo:session): session closed for user root
Apr 28 22:12:37 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-ad642c4e-d372-4982-ae38-41df7e5f59db tempest-VolumesActionsTest-153568153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7bdcdad7-d5b2-462a-b86e-96f97226d282" returned: 0 in 0.810s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:12:37 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-ad642c4e-d372-4982-ae38-41df7e5f59db tempest-VolumesActionsTest-153568153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7bdcdad7-d5b2-462a-b86e-96f97226d282 /opt/stack/data/cinder/conversion/7bdcdad7-d5b2-462a-b86e-96f97226d282.temp_image.33387373-acd5-4143-bf37-7792503e31482k1siz05.img {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:12:37 devstack sudo[90955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7bdcdad7-d5b2-462a-b86e-96f97226d282 /opt/stack/data/cinder/conversion/7bdcdad7-d5b2-462a-b86e-96f97226d282.temp_image.33387373-acd5-4143-bf37-7792503e31482k1siz05.img
Apr 28 22:12:37 devstack sudo[90955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:12:39 devstack cinder-volume[83924]: DEBUG oslo_service.periodic_task [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83924) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 28 22:12:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:12:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:12:39 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:12:39 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:12:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:12:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:12:39 devstack sudo[90984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:12:39 devstack sudo[90984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:12:41 devstack sudo[90984]: pam_unix(sudo:session): session closed for user root
Apr 28 22:12:41 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 1.330s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:12:41 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:12:42 devstack sudo[90955]: pam_unix(sudo:session): session closed for user root
Apr 28 22:12:42 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-ad642c4e-d372-4982-ae38-41df7e5f59db tempest-VolumesActionsTest-153568153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7bdcdad7-d5b2-462a-b86e-96f97226d282 /opt/stack/data/cinder/conversion/7bdcdad7-d5b2-462a-b86e-96f97226d282.temp_image.33387373-acd5-4143-bf37-7792503e31482k1siz05.img" returned: 0 in 5.036s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:12:42 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25119c4-343b-4c15-aef4-c0fc9927ffe9]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:12:42 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-ad642c4e-d372-4982-ae38-41df7e5f59db tempest-VolumesActionsTest-153568153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7bdcdad7-d5b2-462a-b86e-96f97226d282 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:12:42 devstack sudo[90990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7bdcdad7-d5b2-462a-b86e-96f97226d282
Apr 28 22:12:42 devstack sudo[90990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:12:43 devstack sudo[90990]: pam_unix(sudo:session): session closed for user root
Apr 28 22:12:43 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-ad642c4e-d372-4982-ae38-41df7e5f59db tempest-VolumesActionsTest-153568153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7bdcdad7-d5b2-462a-b86e-96f97226d282" returned: 0 in 0.876s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:12:43 devstack cinder-volume[83924]: DEBUG cinder.image.image_utils [None req-ad642c4e-d372-4982-ae38-41df7e5f59db tempest-VolumesActionsTest-153568153 None] Image conversion details: src /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7bdcdad7-d5b2-462a-b86e-96f97226d282, size 1024.00 MB, duration 5.04 sec, destination /opt/stack/data/cinder/conversion/7bdcdad7-d5b2-462a-b86e-96f97226d282.temp_image.33387373-acd5-4143-bf37-7792503e31482k1siz05.img {{(pid=83924) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 28 22:12:43 devstack cinder-volume[83924]: INFO cinder.image.image_utils [None req-ad642c4e-d372-4982-ae38-41df7e5f59db tempest-VolumesActionsTest-153568153 None] Converted 1024.00 MB image at 203.30 MB/s
Apr 28 22:12:43 devstack cinder-volume[83924]: DEBUG cinder.image.image_utils [None req-ad642c4e-d372-4982-ae38-41df7e5f59db tempest-VolumesActionsTest-153568153 None] 33387373-acd5-4143-bf37-7792503e3148 was raw, no need to convert to raw {{(pid=83924) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}}
Apr 28 22:12:50 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cc0aad2-5007-48c1-8d96-70b1e6b00e80 tempest-VolumesActionsTest-569706945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:12:50 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-1cc0aad2-5007-48c1-8d96-70b1e6b00e80 tempest-VolumesActionsTest-569706945 None] Flow 'volume_create_manager' (be46b0d4-dff8-4de5-94c5-4afc640fe1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:12:50 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-1cc0aad2-5007-48c1-8d96-70b1e6b00e80 tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8ee9a11-d0d0-4061-a75f-3e50e8f17886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:12:50 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-1cc0aad2-5007-48c1-8d96-70b1e6b00e80 tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8ee9a11-d0d0-4061-a75f-3e50e8f17886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:12:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1961132908',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8b38f13-7a8c-48dc-8728-cfd5b6e52364,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='417e78d847a14bb7b984ce42071a7dcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:12:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:12:50Z,use_quota=True,user_id='593c239cd1704470a2e916dd6a242c9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:12:50 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-1cc0aad2-5007-48c1-8d96-70b1e6b00e80 tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3187baa-650d-4bf1-94d2-0d804ef8f0a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:12:50 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-1cc0aad2-5007-48c1-8d96-70b1e6b00e80 tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3187baa-650d-4bf1-94d2-0d804ef8f0a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:12:50 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-1cc0aad2-5007-48c1-8d96-70b1e6b00e80 tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e97c2e6-781d-4be2-b3b5-c475223818e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:12:50 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-1cc0aad2-5007-48c1-8d96-70b1e6b00e80 tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e97c2e6-781d-4be2-b3b5-c475223818e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8b38f13-7a8c-48dc-8728-cfd5b6e52364', 'volume_name': 'volume-a8b38f13-7a8c-48dc-8728-cfd5b6e52364', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:12:50 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-1cc0aad2-5007-48c1-8d96-70b1e6b00e80 tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bf2f57a-e1c0-4961-9a5a-d66f1461a5da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:12:50 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-1cc0aad2-5007-48c1-8d96-70b1e6b00e80 tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bf2f57a-e1c0-4961-9a5a-d66f1461a5da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:12:50 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-1cc0aad2-5007-48c1-8d96-70b1e6b00e80 tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5893116a-01b8-4fc9-8ca0-f03a1f360f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:12:50 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-1cc0aad2-5007-48c1-8d96-70b1e6b00e80 tempest-VolumesActionsTest-569706945 None] Volume a8b38f13-7a8c-48dc-8728-cfd5b6e52364: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8b38f13-7a8c-48dc-8728-cfd5b6e52364', 'volume_size': 1}
Apr 28 22:12:50 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-1cc0aad2-5007-48c1-8d96-70b1e6b00e80 tempest-VolumesActionsTest-569706945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:13:00 devstack cinder-volume[83924]: DEBUG dbcounter [-] [83924] Writing DB stats cinder:UPDATE=6,cinder:SELECT=12 {{(pid=83924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 28 22:13:00 devstack cinder-volume[83924]: DEBUG dbcounter [-] [83924] Writing DB stats cinder:SELECT=2 {{(pid=83924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 28 22:13:03 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-ad642c4e-d372-4982-ae38-41df7e5f59db tempest-VolumesActionsTest-153568153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 27.675s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:13:03 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-ad642c4e-d372-4982-ae38-41df7e5f59db tempest-VolumesActionsTest-153568153 None] Uploaded volume to glance image-id: 33387373-acd5-4143-bf37-7792503e3148. {{(pid=83924) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 28 22:13:03 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-1cc0aad2-5007-48c1-8d96-70b1e6b00e80 tempest-VolumesActionsTest-569706945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.341s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:13:03 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-1cc0aad2-5007-48c1-8d96-70b1e6b00e80 tempest-VolumesActionsTest-569706945 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:12:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1961132908',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8b38f13-7a8c-48dc-8728-cfd5b6e52364,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='417e78d847a14bb7b984ce42071a7dcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:12:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:12:50Z,use_quota=True,user_id='593c239cd1704470a2e916dd6a242c9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:13:03 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-1cc0aad2-5007-48c1-8d96-70b1e6b00e80 tempest-VolumesActionsTest-569706945 None] Creating volume a8b38f13-7a8c-48dc-8728-cfd5b6e52364 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:13:03 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-1cc0aad2-5007-48c1-8d96-70b1e6b00e80 tempest-VolumesActionsTest-569706945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:13:03 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-1cc0aad2-5007-48c1-8d96-70b1e6b00e80 tempest-VolumesActionsTest-569706945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:13:03 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-1cc0aad2-5007-48c1-8d96-70b1e6b00e80 tempest-VolumesActionsTest-569706945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:13:03 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-1cc0aad2-5007-48c1-8d96-70b1e6b00e80 tempest-VolumesActionsTest-569706945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:13:03 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-1cc0aad2-5007-48c1-8d96-70b1e6b00e80 tempest-VolumesActionsTest-569706945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:13:03 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-1cc0aad2-5007-48c1-8d96-70b1e6b00e80 tempest-VolumesActionsTest-569706945 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:13:03 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-1cc0aad2-5007-48c1-8d96-70b1e6b00e80 tempest-VolumesActionsTest-569706945 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:13:03 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-1cc0aad2-5007-48c1-8d96-70b1e6b00e80 tempest-VolumesActionsTest-569706945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a8b38f13-7a8c-48dc-8728-cfd5b6e52364 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:13:03 devstack sudo[91081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a8b38f13-7a8c-48dc-8728-cfd5b6e52364 1073741824
Apr 28 22:13:03 devstack sudo[91081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:13:03 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-ad642c4e-d372-4982-ae38-41df7e5f59db tempest-VolumesActionsTest-153568153 None] Copy volume to image completed successfully.
Apr 28 22:13:04 devstack sudo[91081]: pam_unix(sudo:session): session closed for user root
Apr 28 22:13:04 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-1cc0aad2-5007-48c1-8d96-70b1e6b00e80 tempest-VolumesActionsTest-569706945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a8b38f13-7a8c-48dc-8728-cfd5b6e52364 1073741824" returned: 0 in 0.834s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:13:04 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-1cc0aad2-5007-48c1-8d96-70b1e6b00e80 tempest-VolumesActionsTest-569706945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a8b38f13-7a8c-48dc-8728-cfd5b6e52364 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:13:04 devstack sudo[91086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a8b38f13-7a8c-48dc-8728-cfd5b6e52364
Apr 28 22:13:04 devstack sudo[91086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:13:05 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-a608eb5f-2c1b-4a84-8510-d3a85c653aa9 tempest-VolumesActionsTest-153568153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:13:05 devstack sudo[91086]: pam_unix(sudo:session): session closed for user root
Apr 28 22:13:05 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-1cc0aad2-5007-48c1-8d96-70b1e6b00e80 tempest-VolumesActionsTest-569706945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a8b38f13-7a8c-48dc-8728-cfd5b6e52364" returned: 0 in 0.661s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:13:05 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-1cc0aad2-5007-48c1-8d96-70b1e6b00e80 tempest-VolumesActionsTest-569706945 None] <== create_volume: return (1536ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:13:05 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-1cc0aad2-5007-48c1-8d96-70b1e6b00e80 tempest-VolumesActionsTest-569706945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.538s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:13:05 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-a608eb5f-2c1b-4a84-8510-d3a85c653aa9 tempest-VolumesActionsTest-153568153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.078s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:13:05 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-1cc0aad2-5007-48c1-8d96-70b1e6b00e80 tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5893116a-01b8-4fc9-8ca0-f03a1f360f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8b38f13-7a8c-48dc-8728-cfd5b6e52364', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:13:05 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-1cc0aad2-5007-48c1-8d96-70b1e6b00e80 tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ab096c0-6b55-4b75-acda-885a4e9715b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:13:05 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca5f24a-3cd0-447c-af70-54a390265e2b]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:13:05 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a608eb5f-2c1b-4a84-8510-d3a85c653aa9 tempest-VolumesActionsTest-153568153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7bdcdad7-d5b2-462a-b86e-96f97226d282 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:13:05 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-1cc0aad2-5007-48c1-8d96-70b1e6b00e80 tempest-VolumesActionsTest-569706945 None] Volume volume-a8b38f13-7a8c-48dc-8728-cfd5b6e52364 (a8b38f13-7a8c-48dc-8728-cfd5b6e52364): created successfully
Apr 28 22:13:05 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-1cc0aad2-5007-48c1-8d96-70b1e6b00e80 tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ab096c0-6b55-4b75-acda-885a4e9715b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:13:05 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-1cc0aad2-5007-48c1-8d96-70b1e6b00e80 tempest-VolumesActionsTest-569706945 None] Flow 'volume_create_manager' (be46b0d4-dff8-4de5-94c5-4afc640fe1dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:13:05 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-1cc0aad2-5007-48c1-8d96-70b1e6b00e80 tempest-VolumesActionsTest-569706945 None] Created volume successfully.
Apr 28 22:13:05 devstack sudo[91089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7bdcdad7-d5b2-462a-b86e-96f97226d282
Apr 28 22:13:05 devstack sudo[91089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:13:05 devstack sudo[91089]: pam_unix(sudo:session): session closed for user root
Apr 28 22:13:05 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a608eb5f-2c1b-4a84-8510-d3a85c653aa9 tempest-VolumesActionsTest-153568153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7bdcdad7-d5b2-462a-b86e-96f97226d282" returned: 0 in 0.685s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:13:05 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e745a60a-5e6d-4874-8de8-9fac55b77c39]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:13:05 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a608eb5f-2c1b-4a84-8510-d3a85c653aa9 tempest-VolumesActionsTest-153568153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7bdcdad7-d5b2-462a-b86e-96f97226d282 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:13:05 devstack sudo[91094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7bdcdad7-d5b2-462a-b86e-96f97226d282
Apr 28 22:13:05 devstack sudo[91094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:13:06 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-0510e212-d491-4577-838c-147b631dadfb tempest-VolumesActionsTest-569706945 None] Acquiring lock "cinder-a8b38f13-7a8c-48dc-8728-cfd5b6e52364" by "attach_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:13:06 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-0510e212-d491-4577-838c-147b631dadfb tempest-VolumesActionsTest-569706945 None] Lock "cinder-a8b38f13-7a8c-48dc-8728-cfd5b6e52364" acquired by "attach_volume" :: waited 0.020s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:13:06 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-0510e212-d491-4577-838c-147b631dadfb tempest-VolumesActionsTest-569706945 None] Attaching volume a8b38f13-7a8c-48dc-8728-cfd5b6e52364 to instance c448ee21-81d7-4620-99de-27270f5e5dee at mountpoint /dev/vdb on host None.
Apr 28 22:13:06 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-0510e212-d491-4577-838c-147b631dadfb tempest-VolumesActionsTest-569706945 None] Attach volume completed successfully.
Apr 28 22:13:06 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-0510e212-d491-4577-838c-147b631dadfb tempest-VolumesActionsTest-569706945 None] Lock "cinder-a8b38f13-7a8c-48dc-8728-cfd5b6e52364" released by "attach_volume" :: held 0.101s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:13:06 devstack sudo[91094]: pam_unix(sudo:session): session closed for user root
Apr 28 22:13:06 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a608eb5f-2c1b-4a84-8510-d3a85c653aa9 tempest-VolumesActionsTest-153568153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7bdcdad7-d5b2-462a-b86e-96f97226d282" returned: 0 in 0.750s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:13:06 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a608eb5f-2c1b-4a84-8510-d3a85c653aa9 tempest-VolumesActionsTest-153568153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7bdcdad7-d5b2-462a-b86e-96f97226d282 /opt/stack/data/cinder/conversion/7bdcdad7-d5b2-462a-b86e-96f97226d282.temp_image.79325f86-1174-49fd-9f03-f6db5afedfefima26ww0.img {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:13:06 devstack sudo[91099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7bdcdad7-d5b2-462a-b86e-96f97226d282 /opt/stack/data/cinder/conversion/7bdcdad7-d5b2-462a-b86e-96f97226d282.temp_image.79325f86-1174-49fd-9f03-f6db5afedfefima26ww0.img
Apr 28 22:13:06 devstack sudo[91099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:13:07 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-10a7bc76-44be-4714-8fc4-784e314d6848 tempest-VolumesActionsTest-1263735328 None] Terminate volume connection completed successfully.
Apr 28 22:13:07 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-10a7bc76-44be-4714-8fc4-784e314d6848 tempest-VolumesActionsTest-1263735328 None] Acquiring lock "cinder-a8b38f13-7a8c-48dc-8728-cfd5b6e52364-detach_volume" by "detach_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:13:07 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-10a7bc76-44be-4714-8fc4-784e314d6848 tempest-VolumesActionsTest-1263735328 None] Lock "cinder-a8b38f13-7a8c-48dc-8728-cfd5b6e52364-detach_volume" acquired by "detach_volume" :: waited 0.060s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:13:07 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-10a7bc76-44be-4714-8fc4-784e314d6848 tempest-VolumesActionsTest-1263735328 None] Detaching volume a8b38f13-7a8c-48dc-8728-cfd5b6e52364 from instance c448ee21-81d7-4620-99de-27270f5e5dee.
Apr 28 22:13:07 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-10a7bc76-44be-4714-8fc4-784e314d6848 tempest-VolumesActionsTest-1263735328 None] Detach volume completed successfully.
Apr 28 22:13:07 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-10a7bc76-44be-4714-8fc4-784e314d6848 tempest-VolumesActionsTest-1263735328 None] Lock "cinder-a8b38f13-7a8c-48dc-8728-cfd5b6e52364-detach_volume" released by "detach_volume" :: held 0.187s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:13:08 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-d9275e19-71b2-43bd-882a-c80442984f5e tempest-VolumesActionsTest-569706945 None] Acquiring lock "cinder-a8b38f13-7a8c-48dc-8728-cfd5b6e52364-detach_volume" by "detach_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:13:08 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-d9275e19-71b2-43bd-882a-c80442984f5e tempest-VolumesActionsTest-569706945 None] Lock "cinder-a8b38f13-7a8c-48dc-8728-cfd5b6e52364-detach_volume" acquired by "detach_volume" :: waited 0.042s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:13:08 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-d9275e19-71b2-43bd-882a-c80442984f5e tempest-VolumesActionsTest-569706945 None] Volume detach called, but volume not attached.
Apr 28 22:13:08 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-d9275e19-71b2-43bd-882a-c80442984f5e tempest-VolumesActionsTest-569706945 None] Lock "cinder-a8b38f13-7a8c-48dc-8728-cfd5b6e52364-detach_volume" released by "detach_volume" :: held 0.066s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:13:09 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-8387686c-e171-4a79-a0d3-6074c50d4977 tempest-VolumesActionsTest-569706945 None] Acquiring lock "cinder-a8b38f13-7a8c-48dc-8728-cfd5b6e52364-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:13:09 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-8387686c-e171-4a79-a0d3-6074c50d4977 tempest-VolumesActionsTest-569706945 None] Lock "cinder-a8b38f13-7a8c-48dc-8728-cfd5b6e52364-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:13:09 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-8387686c-e171-4a79-a0d3-6074c50d4977 tempest-VolumesActionsTest-569706945 None] Acquiring lock "cinder-quobyte-a8b38f13-7a8c-48dc-8728-cfd5b6e52364" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:13:09 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-8387686c-e171-4a79-a0d3-6074c50d4977 tempest-VolumesActionsTest-569706945 None] Lock "cinder-quobyte-a8b38f13-7a8c-48dc-8728-cfd5b6e52364" acquired by "delete_volume" :: waited 0.055s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:13:09 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[25785d11-d6f0-4ca0-b07d-7c9f3d181c90]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:13:09 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-8387686c-e171-4a79-a0d3-6074c50d4977 tempest-VolumesActionsTest-569706945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a8b38f13-7a8c-48dc-8728-cfd5b6e52364 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:13:10 devstack sudo[91111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a8b38f13-7a8c-48dc-8728-cfd5b6e52364
Apr 28 22:13:10 devstack sudo[91111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:13:11 devstack sudo[91111]: pam_unix(sudo:session): session closed for user root
Apr 28 22:13:11 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-8387686c-e171-4a79-a0d3-6074c50d4977 tempest-VolumesActionsTest-569706945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a8b38f13-7a8c-48dc-8728-cfd5b6e52364" returned: 0 in 1.364s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:13:11 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-8387686c-e171-4a79-a0d3-6074c50d4977 tempest-VolumesActionsTest-569706945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a8b38f13-7a8c-48dc-8728-cfd5b6e52364 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:13:11 devstack sudo[91120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a8b38f13-7a8c-48dc-8728-cfd5b6e52364
Apr 28 22:13:11 devstack sudo[91120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:13:11 devstack sudo[91099]: pam_unix(sudo:session): session closed for user root
Apr 28 22:13:11 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a608eb5f-2c1b-4a84-8510-d3a85c653aa9 tempest-VolumesActionsTest-153568153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7bdcdad7-d5b2-462a-b86e-96f97226d282 /opt/stack/data/cinder/conversion/7bdcdad7-d5b2-462a-b86e-96f97226d282.temp_image.79325f86-1174-49fd-9f03-f6db5afedfefima26ww0.img" returned: 0 in 5.201s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:13:11 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22623d5-fac0-4cf3-a609-faead7709aa3]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:13:11 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a608eb5f-2c1b-4a84-8510-d3a85c653aa9 tempest-VolumesActionsTest-153568153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7bdcdad7-d5b2-462a-b86e-96f97226d282 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:13:11 devstack sudo[91122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7bdcdad7-d5b2-462a-b86e-96f97226d282
Apr 28 22:13:11 devstack sudo[91122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:13:12 devstack sudo[91120]: pam_unix(sudo:session): session closed for user root
Apr 28 22:13:12 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-8387686c-e171-4a79-a0d3-6074c50d4977 tempest-VolumesActionsTest-569706945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a8b38f13-7a8c-48dc-8728-cfd5b6e52364" returned: 0 in 0.861s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:13:12 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-8387686c-e171-4a79-a0d3-6074c50d4977 tempest-VolumesActionsTest-569706945 None] Lock "cinder-quobyte-a8b38f13-7a8c-48dc-8728-cfd5b6e52364" released by "delete_volume" :: held 2.306s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:13:12 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-8387686c-e171-4a79-a0d3-6074c50d4977 tempest-VolumesActionsTest-569706945 None] Created reservations ['7505e2ec-9b22-4ece-a18f-8bc2c6853aac', '4f9dec76-a70a-48b9-be83-7a9c336f968f', '5dc14712-ba3b-4991-ae03-606dc1203a00', '2b56bfa6-8543-4446-ba22-ffb97e2fa698'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:13:12 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-8387686c-e171-4a79-a0d3-6074c50d4977 tempest-VolumesActionsTest-569706945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:13:12 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-8387686c-e171-4a79-a0d3-6074c50d4977 tempest-VolumesActionsTest-569706945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:13:12 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-8387686c-e171-4a79-a0d3-6074c50d4977 tempest-VolumesActionsTest-569706945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:13:12 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-8387686c-e171-4a79-a0d3-6074c50d4977 tempest-VolumesActionsTest-569706945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:13:12 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-8387686c-e171-4a79-a0d3-6074c50d4977 tempest-VolumesActionsTest-569706945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:13:12 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-8387686c-e171-4a79-a0d3-6074c50d4977 tempest-VolumesActionsTest-569706945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:13:12 devstack sudo[91125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:13:12 devstack sudo[91125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:13:12 devstack sudo[91122]: pam_unix(sudo:session): session closed for user root
Apr 28 22:13:12 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a608eb5f-2c1b-4a84-8510-d3a85c653aa9 tempest-VolumesActionsTest-153568153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7bdcdad7-d5b2-462a-b86e-96f97226d282" returned: 0 in 0.938s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:13:12 devstack cinder-volume[83924]: DEBUG cinder.image.image_utils [None req-a608eb5f-2c1b-4a84-8510-d3a85c653aa9 tempest-VolumesActionsTest-153568153 None] Image conversion details: src /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7bdcdad7-d5b2-462a-b86e-96f97226d282, size 1024.00 MB, duration 5.20 sec, destination /opt/stack/data/cinder/conversion/7bdcdad7-d5b2-462a-b86e-96f97226d282.temp_image.79325f86-1174-49fd-9f03-f6db5afedfefima26ww0.img {{(pid=83924) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 28 22:13:12 devstack cinder-volume[83924]: INFO cinder.image.image_utils [None req-a608eb5f-2c1b-4a84-8510-d3a85c653aa9 tempest-VolumesActionsTest-153568153 None] Converted 1024.00 MB image at 196.85 MB/s
Apr 28 22:13:12 devstack cinder-volume[83924]: DEBUG cinder.image.image_utils [None req-a608eb5f-2c1b-4a84-8510-d3a85c653aa9 tempest-VolumesActionsTest-153568153 None] 79325f86-1174-49fd-9f03-f6db5afedfef was raw, converting to qcow2 {{(pid=83924) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}}
Apr 28 22:13:12 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[3621fa3a-a9f7-41b3-9743-bad53aec95e2]: (4, 'raw') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:13:12 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a608eb5f-2c1b-4a84-8510-d3a85c653aa9 tempest-VolumesActionsTest-153568153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/7bdcdad7-d5b2-462a-b86e-96f97226d282.temp_image.79325f86-1174-49fd-9f03-f6db5afedfefima26ww0.img {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:13:12 devstack sudo[91125]: pam_unix(sudo:session): session closed for user root
Apr 28 22:13:12 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-8387686c-e171-4a79-a0d3-6074c50d4977 tempest-VolumesActionsTest-569706945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.602s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:13:12 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-8387686c-e171-4a79-a0d3-6074c50d4977 tempest-VolumesActionsTest-569706945 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:13:12 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-8387686c-e171-4a79-a0d3-6074c50d4977 tempest-VolumesActionsTest-569706945 None] Deleted volume successfully.
Apr 28 22:13:12 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-8387686c-e171-4a79-a0d3-6074c50d4977 tempest-VolumesActionsTest-569706945 None] Lock "cinder-a8b38f13-7a8c-48dc-8728-cfd5b6e52364-delete_volume" released by "delete_volume" :: held 3.241s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:13:12 devstack sudo[91131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/7bdcdad7-d5b2-462a-b86e-96f97226d282.temp_image.79325f86-1174-49fd-9f03-f6db5afedfefima26ww0.img
Apr 28 22:13:12 devstack sudo[91131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:13:13 devstack sudo[91131]: pam_unix(sudo:session): session closed for user root
Apr 28 22:13:13 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a608eb5f-2c1b-4a84-8510-d3a85c653aa9 tempest-VolumesActionsTest-153568153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/7bdcdad7-d5b2-462a-b86e-96f97226d282.temp_image.79325f86-1174-49fd-9f03-f6db5afedfefima26ww0.img" returned: 0 in 0.693s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:13:13 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a608eb5f-2c1b-4a84-8510-d3a85c653aa9 tempest-VolumesActionsTest-153568153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7bdcdad7-d5b2-462a-b86e-96f97226d282.temp_image.79325f86-1174-49fd-9f03-f6db5afedfefima26ww0.img {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:13:13 devstack sudo[91136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7bdcdad7-d5b2-462a-b86e-96f97226d282.temp_image.79325f86-1174-49fd-9f03-f6db5afedfefima26ww0.img
Apr 28 22:13:13 devstack sudo[91136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:13:14 devstack sudo[91136]: pam_unix(sudo:session): session closed for user root
Apr 28 22:13:14 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a608eb5f-2c1b-4a84-8510-d3a85c653aa9 tempest-VolumesActionsTest-153568153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7bdcdad7-d5b2-462a-b86e-96f97226d282.temp_image.79325f86-1174-49fd-9f03-f6db5afedfefima26ww0.img" returned: 1 in 0.694s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:13:14 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a608eb5f-2c1b-4a84-8510-d3a85c653aa9 tempest-VolumesActionsTest-153568153 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7bdcdad7-d5b2-462a-b86e-96f97226d282.temp_image.79325f86-1174-49fd-9f03-f6db5afedfefima26ww0.img' failed. Not Retrying. {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 28 22:13:14 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a608eb5f-2c1b-4a84-8510-d3a85c653aa9 tempest-VolumesActionsTest-153568153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/7bdcdad7-d5b2-462a-b86e-96f97226d282.temp_image.79325f86-1174-49fd-9f03-f6db5afedfefima26ww0.img /opt/stack/data/cinder/conversion/vol_upload_8jfbl2ha {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:13:14 devstack sudo[91149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/7bdcdad7-d5b2-462a-b86e-96f97226d282.temp_image.79325f86-1174-49fd-9f03-f6db5afedfefima26ww0.img /opt/stack/data/cinder/conversion/vol_upload_8jfbl2ha
Apr 28 22:13:14 devstack sudo[91149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:13:14 devstack sudo[91149]: pam_unix(sudo:session): session closed for user root
Apr 28 22:13:14 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a608eb5f-2c1b-4a84-8510-d3a85c653aa9 tempest-VolumesActionsTest-153568153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/7bdcdad7-d5b2-462a-b86e-96f97226d282.temp_image.79325f86-1174-49fd-9f03-f6db5afedfefima26ww0.img /opt/stack/data/cinder/conversion/vol_upload_8jfbl2ha" returned: 0 in 0.734s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:13:14 devstack cinder-volume[83924]: DEBUG cinder.image.image_utils [None req-a608eb5f-2c1b-4a84-8510-d3a85c653aa9 tempest-VolumesActionsTest-153568153 None] Image conversion details: src /opt/stack/data/cinder/conversion/7bdcdad7-d5b2-462a-b86e-96f97226d282.temp_image.79325f86-1174-49fd-9f03-f6db5afedfefima26ww0.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_8jfbl2ha {{(pid=83924) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 28 22:13:14 devstack cinder-volume[83924]: INFO cinder.image.image_utils [None req-a608eb5f-2c1b-4a84-8510-d3a85c653aa9 tempest-VolumesActionsTest-153568153 None] Converted 1024.00 MB image at 1024.00 MB/s
Apr 28 22:13:14 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1141162-09e9-4f19-b98d-c8a6d40754dd]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:13:14 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a608eb5f-2c1b-4a84-8510-d3a85c653aa9 tempest-VolumesActionsTest-153568153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_8jfbl2ha {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:13:15 devstack sudo[91186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_8jfbl2ha
Apr 28 22:13:15 devstack sudo[91186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:13:15 devstack sudo[91186]: pam_unix(sudo:session): session closed for user root
Apr 28 22:13:15 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a608eb5f-2c1b-4a84-8510-d3a85c653aa9 tempest-VolumesActionsTest-153568153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_8jfbl2ha" returned: 0 in 0.708s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:13:17 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-a608eb5f-2c1b-4a84-8510-d3a85c653aa9 tempest-VolumesActionsTest-153568153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.073s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:13:17 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a608eb5f-2c1b-4a84-8510-d3a85c653aa9 tempest-VolumesActionsTest-153568153 None] Uploaded volume to glance image-id: 79325f86-1174-49fd-9f03-f6db5afedfef. {{(pid=83924) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 28 22:13:17 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-a608eb5f-2c1b-4a84-8510-d3a85c653aa9 tempest-VolumesActionsTest-153568153 None] Copy volume to image completed successfully.
Apr 28 22:13:18 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-1a435ee4-88e8-4eb1-b738-c621edc25c7d tempest-VolumesActionsTest-153568153 None] Acquiring lock "cinder-7bdcdad7-d5b2-462a-b86e-96f97226d282-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:13:18 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-1a435ee4-88e8-4eb1-b738-c621edc25c7d tempest-VolumesActionsTest-153568153 None] Lock "cinder-7bdcdad7-d5b2-462a-b86e-96f97226d282-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:13:18 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-1a435ee4-88e8-4eb1-b738-c621edc25c7d tempest-VolumesActionsTest-153568153 None] Acquiring lock "cinder-quobyte-7bdcdad7-d5b2-462a-b86e-96f97226d282" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:13:18 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-1a435ee4-88e8-4eb1-b738-c621edc25c7d tempest-VolumesActionsTest-153568153 None] Lock "cinder-quobyte-7bdcdad7-d5b2-462a-b86e-96f97226d282" acquired by "delete_volume" :: waited 0.014s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:13:18 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[149a24d3-4612-4c35-a21a-a2f009a7cba6]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:13:18 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-1a435ee4-88e8-4eb1-b738-c621edc25c7d tempest-VolumesActionsTest-153568153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7bdcdad7-d5b2-462a-b86e-96f97226d282 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:13:18 devstack sudo[91192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7bdcdad7-d5b2-462a-b86e-96f97226d282
Apr 28 22:13:18 devstack sudo[91192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:13:19 devstack sudo[91192]: pam_unix(sudo:session): session closed for user root
Apr 28 22:13:19 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-1a435ee4-88e8-4eb1-b738-c621edc25c7d tempest-VolumesActionsTest-153568153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7bdcdad7-d5b2-462a-b86e-96f97226d282" returned: 0 in 0.707s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:13:19 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-1a435ee4-88e8-4eb1-b738-c621edc25c7d tempest-VolumesActionsTest-153568153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7bdcdad7-d5b2-462a-b86e-96f97226d282 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:13:19 devstack sudo[91197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7bdcdad7-d5b2-462a-b86e-96f97226d282
Apr 28 22:13:19 devstack sudo[91197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:13:19 devstack sudo[91197]: pam_unix(sudo:session): session closed for user root
Apr 28 22:13:19 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-1a435ee4-88e8-4eb1-b738-c621edc25c7d tempest-VolumesActionsTest-153568153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-7bdcdad7-d5b2-462a-b86e-96f97226d282" returned: 0 in 0.671s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:13:19 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-1a435ee4-88e8-4eb1-b738-c621edc25c7d tempest-VolumesActionsTest-153568153 None] Lock "cinder-quobyte-7bdcdad7-d5b2-462a-b86e-96f97226d282" released by "delete_volume" :: held 1.425s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:13:19 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-1a435ee4-88e8-4eb1-b738-c621edc25c7d tempest-VolumesActionsTest-153568153 None] Created reservations ['60554645-004e-4ba6-a33e-3cc9f5cffd12', '5930720b-6b1a-455d-8ebc-13a59502aa85', '56ea643d-bcc9-449b-bc2f-e3ee1b849640', '6f443088-e39f-4b8c-a7d0-034b3ffd787a'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:13:19 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f3c140f-8a15-4446-ac75-6a4d7cbd364c tempest-VolumesActionsTest-569706945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:13:19 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-9f3c140f-8a15-4446-ac75-6a4d7cbd364c tempest-VolumesActionsTest-569706945 None] Flow 'volume_create_manager' (8fc9420d-0d9a-40ff-a8b3-df6746dc75cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:13:19 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-9f3c140f-8a15-4446-ac75-6a4d7cbd364c tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d189b9aa-fffe-443c-8598-789d23bbec82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:13:19 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-9f3c140f-8a15-4446-ac75-6a4d7cbd364c tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d189b9aa-fffe-443c-8598-789d23bbec82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:13:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1932676261',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f83f148a-89b7-4ba0-809c-0ffebb4aa077,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='417e78d847a14bb7b984ce42071a7dcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:13:20Z,use_quota=True,user_id='593c239cd1704470a2e916dd6a242c9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:13:19 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-9f3c140f-8a15-4446-ac75-6a4d7cbd364c tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea912ae1-882a-4bae-b912-eea913f07406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:13:19 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-9f3c140f-8a15-4446-ac75-6a4d7cbd364c tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea912ae1-882a-4bae-b912-eea913f07406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:13:19 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-9f3c140f-8a15-4446-ac75-6a4d7cbd364c tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8273e9d5-9baa-4777-9b33-61bd28751e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:13:19 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-9f3c140f-8a15-4446-ac75-6a4d7cbd364c tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8273e9d5-9baa-4777-9b33-61bd28751e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f83f148a-89b7-4ba0-809c-0ffebb4aa077', 'volume_name': 'volume-f83f148a-89b7-4ba0-809c-0ffebb4aa077', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:13:19 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-9f3c140f-8a15-4446-ac75-6a4d7cbd364c tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (826b38a1-8382-4a19-9cc3-9d0aed97710e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:13:19 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-9f3c140f-8a15-4446-ac75-6a4d7cbd364c tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (826b38a1-8382-4a19-9cc3-9d0aed97710e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:13:19 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-9f3c140f-8a15-4446-ac75-6a4d7cbd364c tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1d20c70-790b-4034-9b9e-ffa255b15b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:13:19 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-9f3c140f-8a15-4446-ac75-6a4d7cbd364c tempest-VolumesActionsTest-569706945 None] Volume f83f148a-89b7-4ba0-809c-0ffebb4aa077: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f83f148a-89b7-4ba0-809c-0ffebb4aa077', 'volume_size': 1}
Apr 28 22:13:19 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-9f3c140f-8a15-4446-ac75-6a4d7cbd364c tempest-VolumesActionsTest-569706945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:13:19 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-9f3c140f-8a15-4446-ac75-6a4d7cbd364c tempest-VolumesActionsTest-569706945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:13:19 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-9f3c140f-8a15-4446-ac75-6a4d7cbd364c tempest-VolumesActionsTest-569706945 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:13:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1932676261',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f83f148a-89b7-4ba0-809c-0ffebb4aa077,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='417e78d847a14bb7b984ce42071a7dcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:13:20Z,use_quota=True,user_id='593c239cd1704470a2e916dd6a242c9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:13:19 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-9f3c140f-8a15-4446-ac75-6a4d7cbd364c tempest-VolumesActionsTest-569706945 None] Creating volume f83f148a-89b7-4ba0-809c-0ffebb4aa077 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:13:19 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-9f3c140f-8a15-4446-ac75-6a4d7cbd364c tempest-VolumesActionsTest-569706945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:13:19 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-9f3c140f-8a15-4446-ac75-6a4d7cbd364c tempest-VolumesActionsTest-569706945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:13:19 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-9f3c140f-8a15-4446-ac75-6a4d7cbd364c tempest-VolumesActionsTest-569706945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:13:20 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-9f3c140f-8a15-4446-ac75-6a4d7cbd364c tempest-VolumesActionsTest-569706945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:13:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-9f3c140f-8a15-4446-ac75-6a4d7cbd364c tempest-VolumesActionsTest-569706945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:13:20 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-9f3c140f-8a15-4446-ac75-6a4d7cbd364c tempest-VolumesActionsTest-569706945 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:13:20 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-9f3c140f-8a15-4446-ac75-6a4d7cbd364c tempest-VolumesActionsTest-569706945 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:13:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-9f3c140f-8a15-4446-ac75-6a4d7cbd364c tempest-VolumesActionsTest-569706945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f83f148a-89b7-4ba0-809c-0ffebb4aa077 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:13:20 devstack sudo[91200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f83f148a-89b7-4ba0-809c-0ffebb4aa077 1073741824
Apr 28 22:13:20 devstack sudo[91200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:13:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-1a435ee4-88e8-4eb1-b738-c621edc25c7d tempest-VolumesActionsTest-153568153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:13:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-1a435ee4-88e8-4eb1-b738-c621edc25c7d tempest-VolumesActionsTest-153568153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:13:20 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-1a435ee4-88e8-4eb1-b738-c621edc25c7d tempest-VolumesActionsTest-153568153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:13:20 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-1a435ee4-88e8-4eb1-b738-c621edc25c7d tempest-VolumesActionsTest-153568153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:13:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-1a435ee4-88e8-4eb1-b738-c621edc25c7d tempest-VolumesActionsTest-153568153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:13:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-1a435ee4-88e8-4eb1-b738-c621edc25c7d tempest-VolumesActionsTest-153568153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:13:20 devstack sudo[91202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:13:20 devstack sudo[91202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:13:20 devstack sudo[91202]: pam_unix(sudo:session): session closed for user root
Apr 28 22:13:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-1a435ee4-88e8-4eb1-b738-c621edc25c7d tempest-VolumesActionsTest-153568153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.660s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:13:20 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-1a435ee4-88e8-4eb1-b738-c621edc25c7d tempest-VolumesActionsTest-153568153 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:13:20 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-1a435ee4-88e8-4eb1-b738-c621edc25c7d tempest-VolumesActionsTest-153568153 None] Deleted volume successfully.
Apr 28 22:13:20 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-1a435ee4-88e8-4eb1-b738-c621edc25c7d tempest-VolumesActionsTest-153568153 None] Lock "cinder-7bdcdad7-d5b2-462a-b86e-96f97226d282-delete_volume" released by "delete_volume" :: held 2.464s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:13:20 devstack sudo[91200]: pam_unix(sudo:session): session closed for user root
Apr 28 22:13:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-9f3c140f-8a15-4446-ac75-6a4d7cbd364c tempest-VolumesActionsTest-569706945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f83f148a-89b7-4ba0-809c-0ffebb4aa077 1073741824" returned: 0 in 0.926s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:13:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-9f3c140f-8a15-4446-ac75-6a4d7cbd364c tempest-VolumesActionsTest-569706945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f83f148a-89b7-4ba0-809c-0ffebb4aa077 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:13:20 devstack sudo[91246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f83f148a-89b7-4ba0-809c-0ffebb4aa077
Apr 28 22:13:20 devstack sudo[91246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:13:21 devstack sudo[91246]: pam_unix(sudo:session): session closed for user root
Apr 28 22:13:21 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-9f3c140f-8a15-4446-ac75-6a4d7cbd364c tempest-VolumesActionsTest-569706945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f83f148a-89b7-4ba0-809c-0ffebb4aa077" returned: 0 in 0.667s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:13:21 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-9f3c140f-8a15-4446-ac75-6a4d7cbd364c tempest-VolumesActionsTest-569706945 None] <== create_volume: return (1637ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:13:21 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-9f3c140f-8a15-4446-ac75-6a4d7cbd364c tempest-VolumesActionsTest-569706945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.639s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:13:21 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-9f3c140f-8a15-4446-ac75-6a4d7cbd364c tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1d20c70-790b-4034-9b9e-ffa255b15b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f83f148a-89b7-4ba0-809c-0ffebb4aa077', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:13:21 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-9f3c140f-8a15-4446-ac75-6a4d7cbd364c tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (327a4c2f-259b-47b8-bd2f-99d26e1292cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:13:21 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-9f3c140f-8a15-4446-ac75-6a4d7cbd364c tempest-VolumesActionsTest-569706945 None] Volume volume-f83f148a-89b7-4ba0-809c-0ffebb4aa077 (f83f148a-89b7-4ba0-809c-0ffebb4aa077): created successfully
Apr 28 22:13:21 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-9f3c140f-8a15-4446-ac75-6a4d7cbd364c tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (327a4c2f-259b-47b8-bd2f-99d26e1292cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:13:21 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-9f3c140f-8a15-4446-ac75-6a4d7cbd364c tempest-VolumesActionsTest-569706945 None] Flow 'volume_create_manager' (8fc9420d-0d9a-40ff-a8b3-df6746dc75cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:13:21 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-9f3c140f-8a15-4446-ac75-6a4d7cbd364c tempest-VolumesActionsTest-569706945 None] Created volume successfully.
Apr 28 22:13:22 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-e67009d0-48e9-4177-99b4-c6c9057495b4 tempest-VolumesActionsTest-1263735328 None] Acquiring lock "cinder-f83f148a-89b7-4ba0-809c-0ffebb4aa077-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:13:22 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-e67009d0-48e9-4177-99b4-c6c9057495b4 tempest-VolumesActionsTest-1263735328 None] Lock "cinder-f83f148a-89b7-4ba0-809c-0ffebb4aa077-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:13:22 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-e67009d0-48e9-4177-99b4-c6c9057495b4 tempest-VolumesActionsTest-1263735328 None] Acquiring lock "cinder-quobyte-f83f148a-89b7-4ba0-809c-0ffebb4aa077" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:13:22 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-e67009d0-48e9-4177-99b4-c6c9057495b4 tempest-VolumesActionsTest-1263735328 None] Lock "cinder-quobyte-f83f148a-89b7-4ba0-809c-0ffebb4aa077" acquired by "delete_volume" :: waited 0.017s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:13:22 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ba49a8-a4dc-4ea8-9485-c775dfdd01a9]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:13:22 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e67009d0-48e9-4177-99b4-c6c9057495b4 tempest-VolumesActionsTest-1263735328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f83f148a-89b7-4ba0-809c-0ffebb4aa077 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:13:22 devstack sudo[91250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f83f148a-89b7-4ba0-809c-0ffebb4aa077
Apr 28 22:13:22 devstack sudo[91250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:13:23 devstack sudo[91250]: pam_unix(sudo:session): session closed for user root
Apr 28 22:13:23 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e67009d0-48e9-4177-99b4-c6c9057495b4 tempest-VolumesActionsTest-1263735328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f83f148a-89b7-4ba0-809c-0ffebb4aa077" returned: 0 in 0.767s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:13:23 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e67009d0-48e9-4177-99b4-c6c9057495b4 tempest-VolumesActionsTest-1263735328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f83f148a-89b7-4ba0-809c-0ffebb4aa077 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:13:23 devstack sudo[91257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f83f148a-89b7-4ba0-809c-0ffebb4aa077
Apr 28 22:13:23 devstack sudo[91257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:13:23 devstack sudo[91257]: pam_unix(sudo:session): session closed for user root
Apr 28 22:13:23 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e67009d0-48e9-4177-99b4-c6c9057495b4 tempest-VolumesActionsTest-1263735328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f83f148a-89b7-4ba0-809c-0ffebb4aa077" returned: 0 in 0.693s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:13:23 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-e67009d0-48e9-4177-99b4-c6c9057495b4 tempest-VolumesActionsTest-1263735328 None] Lock "cinder-quobyte-f83f148a-89b7-4ba0-809c-0ffebb4aa077" released by "delete_volume" :: held 1.506s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:13:23 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-e67009d0-48e9-4177-99b4-c6c9057495b4 tempest-VolumesActionsTest-1263735328 None] Created reservations ['7c41a4f3-ceb1-48de-a524-d943995c7341', 'c39d66d3-dda9-49c3-ae95-e48c52abb7e2', '5b1b68c1-62fc-4bfd-a58c-ec2f5c5599e5', 'c4346861-13b1-4840-8003-fad0f1ba0ade'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:13:23 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-e67009d0-48e9-4177-99b4-c6c9057495b4 tempest-VolumesActionsTest-1263735328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:13:23 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-e67009d0-48e9-4177-99b4-c6c9057495b4 tempest-VolumesActionsTest-1263735328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:13:23 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-e67009d0-48e9-4177-99b4-c6c9057495b4 tempest-VolumesActionsTest-1263735328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:13:23 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-e67009d0-48e9-4177-99b4-c6c9057495b4 tempest-VolumesActionsTest-1263735328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:13:23 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-e67009d0-48e9-4177-99b4-c6c9057495b4 tempest-VolumesActionsTest-1263735328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:13:23 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e67009d0-48e9-4177-99b4-c6c9057495b4 tempest-VolumesActionsTest-1263735328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:13:23 devstack sudo[91260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:13:23 devstack sudo[91260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:13:24 devstack sudo[91260]: pam_unix(sudo:session): session closed for user root
Apr 28 22:13:24 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e67009d0-48e9-4177-99b4-c6c9057495b4 tempest-VolumesActionsTest-1263735328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.649s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:13:24 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-e67009d0-48e9-4177-99b4-c6c9057495b4 tempest-VolumesActionsTest-1263735328 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:13:24 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-e67009d0-48e9-4177-99b4-c6c9057495b4 tempest-VolumesActionsTest-1263735328 None] Deleted volume successfully.
Apr 28 22:13:24 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-e67009d0-48e9-4177-99b4-c6c9057495b4 tempest-VolumesActionsTest-1263735328 None] Lock "cinder-f83f148a-89b7-4ba0-809c-0ffebb4aa077-delete_volume" released by "delete_volume" :: held 2.383s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:13:25 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-250f2d65-1584-4616-a5e7-fc6c7dd88060 tempest-VolumesActionsTest-569706945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:13:25 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-250f2d65-1584-4616-a5e7-fc6c7dd88060 tempest-VolumesActionsTest-569706945 None] Flow 'volume_create_manager' (14e99d15-eb2c-4bd8-83be-beb3d6d9f211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:13:25 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-250f2d65-1584-4616-a5e7-fc6c7dd88060 tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37143115-dfec-42a3-96f4-34318cb089fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:13:25 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-250f2d65-1584-4616-a5e7-fc6c7dd88060 tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37143115-dfec-42a3-96f4-34318cb089fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:13:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1852873946',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed56f5ce-122e-4a92-bb2e-af4afa49d123,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='417e78d847a14bb7b984ce42071a7dcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:13:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:13:25Z,use_quota=True,user_id='593c239cd1704470a2e916dd6a242c9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:13:25 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-250f2d65-1584-4616-a5e7-fc6c7dd88060 tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e35e6822-297e-4da9-82e0-fd2dc2b75f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:13:25 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-250f2d65-1584-4616-a5e7-fc6c7dd88060 tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e35e6822-297e-4da9-82e0-fd2dc2b75f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:13:25 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-250f2d65-1584-4616-a5e7-fc6c7dd88060 tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f8da3c3-c461-4b85-8ffa-8e1c7fde5116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:13:25 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-250f2d65-1584-4616-a5e7-fc6c7dd88060 tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f8da3c3-c461-4b85-8ffa-8e1c7fde5116) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed56f5ce-122e-4a92-bb2e-af4afa49d123', 'volume_name': 'volume-ed56f5ce-122e-4a92-bb2e-af4afa49d123', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:13:25 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-250f2d65-1584-4616-a5e7-fc6c7dd88060 tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c1dbfda-5498-4723-93d8-a500d7499db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:13:25 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-250f2d65-1584-4616-a5e7-fc6c7dd88060 tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c1dbfda-5498-4723-93d8-a500d7499db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:13:25 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-250f2d65-1584-4616-a5e7-fc6c7dd88060 tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (231b838a-bfa8-4a10-97dc-fced6124234a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:13:25 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-250f2d65-1584-4616-a5e7-fc6c7dd88060 tempest-VolumesActionsTest-569706945 None] Volume ed56f5ce-122e-4a92-bb2e-af4afa49d123: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed56f5ce-122e-4a92-bb2e-af4afa49d123', 'volume_size': 1}
Apr 28 22:13:25 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-250f2d65-1584-4616-a5e7-fc6c7dd88060 tempest-VolumesActionsTest-569706945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:13:25 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-250f2d65-1584-4616-a5e7-fc6c7dd88060 tempest-VolumesActionsTest-569706945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:13:25 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-250f2d65-1584-4616-a5e7-fc6c7dd88060 tempest-VolumesActionsTest-569706945 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:13:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1852873946',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed56f5ce-122e-4a92-bb2e-af4afa49d123,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='417e78d847a14bb7b984ce42071a7dcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:13:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:13:25Z,use_quota=True,user_id='593c239cd1704470a2e916dd6a242c9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:13:25 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-250f2d65-1584-4616-a5e7-fc6c7dd88060 tempest-VolumesActionsTest-569706945 None] Creating volume ed56f5ce-122e-4a92-bb2e-af4afa49d123 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:13:25 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-250f2d65-1584-4616-a5e7-fc6c7dd88060 tempest-VolumesActionsTest-569706945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:13:25 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-250f2d65-1584-4616-a5e7-fc6c7dd88060 tempest-VolumesActionsTest-569706945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:13:25 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-250f2d65-1584-4616-a5e7-fc6c7dd88060 tempest-VolumesActionsTest-569706945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:13:25 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-250f2d65-1584-4616-a5e7-fc6c7dd88060 tempest-VolumesActionsTest-569706945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:13:25 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-250f2d65-1584-4616-a5e7-fc6c7dd88060 tempest-VolumesActionsTest-569706945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:13:25 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-250f2d65-1584-4616-a5e7-fc6c7dd88060 tempest-VolumesActionsTest-569706945 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:13:25 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-250f2d65-1584-4616-a5e7-fc6c7dd88060 tempest-VolumesActionsTest-569706945 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:13:25 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-250f2d65-1584-4616-a5e7-fc6c7dd88060 tempest-VolumesActionsTest-569706945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ed56f5ce-122e-4a92-bb2e-af4afa49d123 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:13:25 devstack sudo[91271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ed56f5ce-122e-4a92-bb2e-af4afa49d123 1073741824
Apr 28 22:13:25 devstack sudo[91271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:13:26 devstack sudo[91271]: pam_unix(sudo:session): session closed for user root
Apr 28 22:13:26 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-250f2d65-1584-4616-a5e7-fc6c7dd88060 tempest-VolumesActionsTest-569706945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ed56f5ce-122e-4a92-bb2e-af4afa49d123 1073741824" returned: 0 in 0.982s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:13:26 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-250f2d65-1584-4616-a5e7-fc6c7dd88060 tempest-VolumesActionsTest-569706945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ed56f5ce-122e-4a92-bb2e-af4afa49d123 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:13:26 devstack sudo[91278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ed56f5ce-122e-4a92-bb2e-af4afa49d123
Apr 28 22:13:26 devstack sudo[91278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:13:26 devstack sudo[91278]: pam_unix(sudo:session): session closed for user root
Apr 28 22:13:26 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-250f2d65-1584-4616-a5e7-fc6c7dd88060 tempest-VolumesActionsTest-569706945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ed56f5ce-122e-4a92-bb2e-af4afa49d123" returned: 0 in 0.644s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:13:26 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-250f2d65-1584-4616-a5e7-fc6c7dd88060 tempest-VolumesActionsTest-569706945 None] <== create_volume: return (1678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:13:26 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-250f2d65-1584-4616-a5e7-fc6c7dd88060 tempest-VolumesActionsTest-569706945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.685s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:13:26 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-250f2d65-1584-4616-a5e7-fc6c7dd88060 tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (231b838a-bfa8-4a10-97dc-fced6124234a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed56f5ce-122e-4a92-bb2e-af4afa49d123', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:13:26 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-250f2d65-1584-4616-a5e7-fc6c7dd88060 tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8ea3ac7-580a-4e2c-a1f2-63458a364903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:13:26 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-250f2d65-1584-4616-a5e7-fc6c7dd88060 tempest-VolumesActionsTest-569706945 None] Volume volume-ed56f5ce-122e-4a92-bb2e-af4afa49d123 (ed56f5ce-122e-4a92-bb2e-af4afa49d123): created successfully
Apr 28 22:13:26 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-250f2d65-1584-4616-a5e7-fc6c7dd88060 tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8ea3ac7-580a-4e2c-a1f2-63458a364903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:13:26 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-250f2d65-1584-4616-a5e7-fc6c7dd88060 tempest-VolumesActionsTest-569706945 None] Flow 'volume_create_manager' (14e99d15-eb2c-4bd8-83be-beb3d6d9f211) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:13:26 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-250f2d65-1584-4616-a5e7-fc6c7dd88060 tempest-VolumesActionsTest-569706945 None] Created volume successfully.
Apr 28 22:13:27 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-137344a8-3cdd-4955-8c11-3ee3890a974b tempest-VolumesActionsTest-1263735328 None] Acquiring lock "cinder-ed56f5ce-122e-4a92-bb2e-af4afa49d123-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:13:27 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-137344a8-3cdd-4955-8c11-3ee3890a974b tempest-VolumesActionsTest-1263735328 None] Lock "cinder-ed56f5ce-122e-4a92-bb2e-af4afa49d123-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:13:27 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-137344a8-3cdd-4955-8c11-3ee3890a974b tempest-VolumesActionsTest-1263735328 None] Acquiring lock "cinder-quobyte-ed56f5ce-122e-4a92-bb2e-af4afa49d123" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:13:27 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-137344a8-3cdd-4955-8c11-3ee3890a974b tempest-VolumesActionsTest-1263735328 None] Lock "cinder-quobyte-ed56f5ce-122e-4a92-bb2e-af4afa49d123" acquired by "delete_volume" :: waited 0.022s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:13:27 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1443f9-2200-4163-b96f-bcc013197eb3]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:13:27 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-137344a8-3cdd-4955-8c11-3ee3890a974b tempest-VolumesActionsTest-1263735328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ed56f5ce-122e-4a92-bb2e-af4afa49d123 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:13:27 devstack sudo[91281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ed56f5ce-122e-4a92-bb2e-af4afa49d123
Apr 28 22:13:27 devstack sudo[91281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:13:28 devstack sudo[91281]: pam_unix(sudo:session): session closed for user root
Apr 28 22:13:28 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-137344a8-3cdd-4955-8c11-3ee3890a974b tempest-VolumesActionsTest-1263735328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ed56f5ce-122e-4a92-bb2e-af4afa49d123" returned: 0 in 0.830s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:13:28 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-137344a8-3cdd-4955-8c11-3ee3890a974b tempest-VolumesActionsTest-1263735328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ed56f5ce-122e-4a92-bb2e-af4afa49d123 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:13:28 devstack sudo[91286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ed56f5ce-122e-4a92-bb2e-af4afa49d123
Apr 28 22:13:28 devstack sudo[91286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:13:29 devstack sudo[91286]: pam_unix(sudo:session): session closed for user root
Apr 28 22:13:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-137344a8-3cdd-4955-8c11-3ee3890a974b tempest-VolumesActionsTest-1263735328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ed56f5ce-122e-4a92-bb2e-af4afa49d123" returned: 0 in 0.697s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:13:29 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-137344a8-3cdd-4955-8c11-3ee3890a974b tempest-VolumesActionsTest-1263735328 None] Lock "cinder-quobyte-ed56f5ce-122e-4a92-bb2e-af4afa49d123" released by "delete_volume" :: held 1.582s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:13:29 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-137344a8-3cdd-4955-8c11-3ee3890a974b tempest-VolumesActionsTest-1263735328 None] Created reservations ['91c2908e-9658-444c-b8a6-2c0514164bdf', '163f5bb9-6efb-4eba-8828-65b6d1866073', 'd808c2d0-d51a-442b-8834-bb939f3ff9f1', '9895a453-a00e-480a-890a-d8c6a52bce28'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:13:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-137344a8-3cdd-4955-8c11-3ee3890a974b tempest-VolumesActionsTest-1263735328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:13:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-137344a8-3cdd-4955-8c11-3ee3890a974b tempest-VolumesActionsTest-1263735328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:13:29 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-137344a8-3cdd-4955-8c11-3ee3890a974b tempest-VolumesActionsTest-1263735328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:13:29 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-137344a8-3cdd-4955-8c11-3ee3890a974b tempest-VolumesActionsTest-1263735328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:13:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-137344a8-3cdd-4955-8c11-3ee3890a974b tempest-VolumesActionsTest-1263735328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:13:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-137344a8-3cdd-4955-8c11-3ee3890a974b tempest-VolumesActionsTest-1263735328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:13:29 devstack sudo[91289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:13:29 devstack sudo[91289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:13:29 devstack sudo[91289]: pam_unix(sudo:session): session closed for user root
Apr 28 22:13:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-137344a8-3cdd-4955-8c11-3ee3890a974b tempest-VolumesActionsTest-1263735328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.741s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:13:29 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-137344a8-3cdd-4955-8c11-3ee3890a974b tempest-VolumesActionsTest-1263735328 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:13:29 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-137344a8-3cdd-4955-8c11-3ee3890a974b tempest-VolumesActionsTest-1263735328 None] Deleted volume successfully.
Apr 28 22:13:29 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-137344a8-3cdd-4955-8c11-3ee3890a974b tempest-VolumesActionsTest-1263735328 None] Lock "cinder-ed56f5ce-122e-4a92-bb2e-af4afa49d123-delete_volume" released by "delete_volume" :: held 2.569s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:13:30 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f4522ff-ef75-4935-87dc-80481b991e9c tempest-VolumesActionsTest-569706945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:13:30 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-4f4522ff-ef75-4935-87dc-80481b991e9c tempest-VolumesActionsTest-569706945 None] Flow 'volume_create_manager' (84281331-a9e9-413d-8ca8-49b72a208a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:13:30 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-4f4522ff-ef75-4935-87dc-80481b991e9c tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac25baee-836f-4805-a6f7-4545b9f67232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:13:30 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-4f4522ff-ef75-4935-87dc-80481b991e9c tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac25baee-836f-4805-a6f7-4545b9f67232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:13:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1587883923',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ba25149-33e9-4a3b-b9e9-bc3c4b4ce82d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='417e78d847a14bb7b984ce42071a7dcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:13:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:13:30Z,use_quota=True,user_id='593c239cd1704470a2e916dd6a242c9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:13:30 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-4f4522ff-ef75-4935-87dc-80481b991e9c tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f6c4004-e21c-4728-ad25-e53607bdca14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:13:30 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-4f4522ff-ef75-4935-87dc-80481b991e9c tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f6c4004-e21c-4728-ad25-e53607bdca14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:13:30 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-4f4522ff-ef75-4935-87dc-80481b991e9c tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26ffce54-a05b-4a8e-9fd4-92f1014dbd4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:13:30 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-4f4522ff-ef75-4935-87dc-80481b991e9c tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26ffce54-a05b-4a8e-9fd4-92f1014dbd4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ba25149-33e9-4a3b-b9e9-bc3c4b4ce82d', 'volume_name': 'volume-2ba25149-33e9-4a3b-b9e9-bc3c4b4ce82d', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:13:30 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-4f4522ff-ef75-4935-87dc-80481b991e9c tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2011336e-0e2f-4f65-81fb-e987b3a7074e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:13:30 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-4f4522ff-ef75-4935-87dc-80481b991e9c tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2011336e-0e2f-4f65-81fb-e987b3a7074e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:13:30 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-4f4522ff-ef75-4935-87dc-80481b991e9c tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca86cf99-af03-4782-a9ac-7ff00622b0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:13:30 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-4f4522ff-ef75-4935-87dc-80481b991e9c tempest-VolumesActionsTest-569706945 None] Volume 2ba25149-33e9-4a3b-b9e9-bc3c4b4ce82d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ba25149-33e9-4a3b-b9e9-bc3c4b4ce82d', 'volume_size': 1}
Apr 28 22:13:30 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-4f4522ff-ef75-4935-87dc-80481b991e9c tempest-VolumesActionsTest-569706945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:13:30 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-4f4522ff-ef75-4935-87dc-80481b991e9c tempest-VolumesActionsTest-569706945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:13:30 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-4f4522ff-ef75-4935-87dc-80481b991e9c tempest-VolumesActionsTest-569706945 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:13:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1587883923',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ba25149-33e9-4a3b-b9e9-bc3c4b4ce82d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='417e78d847a14bb7b984ce42071a7dcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:13:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:13:30Z,use_quota=True,user_id='593c239cd1704470a2e916dd6a242c9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:13:30 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-4f4522ff-ef75-4935-87dc-80481b991e9c tempest-VolumesActionsTest-569706945 None] Creating volume 2ba25149-33e9-4a3b-b9e9-bc3c4b4ce82d {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:13:30 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-4f4522ff-ef75-4935-87dc-80481b991e9c tempest-VolumesActionsTest-569706945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:13:30 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-4f4522ff-ef75-4935-87dc-80481b991e9c tempest-VolumesActionsTest-569706945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:13:30 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-4f4522ff-ef75-4935-87dc-80481b991e9c tempest-VolumesActionsTest-569706945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:13:30 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-4f4522ff-ef75-4935-87dc-80481b991e9c tempest-VolumesActionsTest-569706945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:13:30 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-4f4522ff-ef75-4935-87dc-80481b991e9c tempest-VolumesActionsTest-569706945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:13:30 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-4f4522ff-ef75-4935-87dc-80481b991e9c tempest-VolumesActionsTest-569706945 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:13:30 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-4f4522ff-ef75-4935-87dc-80481b991e9c tempest-VolumesActionsTest-569706945 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:13:30 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4f4522ff-ef75-4935-87dc-80481b991e9c tempest-VolumesActionsTest-569706945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2ba25149-33e9-4a3b-b9e9-bc3c4b4ce82d 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:13:30 devstack sudo[91292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2ba25149-33e9-4a3b-b9e9-bc3c4b4ce82d 1073741824
Apr 28 22:13:30 devstack sudo[91292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:13:31 devstack sudo[91292]: pam_unix(sudo:session): session closed for user root
Apr 28 22:13:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4f4522ff-ef75-4935-87dc-80481b991e9c tempest-VolumesActionsTest-569706945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2ba25149-33e9-4a3b-b9e9-bc3c4b4ce82d 1073741824" returned: 0 in 0.886s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:13:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4f4522ff-ef75-4935-87dc-80481b991e9c tempest-VolumesActionsTest-569706945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2ba25149-33e9-4a3b-b9e9-bc3c4b4ce82d {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:13:31 devstack sudo[91297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2ba25149-33e9-4a3b-b9e9-bc3c4b4ce82d
Apr 28 22:13:31 devstack sudo[91297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:13:31 devstack sudo[91297]: pam_unix(sudo:session): session closed for user root
Apr 28 22:13:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4f4522ff-ef75-4935-87dc-80481b991e9c tempest-VolumesActionsTest-569706945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2ba25149-33e9-4a3b-b9e9-bc3c4b4ce82d" returned: 0 in 0.674s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:13:31 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-4f4522ff-ef75-4935-87dc-80481b991e9c tempest-VolumesActionsTest-569706945 None] <== create_volume: return (1613ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:13:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-4f4522ff-ef75-4935-87dc-80481b991e9c tempest-VolumesActionsTest-569706945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.615s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:13:31 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-4f4522ff-ef75-4935-87dc-80481b991e9c tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca86cf99-af03-4782-a9ac-7ff00622b0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ba25149-33e9-4a3b-b9e9-bc3c4b4ce82d', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:13:31 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-4f4522ff-ef75-4935-87dc-80481b991e9c tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e91a265-e73a-4277-ad98-b1d7f2cee354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:13:31 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-4f4522ff-ef75-4935-87dc-80481b991e9c tempest-VolumesActionsTest-569706945 None] Volume volume-2ba25149-33e9-4a3b-b9e9-bc3c4b4ce82d (2ba25149-33e9-4a3b-b9e9-bc3c4b4ce82d): created successfully
Apr 28 22:13:31 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-4f4522ff-ef75-4935-87dc-80481b991e9c tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e91a265-e73a-4277-ad98-b1d7f2cee354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:13:31 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-4f4522ff-ef75-4935-87dc-80481b991e9c tempest-VolumesActionsTest-569706945 None] Flow 'volume_create_manager' (84281331-a9e9-413d-8ca8-49b72a208a3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:13:31 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-4f4522ff-ef75-4935-87dc-80481b991e9c tempest-VolumesActionsTest-569706945 None] Created volume successfully.
Apr 28 22:13:32 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-ffa2fea6-5632-45bc-83b5-f8d2febfbe77 tempest-VolumesActionsTest-1263735328 None] Acquiring lock "cinder-2ba25149-33e9-4a3b-b9e9-bc3c4b4ce82d-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:13:32 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-ffa2fea6-5632-45bc-83b5-f8d2febfbe77 tempest-VolumesActionsTest-1263735328 None] Lock "cinder-2ba25149-33e9-4a3b-b9e9-bc3c4b4ce82d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:13:32 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-ffa2fea6-5632-45bc-83b5-f8d2febfbe77 tempest-VolumesActionsTest-1263735328 None] Acquiring lock "cinder-quobyte-2ba25149-33e9-4a3b-b9e9-bc3c4b4ce82d" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:13:32 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-ffa2fea6-5632-45bc-83b5-f8d2febfbe77 tempest-VolumesActionsTest-1263735328 None] Lock "cinder-quobyte-2ba25149-33e9-4a3b-b9e9-bc3c4b4ce82d" acquired by "delete_volume" :: waited 0.024s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:13:32 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd36d3c-2603-48fd-ad1b-1e3b9775ff56]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:13:32 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-ffa2fea6-5632-45bc-83b5-f8d2febfbe77 tempest-VolumesActionsTest-1263735328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2ba25149-33e9-4a3b-b9e9-bc3c4b4ce82d {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:13:32 devstack sudo[91301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2ba25149-33e9-4a3b-b9e9-bc3c4b4ce82d
Apr 28 22:13:32 devstack sudo[91301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:13:33 devstack sudo[91301]: pam_unix(sudo:session): session closed for user root
Apr 28 22:13:33 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-ffa2fea6-5632-45bc-83b5-f8d2febfbe77 tempest-VolumesActionsTest-1263735328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2ba25149-33e9-4a3b-b9e9-bc3c4b4ce82d" returned: 0 in 0.772s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:13:33 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-ffa2fea6-5632-45bc-83b5-f8d2febfbe77 tempest-VolumesActionsTest-1263735328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2ba25149-33e9-4a3b-b9e9-bc3c4b4ce82d {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:13:33 devstack sudo[91307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2ba25149-33e9-4a3b-b9e9-bc3c4b4ce82d
Apr 28 22:13:33 devstack sudo[91307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:13:34 devstack sudo[91307]: pam_unix(sudo:session): session closed for user root
Apr 28 22:13:34 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-ffa2fea6-5632-45bc-83b5-f8d2febfbe77 tempest-VolumesActionsTest-1263735328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2ba25149-33e9-4a3b-b9e9-bc3c4b4ce82d" returned: 0 in 0.634s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:13:34 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-ffa2fea6-5632-45bc-83b5-f8d2febfbe77 tempest-VolumesActionsTest-1263735328 None] Lock "cinder-quobyte-2ba25149-33e9-4a3b-b9e9-bc3c4b4ce82d" released by "delete_volume" :: held 1.458s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:13:34 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-ffa2fea6-5632-45bc-83b5-f8d2febfbe77 tempest-VolumesActionsTest-1263735328 None] Created reservations ['faed0dff-6b2f-423f-8854-0787afd755d2', '336ae5af-821d-42ab-92b7-c22bcc145de0', 'f996f6c6-adb9-40f7-8d56-36d361860892', 'd79d906d-128f-40b7-815d-ca958159c1b6'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:13:34 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-ffa2fea6-5632-45bc-83b5-f8d2febfbe77 tempest-VolumesActionsTest-1263735328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:13:34 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-ffa2fea6-5632-45bc-83b5-f8d2febfbe77 tempest-VolumesActionsTest-1263735328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:13:34 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-ffa2fea6-5632-45bc-83b5-f8d2febfbe77 tempest-VolumesActionsTest-1263735328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:13:34 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-ffa2fea6-5632-45bc-83b5-f8d2febfbe77 tempest-VolumesActionsTest-1263735328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:13:34 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-ffa2fea6-5632-45bc-83b5-f8d2febfbe77 tempest-VolumesActionsTest-1263735328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:13:34 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-ffa2fea6-5632-45bc-83b5-f8d2febfbe77 tempest-VolumesActionsTest-1263735328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:13:34 devstack sudo[91310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:13:34 devstack sudo[91310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:13:34 devstack sudo[91310]: pam_unix(sudo:session): session closed for user root
Apr 28 22:13:34 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-ffa2fea6-5632-45bc-83b5-f8d2febfbe77 tempest-VolumesActionsTest-1263735328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.726s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:13:34 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-ffa2fea6-5632-45bc-83b5-f8d2febfbe77 tempest-VolumesActionsTest-1263735328 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:13:34 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-ffa2fea6-5632-45bc-83b5-f8d2febfbe77 tempest-VolumesActionsTest-1263735328 None] Deleted volume successfully.
Apr 28 22:13:34 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-ffa2fea6-5632-45bc-83b5-f8d2febfbe77 tempest-VolumesActionsTest-1263735328 None] Lock "cinder-2ba25149-33e9-4a3b-b9e9-bc3c4b4ce82d-delete_volume" released by "delete_volume" :: held 2.452s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:13:35 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-18cd95ab-2156-4ae0-8086-0e29e630471b tempest-VolumesActionsTest-569706945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:13:35 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-18cd95ab-2156-4ae0-8086-0e29e630471b tempest-VolumesActionsTest-569706945 None] Flow 'volume_create_manager' (f35ebca8-0b7b-4fd8-bca1-defda8adc651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:13:35 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-18cd95ab-2156-4ae0-8086-0e29e630471b tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0113e970-a03c-43d6-a1aa-3919c1a4ab32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:13:35 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-18cd95ab-2156-4ae0-8086-0e29e630471b tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0113e970-a03c-43d6-a1aa-3919c1a4ab32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:13:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1866137508',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dd8fc39-e51c-45a6-b026-97ed16c26c85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='417e78d847a14bb7b984ce42071a7dcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:13:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:13:35Z,use_quota=True,user_id='593c239cd1704470a2e916dd6a242c9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:13:35 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-18cd95ab-2156-4ae0-8086-0e29e630471b tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7e1c2fb-49ce-4652-8580-834cc434ee1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:13:35 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-18cd95ab-2156-4ae0-8086-0e29e630471b tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7e1c2fb-49ce-4652-8580-834cc434ee1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:13:35 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-18cd95ab-2156-4ae0-8086-0e29e630471b tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de9ea38d-9479-45f1-8cf4-bdce83b92468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:13:35 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-18cd95ab-2156-4ae0-8086-0e29e630471b tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de9ea38d-9479-45f1-8cf4-bdce83b92468) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0dd8fc39-e51c-45a6-b026-97ed16c26c85', 'volume_name': 'volume-0dd8fc39-e51c-45a6-b026-97ed16c26c85', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:13:35 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-18cd95ab-2156-4ae0-8086-0e29e630471b tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (becf7667-0e8b-4d4d-8ed1-447f91c701f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:13:35 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-18cd95ab-2156-4ae0-8086-0e29e630471b tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (becf7667-0e8b-4d4d-8ed1-447f91c701f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:13:35 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-18cd95ab-2156-4ae0-8086-0e29e630471b tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19a4c2c4-0db2-4aaa-92ef-aef11f89305b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:13:35 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-18cd95ab-2156-4ae0-8086-0e29e630471b tempest-VolumesActionsTest-569706945 None] Volume 0dd8fc39-e51c-45a6-b026-97ed16c26c85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0dd8fc39-e51c-45a6-b026-97ed16c26c85', 'volume_size': 1}
Apr 28 22:13:35 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-18cd95ab-2156-4ae0-8086-0e29e630471b tempest-VolumesActionsTest-569706945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:13:35 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-18cd95ab-2156-4ae0-8086-0e29e630471b tempest-VolumesActionsTest-569706945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:13:35 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-18cd95ab-2156-4ae0-8086-0e29e630471b tempest-VolumesActionsTest-569706945 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:13:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1866137508',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dd8fc39-e51c-45a6-b026-97ed16c26c85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='417e78d847a14bb7b984ce42071a7dcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:13:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:13:35Z,use_quota=True,user_id='593c239cd1704470a2e916dd6a242c9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:13:35 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-18cd95ab-2156-4ae0-8086-0e29e630471b tempest-VolumesActionsTest-569706945 None] Creating volume 0dd8fc39-e51c-45a6-b026-97ed16c26c85 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:13:35 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-18cd95ab-2156-4ae0-8086-0e29e630471b tempest-VolumesActionsTest-569706945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:13:35 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-18cd95ab-2156-4ae0-8086-0e29e630471b tempest-VolumesActionsTest-569706945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:13:35 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-18cd95ab-2156-4ae0-8086-0e29e630471b tempest-VolumesActionsTest-569706945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:13:35 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-18cd95ab-2156-4ae0-8086-0e29e630471b tempest-VolumesActionsTest-569706945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:13:35 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-18cd95ab-2156-4ae0-8086-0e29e630471b tempest-VolumesActionsTest-569706945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:13:35 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-18cd95ab-2156-4ae0-8086-0e29e630471b tempest-VolumesActionsTest-569706945 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:13:35 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-18cd95ab-2156-4ae0-8086-0e29e630471b tempest-VolumesActionsTest-569706945 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:13:35 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-18cd95ab-2156-4ae0-8086-0e29e630471b tempest-VolumesActionsTest-569706945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-0dd8fc39-e51c-45a6-b026-97ed16c26c85 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:13:35 devstack sudo[91315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-0dd8fc39-e51c-45a6-b026-97ed16c26c85 1073741824
Apr 28 22:13:35 devstack sudo[91315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:13:36 devstack sudo[91315]: pam_unix(sudo:session): session closed for user root
Apr 28 22:13:36 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-18cd95ab-2156-4ae0-8086-0e29e630471b tempest-VolumesActionsTest-569706945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-0dd8fc39-e51c-45a6-b026-97ed16c26c85 1073741824" returned: 0 in 0.829s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:13:36 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-18cd95ab-2156-4ae0-8086-0e29e630471b tempest-VolumesActionsTest-569706945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-0dd8fc39-e51c-45a6-b026-97ed16c26c85 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:13:36 devstack sudo[91321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-0dd8fc39-e51c-45a6-b026-97ed16c26c85
Apr 28 22:13:36 devstack sudo[91321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:13:36 devstack sudo[91321]: pam_unix(sudo:session): session closed for user root
Apr 28 22:13:36 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-18cd95ab-2156-4ae0-8086-0e29e630471b tempest-VolumesActionsTest-569706945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-0dd8fc39-e51c-45a6-b026-97ed16c26c85" returned: 0 in 0.606s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:13:36 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-18cd95ab-2156-4ae0-8086-0e29e630471b tempest-VolumesActionsTest-569706945 None] <== create_volume: return (1481ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:13:36 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-18cd95ab-2156-4ae0-8086-0e29e630471b tempest-VolumesActionsTest-569706945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.487s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:13:36 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-18cd95ab-2156-4ae0-8086-0e29e630471b tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19a4c2c4-0db2-4aaa-92ef-aef11f89305b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0dd8fc39-e51c-45a6-b026-97ed16c26c85', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:13:36 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-18cd95ab-2156-4ae0-8086-0e29e630471b tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29a1854e-1ab2-4a80-ad99-a5d30dbfda34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:13:36 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-18cd95ab-2156-4ae0-8086-0e29e630471b tempest-VolumesActionsTest-569706945 None] Volume volume-0dd8fc39-e51c-45a6-b026-97ed16c26c85 (0dd8fc39-e51c-45a6-b026-97ed16c26c85): created successfully
Apr 28 22:13:36 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-18cd95ab-2156-4ae0-8086-0e29e630471b tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29a1854e-1ab2-4a80-ad99-a5d30dbfda34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:13:36 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-18cd95ab-2156-4ae0-8086-0e29e630471b tempest-VolumesActionsTest-569706945 None] Flow 'volume_create_manager' (f35ebca8-0b7b-4fd8-bca1-defda8adc651) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:13:36 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-18cd95ab-2156-4ae0-8086-0e29e630471b tempest-VolumesActionsTest-569706945 None] Created volume successfully.
Apr 28 22:13:37 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-d81c2e75-556d-4c90-a029-9a72db13c172 tempest-VolumesActionsTest-1263735328 None] Acquiring lock "cinder-0dd8fc39-e51c-45a6-b026-97ed16c26c85-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:13:37 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-d81c2e75-556d-4c90-a029-9a72db13c172 tempest-VolumesActionsTest-1263735328 None] Lock "cinder-0dd8fc39-e51c-45a6-b026-97ed16c26c85-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:13:37 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-d81c2e75-556d-4c90-a029-9a72db13c172 tempest-VolumesActionsTest-1263735328 None] Acquiring lock "cinder-quobyte-0dd8fc39-e51c-45a6-b026-97ed16c26c85" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:13:37 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-d81c2e75-556d-4c90-a029-9a72db13c172 tempest-VolumesActionsTest-1263735328 None] Lock "cinder-quobyte-0dd8fc39-e51c-45a6-b026-97ed16c26c85" acquired by "delete_volume" :: waited 0.015s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:13:37 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e898f44-187d-45ef-827e-5a2f1894596b]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:13:37 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-d81c2e75-556d-4c90-a029-9a72db13c172 tempest-VolumesActionsTest-1263735328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-0dd8fc39-e51c-45a6-b026-97ed16c26c85 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:13:37 devstack sudo[91324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-0dd8fc39-e51c-45a6-b026-97ed16c26c85
Apr 28 22:13:37 devstack sudo[91324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:13:38 devstack sudo[91324]: pam_unix(sudo:session): session closed for user root
Apr 28 22:13:38 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-d81c2e75-556d-4c90-a029-9a72db13c172 tempest-VolumesActionsTest-1263735328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-0dd8fc39-e51c-45a6-b026-97ed16c26c85" returned: 0 in 0.739s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:13:38 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-d81c2e75-556d-4c90-a029-9a72db13c172 tempest-VolumesActionsTest-1263735328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-0dd8fc39-e51c-45a6-b026-97ed16c26c85 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:13:38 devstack sudo[91329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-0dd8fc39-e51c-45a6-b026-97ed16c26c85
Apr 28 22:13:38 devstack sudo[91329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:13:38 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c68aaad-52d3-43fe-ba96-7e191b3175d1 tempest-VolumesSnapshotTestJSON-845556625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:13:38 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-2c68aaad-52d3-43fe-ba96-7e191b3175d1 tempest-VolumesSnapshotTestJSON-845556625 None] Flow 'volume_create_manager' (e6f6d815-da45-46c8-a9b2-275a2c29ed69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:13:38 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-2c68aaad-52d3-43fe-ba96-7e191b3175d1 tempest-VolumesSnapshotTestJSON-845556625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de469183-f200-41fe-870a-4cf885b429ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:13:38 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-2c68aaad-52d3-43fe-ba96-7e191b3175d1 tempest-VolumesSnapshotTestJSON-845556625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de469183-f200-41fe-870a-4cf885b429ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:13:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-818088941',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55927b0a-96f0-4346-a0eb-5fb22e704e1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='943f06ac94cc45fd8931aec9663110b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:13:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:13:39Z,use_quota=True,user_id='4fa9b35ee1914787baad9599186a3f4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:13:38 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-2c68aaad-52d3-43fe-ba96-7e191b3175d1 tempest-VolumesSnapshotTestJSON-845556625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f1a2231-8a03-4394-ac07-e740c7acc488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:13:38 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-2c68aaad-52d3-43fe-ba96-7e191b3175d1 tempest-VolumesSnapshotTestJSON-845556625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f1a2231-8a03-4394-ac07-e740c7acc488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:13:38 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-2c68aaad-52d3-43fe-ba96-7e191b3175d1 tempest-VolumesSnapshotTestJSON-845556625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25e8877a-78ab-4831-a2b0-151416da33a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:13:38 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-2c68aaad-52d3-43fe-ba96-7e191b3175d1 tempest-VolumesSnapshotTestJSON-845556625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25e8877a-78ab-4831-a2b0-151416da33a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55927b0a-96f0-4346-a0eb-5fb22e704e1d', 'volume_name': 'volume-55927b0a-96f0-4346-a0eb-5fb22e704e1d', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:13:38 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-2c68aaad-52d3-43fe-ba96-7e191b3175d1 tempest-VolumesSnapshotTestJSON-845556625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b299dcb1-5bf0-4e0d-8d3c-974a739d4814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:13:38 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-2c68aaad-52d3-43fe-ba96-7e191b3175d1 tempest-VolumesSnapshotTestJSON-845556625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b299dcb1-5bf0-4e0d-8d3c-974a739d4814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:13:38 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-2c68aaad-52d3-43fe-ba96-7e191b3175d1 tempest-VolumesSnapshotTestJSON-845556625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d50053d-7022-4a33-804e-9a0cbc46c64c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:13:38 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-2c68aaad-52d3-43fe-ba96-7e191b3175d1 tempest-VolumesSnapshotTestJSON-845556625 None] Volume 55927b0a-96f0-4346-a0eb-5fb22e704e1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55927b0a-96f0-4346-a0eb-5fb22e704e1d', 'volume_size': 1}
Apr 28 22:13:38 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-2c68aaad-52d3-43fe-ba96-7e191b3175d1 tempest-VolumesSnapshotTestJSON-845556625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:13:38 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-2c68aaad-52d3-43fe-ba96-7e191b3175d1 tempest-VolumesSnapshotTestJSON-845556625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:13:38 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-2c68aaad-52d3-43fe-ba96-7e191b3175d1 tempest-VolumesSnapshotTestJSON-845556625 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:13:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-818088941',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55927b0a-96f0-4346-a0eb-5fb22e704e1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='943f06ac94cc45fd8931aec9663110b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:13:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:13:39Z,use_quota=True,user_id='4fa9b35ee1914787baad9599186a3f4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:13:38 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-2c68aaad-52d3-43fe-ba96-7e191b3175d1 tempest-VolumesSnapshotTestJSON-845556625 None] Creating volume 55927b0a-96f0-4346-a0eb-5fb22e704e1d {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:13:38 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-2c68aaad-52d3-43fe-ba96-7e191b3175d1 tempest-VolumesSnapshotTestJSON-845556625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:13:38 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-2c68aaad-52d3-43fe-ba96-7e191b3175d1 tempest-VolumesSnapshotTestJSON-845556625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:13:38 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-2c68aaad-52d3-43fe-ba96-7e191b3175d1 tempest-VolumesSnapshotTestJSON-845556625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:13:38 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-2c68aaad-52d3-43fe-ba96-7e191b3175d1 tempest-VolumesSnapshotTestJSON-845556625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:13:38 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-2c68aaad-52d3-43fe-ba96-7e191b3175d1 tempest-VolumesSnapshotTestJSON-845556625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:13:38 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-2c68aaad-52d3-43fe-ba96-7e191b3175d1 tempest-VolumesSnapshotTestJSON-845556625 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:13:38 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-2c68aaad-52d3-43fe-ba96-7e191b3175d1 tempest-VolumesSnapshotTestJSON-845556625 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:13:38 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-2c68aaad-52d3-43fe-ba96-7e191b3175d1 tempest-VolumesSnapshotTestJSON-845556625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-55927b0a-96f0-4346-a0eb-5fb22e704e1d 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:13:38 devstack sudo[91331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-55927b0a-96f0-4346-a0eb-5fb22e704e1d 1073741824
Apr 28 22:13:38 devstack sudo[91331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:13:39 devstack sudo[91329]: pam_unix(sudo:session): session closed for user root
Apr 28 22:13:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-d81c2e75-556d-4c90-a029-9a72db13c172 tempest-VolumesActionsTest-1263735328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-0dd8fc39-e51c-45a6-b026-97ed16c26c85" returned: 0 in 0.597s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:13:39 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-d81c2e75-556d-4c90-a029-9a72db13c172 tempest-VolumesActionsTest-1263735328 None] Lock "cinder-quobyte-0dd8fc39-e51c-45a6-b026-97ed16c26c85" released by "delete_volume" :: held 1.388s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:13:39 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-d81c2e75-556d-4c90-a029-9a72db13c172 tempest-VolumesActionsTest-1263735328 None] Created reservations ['0a013ce2-4353-46e3-81ee-08c476e03782', 'e5a2aa2a-77ad-439e-adf9-fbf51c34faa4', '5e586ce6-ac89-4e25-a077-94949645ed11', 'a7154bd9-41af-4fd7-bb5a-29d37d22edc1'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:13:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-d81c2e75-556d-4c90-a029-9a72db13c172 tempest-VolumesActionsTest-1263735328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:13:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-d81c2e75-556d-4c90-a029-9a72db13c172 tempest-VolumesActionsTest-1263735328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:13:39 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-d81c2e75-556d-4c90-a029-9a72db13c172 tempest-VolumesActionsTest-1263735328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:13:39 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-d81c2e75-556d-4c90-a029-9a72db13c172 tempest-VolumesActionsTest-1263735328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:13:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-d81c2e75-556d-4c90-a029-9a72db13c172 tempest-VolumesActionsTest-1263735328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:13:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-d81c2e75-556d-4c90-a029-9a72db13c172 tempest-VolumesActionsTest-1263735328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:13:39 devstack sudo[91337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:13:39 devstack sudo[91337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:13:39 devstack sudo[91331]: pam_unix(sudo:session): session closed for user root
Apr 28 22:13:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-2c68aaad-52d3-43fe-ba96-7e191b3175d1 tempest-VolumesSnapshotTestJSON-845556625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-55927b0a-96f0-4346-a0eb-5fb22e704e1d 1073741824" returned: 0 in 0.822s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:13:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-2c68aaad-52d3-43fe-ba96-7e191b3175d1 tempest-VolumesSnapshotTestJSON-845556625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-55927b0a-96f0-4346-a0eb-5fb22e704e1d {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:13:39 devstack sudo[91340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-55927b0a-96f0-4346-a0eb-5fb22e704e1d
Apr 28 22:13:39 devstack sudo[91340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:13:39 devstack cinder-volume[83924]: DEBUG oslo_service.periodic_task [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83924) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 28 22:13:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:13:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:13:39 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:13:39 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:13:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:13:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:13:39 devstack sudo[91342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:13:39 devstack sudo[91342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:13:39 devstack sudo[91337]: pam_unix(sudo:session): session closed for user root
Apr 28 22:13:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-d81c2e75-556d-4c90-a029-9a72db13c172 tempest-VolumesActionsTest-1263735328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.677s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:13:39 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-d81c2e75-556d-4c90-a029-9a72db13c172 tempest-VolumesActionsTest-1263735328 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:13:39 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-d81c2e75-556d-4c90-a029-9a72db13c172 tempest-VolumesActionsTest-1263735328 None] Deleted volume successfully.
Apr 28 22:13:39 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-d81c2e75-556d-4c90-a029-9a72db13c172 tempest-VolumesActionsTest-1263735328 None] Lock "cinder-0dd8fc39-e51c-45a6-b026-97ed16c26c85-delete_volume" released by "delete_volume" :: held 2.284s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:13:40 devstack sudo[91340]: pam_unix(sudo:session): session closed for user root
Apr 28 22:13:40 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-2c68aaad-52d3-43fe-ba96-7e191b3175d1 tempest-VolumesSnapshotTestJSON-845556625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-55927b0a-96f0-4346-a0eb-5fb22e704e1d" returned: 0 in 0.644s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:13:40 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-2c68aaad-52d3-43fe-ba96-7e191b3175d1 tempest-VolumesSnapshotTestJSON-845556625 None] <== create_volume: return (1516ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:13:40 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-2c68aaad-52d3-43fe-ba96-7e191b3175d1 tempest-VolumesSnapshotTestJSON-845556625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.519s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:13:40 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-2c68aaad-52d3-43fe-ba96-7e191b3175d1 tempest-VolumesSnapshotTestJSON-845556625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d50053d-7022-4a33-804e-9a0cbc46c64c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55927b0a-96f0-4346-a0eb-5fb22e704e1d', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:13:40 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-2c68aaad-52d3-43fe-ba96-7e191b3175d1 tempest-VolumesSnapshotTestJSON-845556625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (718a69a2-e8d7-402b-9572-ecbaf061015b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:13:40 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-2c68aaad-52d3-43fe-ba96-7e191b3175d1 tempest-VolumesSnapshotTestJSON-845556625 None] Volume volume-55927b0a-96f0-4346-a0eb-5fb22e704e1d (55927b0a-96f0-4346-a0eb-5fb22e704e1d): created successfully
Apr 28 22:13:40 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-2c68aaad-52d3-43fe-ba96-7e191b3175d1 tempest-VolumesSnapshotTestJSON-845556625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (718a69a2-e8d7-402b-9572-ecbaf061015b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:13:40 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-2c68aaad-52d3-43fe-ba96-7e191b3175d1 tempest-VolumesSnapshotTestJSON-845556625 None] Flow 'volume_create_manager' (e6f6d815-da45-46c8-a9b2-275a2c29ed69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:13:40 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-2c68aaad-52d3-43fe-ba96-7e191b3175d1 tempest-VolumesSnapshotTestJSON-845556625 None] Created volume successfully.
Apr 28 22:13:40 devstack sudo[91342]: pam_unix(sudo:session): session closed for user root
Apr 28 22:13:40 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.621s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:13:40 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:13:40 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-86f53a39-9bbc-4bd4-8176-1d9bd3c1254d tempest-VolumesActionsTest-569706945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:13:40 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-86f53a39-9bbc-4bd4-8176-1d9bd3c1254d tempest-VolumesActionsTest-569706945 None] Flow 'volume_create_manager' (dde8bdda-45b0-4440-852b-502b1f4c2cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:13:40 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-86f53a39-9bbc-4bd4-8176-1d9bd3c1254d tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a35c7079-f452-4a23-a3e3-b44fe33236ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:13:40 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-86f53a39-9bbc-4bd4-8176-1d9bd3c1254d tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a35c7079-f452-4a23-a3e3-b44fe33236ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:13:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1781929406',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c17d843a-5dfd-4ba2-badf-3f20cb5c4dcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='417e78d847a14bb7b984ce42071a7dcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:13:40Z,use_quota=True,user_id='593c239cd1704470a2e916dd6a242c9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:13:40 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-86f53a39-9bbc-4bd4-8176-1d9bd3c1254d tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a20b14b6-cea9-4e0d-a07b-6eb67b43c593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:13:40 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-86f53a39-9bbc-4bd4-8176-1d9bd3c1254d tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a20b14b6-cea9-4e0d-a07b-6eb67b43c593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:13:40 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-86f53a39-9bbc-4bd4-8176-1d9bd3c1254d tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f0f1b7d-85ef-46d6-9d80-ebf09c92b306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:13:40 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-86f53a39-9bbc-4bd4-8176-1d9bd3c1254d tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f0f1b7d-85ef-46d6-9d80-ebf09c92b306) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c17d843a-5dfd-4ba2-badf-3f20cb5c4dcc', 'volume_name': 'volume-c17d843a-5dfd-4ba2-badf-3f20cb5c4dcc', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:13:40 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-86f53a39-9bbc-4bd4-8176-1d9bd3c1254d tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (739000ff-eb81-4f6c-bdaa-84099a81ab46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:13:40 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-86f53a39-9bbc-4bd4-8176-1d9bd3c1254d tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (739000ff-eb81-4f6c-bdaa-84099a81ab46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:13:40 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-86f53a39-9bbc-4bd4-8176-1d9bd3c1254d tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (928c3ebe-3c11-4bef-9f82-2b28e9716f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:13:40 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-86f53a39-9bbc-4bd4-8176-1d9bd3c1254d tempest-VolumesActionsTest-569706945 None] Volume c17d843a-5dfd-4ba2-badf-3f20cb5c4dcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c17d843a-5dfd-4ba2-badf-3f20cb5c4dcc', 'volume_size': 1}
Apr 28 22:13:40 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-86f53a39-9bbc-4bd4-8176-1d9bd3c1254d tempest-VolumesActionsTest-569706945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:13:40 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-86f53a39-9bbc-4bd4-8176-1d9bd3c1254d tempest-VolumesActionsTest-569706945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:13:40 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-86f53a39-9bbc-4bd4-8176-1d9bd3c1254d tempest-VolumesActionsTest-569706945 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:13:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1781929406',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c17d843a-5dfd-4ba2-badf-3f20cb5c4dcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='417e78d847a14bb7b984ce42071a7dcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:13:40Z,use_quota=True,user_id='593c239cd1704470a2e916dd6a242c9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:13:40 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-86f53a39-9bbc-4bd4-8176-1d9bd3c1254d tempest-VolumesActionsTest-569706945 None] Creating volume c17d843a-5dfd-4ba2-badf-3f20cb5c4dcc {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:13:40 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-86f53a39-9bbc-4bd4-8176-1d9bd3c1254d tempest-VolumesActionsTest-569706945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:13:40 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-86f53a39-9bbc-4bd4-8176-1d9bd3c1254d tempest-VolumesActionsTest-569706945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:13:40 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-86f53a39-9bbc-4bd4-8176-1d9bd3c1254d tempest-VolumesActionsTest-569706945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:13:40 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-86f53a39-9bbc-4bd4-8176-1d9bd3c1254d tempest-VolumesActionsTest-569706945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:13:40 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-86f53a39-9bbc-4bd4-8176-1d9bd3c1254d tempest-VolumesActionsTest-569706945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:13:40 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-86f53a39-9bbc-4bd4-8176-1d9bd3c1254d tempest-VolumesActionsTest-569706945 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:13:40 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-86f53a39-9bbc-4bd4-8176-1d9bd3c1254d tempest-VolumesActionsTest-569706945 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:13:40 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-86f53a39-9bbc-4bd4-8176-1d9bd3c1254d tempest-VolumesActionsTest-569706945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-c17d843a-5dfd-4ba2-badf-3f20cb5c4dcc 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:13:40 devstack sudo[91347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-c17d843a-5dfd-4ba2-badf-3f20cb5c4dcc 1073741824
Apr 28 22:13:40 devstack sudo[91347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:13:41 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-c972c1bb-7ee8-480b-84cc-ee64a73c4eb4 tempest-VolumesSnapshotTestJSON-845556625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:13:41 devstack sudo[91347]: pam_unix(sudo:session): session closed for user root
Apr 28 22:13:41 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-86f53a39-9bbc-4bd4-8176-1d9bd3c1254d tempest-VolumesActionsTest-569706945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-c17d843a-5dfd-4ba2-badf-3f20cb5c4dcc 1073741824" returned: 0 in 0.775s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:13:41 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-86f53a39-9bbc-4bd4-8176-1d9bd3c1254d tempest-VolumesActionsTest-569706945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-c17d843a-5dfd-4ba2-badf-3f20cb5c4dcc {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:13:41 devstack sudo[91354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-c17d843a-5dfd-4ba2-badf-3f20cb5c4dcc
Apr 28 22:13:41 devstack sudo[91354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:13:41 devstack sudo[91354]: pam_unix(sudo:session): session closed for user root
Apr 28 22:13:41 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-86f53a39-9bbc-4bd4-8176-1d9bd3c1254d tempest-VolumesActionsTest-569706945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-c17d843a-5dfd-4ba2-badf-3f20cb5c4dcc" returned: 0 in 0.587s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:13:41 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-86f53a39-9bbc-4bd4-8176-1d9bd3c1254d tempest-VolumesActionsTest-569706945 None] <== create_volume: return (1399ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:13:41 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-86f53a39-9bbc-4bd4-8176-1d9bd3c1254d tempest-VolumesActionsTest-569706945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.401s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:13:41 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-c972c1bb-7ee8-480b-84cc-ee64a73c4eb4 tempest-VolumesSnapshotTestJSON-845556625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.820s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:13:41 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-c972c1bb-7ee8-480b-84cc-ee64a73c4eb4 tempest-VolumesSnapshotTestJSON-845556625 None] Creating offline snapshot ce462ef1-4869-4c23-a518-0564436eedd4 of volume 55927b0a-96f0-4346-a0eb-5fb22e704e1d {{(pid=83924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 22:13:41 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-86f53a39-9bbc-4bd4-8176-1d9bd3c1254d tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (928c3ebe-3c11-4bef-9f82-2b28e9716f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c17d843a-5dfd-4ba2-badf-3f20cb5c4dcc', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:13:41 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-86f53a39-9bbc-4bd4-8176-1d9bd3c1254d tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23caf150-ee82-4c2f-9b4f-f751e98dac81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:13:41 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d5c6fc-6bd1-4829-a7b6-9e98c949f9f4]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:13:41 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c972c1bb-7ee8-480b-84cc-ee64a73c4eb4 tempest-VolumesSnapshotTestJSON-845556625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-55927b0a-96f0-4346-a0eb-5fb22e704e1d {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:13:41 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-86f53a39-9bbc-4bd4-8176-1d9bd3c1254d tempest-VolumesActionsTest-569706945 None] Volume volume-c17d843a-5dfd-4ba2-badf-3f20cb5c4dcc (c17d843a-5dfd-4ba2-badf-3f20cb5c4dcc): created successfully
Apr 28 22:13:41 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-86f53a39-9bbc-4bd4-8176-1d9bd3c1254d tempest-VolumesActionsTest-569706945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23caf150-ee82-4c2f-9b4f-f751e98dac81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:13:41 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-86f53a39-9bbc-4bd4-8176-1d9bd3c1254d tempest-VolumesActionsTest-569706945 None] Flow 'volume_create_manager' (dde8bdda-45b0-4440-852b-502b1f4c2cd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:13:41 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-86f53a39-9bbc-4bd4-8176-1d9bd3c1254d tempest-VolumesActionsTest-569706945 None] Created volume successfully.
Apr 28 22:13:42 devstack sudo[91357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-55927b0a-96f0-4346-a0eb-5fb22e704e1d
Apr 28 22:13:42 devstack sudo[91357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:13:42 devstack sudo[91357]: pam_unix(sudo:session): session closed for user root
Apr 28 22:13:42 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c972c1bb-7ee8-480b-84cc-ee64a73c4eb4 tempest-VolumesSnapshotTestJSON-845556625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-55927b0a-96f0-4346-a0eb-5fb22e704e1d" returned: 0 in 0.774s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:13:42 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c972c1bb-7ee8-480b-84cc-ee64a73c4eb4 tempest-VolumesSnapshotTestJSON-845556625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-55927b0a-96f0-4346-a0eb-5fb22e704e1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-55927b0a-96f0-4346-a0eb-5fb22e704e1d.ce462ef1-4869-4c23-a518-0564436eedd4 1G {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:13:42 devstack sudo[91362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-55927b0a-96f0-4346-a0eb-5fb22e704e1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-55927b0a-96f0-4346-a0eb-5fb22e704e1d.ce462ef1-4869-4c23-a518-0564436eedd4 1G
Apr 28 22:13:42 devstack sudo[91362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:13:43 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-eec1f543-0e55-45ab-bf4b-6c0657869e3b tempest-VolumesActionsTest-569706945 None] Acquiring lock "cinder-c17d843a-5dfd-4ba2-badf-3f20cb5c4dcc-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:13:43 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-eec1f543-0e55-45ab-bf4b-6c0657869e3b tempest-VolumesActionsTest-569706945 None] Lock "cinder-c17d843a-5dfd-4ba2-badf-3f20cb5c4dcc-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:13:43 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-eec1f543-0e55-45ab-bf4b-6c0657869e3b tempest-VolumesActionsTest-569706945 None] Acquiring lock "cinder-quobyte-c17d843a-5dfd-4ba2-badf-3f20cb5c4dcc" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:13:43 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-eec1f543-0e55-45ab-bf4b-6c0657869e3b tempest-VolumesActionsTest-569706945 None] Lock "cinder-quobyte-c17d843a-5dfd-4ba2-badf-3f20cb5c4dcc" acquired by "delete_volume" :: waited 0.019s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:13:43 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d16daa-8816-41d8-88f9-b8bdf327a7a5]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:13:43 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-eec1f543-0e55-45ab-bf4b-6c0657869e3b tempest-VolumesActionsTest-569706945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-c17d843a-5dfd-4ba2-badf-3f20cb5c4dcc {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:13:43 devstack sudo[91368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-c17d843a-5dfd-4ba2-badf-3f20cb5c4dcc
Apr 28 22:13:43 devstack sudo[91368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:13:43 devstack sudo[91362]: pam_unix(sudo:session): session closed for user root
Apr 28 22:13:43 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c972c1bb-7ee8-480b-84cc-ee64a73c4eb4 tempest-VolumesSnapshotTestJSON-845556625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-55927b0a-96f0-4346-a0eb-5fb22e704e1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-55927b0a-96f0-4346-a0eb-5fb22e704e1d.ce462ef1-4869-4c23-a518-0564436eedd4 1G" returned: 0 in 0.757s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:13:43 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c972c1bb-7ee8-480b-84cc-ee64a73c4eb4 tempest-VolumesSnapshotTestJSON-845556625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55927b0a-96f0-4346-a0eb-5fb22e704e1d -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-55927b0a-96f0-4346-a0eb-5fb22e704e1d.ce462ef1-4869-4c23-a518-0564436eedd4 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:13:43 devstack sudo[91371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55927b0a-96f0-4346-a0eb-5fb22e704e1d -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-55927b0a-96f0-4346-a0eb-5fb22e704e1d.ce462ef1-4869-4c23-a518-0564436eedd4
Apr 28 22:13:43 devstack sudo[91371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:13:43 devstack sudo[91368]: pam_unix(sudo:session): session closed for user root
Apr 28 22:13:43 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-eec1f543-0e55-45ab-bf4b-6c0657869e3b tempest-VolumesActionsTest-569706945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-c17d843a-5dfd-4ba2-badf-3f20cb5c4dcc" returned: 0 in 0.689s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:13:43 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-eec1f543-0e55-45ab-bf4b-6c0657869e3b tempest-VolumesActionsTest-569706945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-c17d843a-5dfd-4ba2-badf-3f20cb5c4dcc {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:13:43 devstack sudo[91377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-c17d843a-5dfd-4ba2-badf-3f20cb5c4dcc
Apr 28 22:13:43 devstack sudo[91377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:13:44 devstack sudo[91371]: pam_unix(sudo:session): session closed for user root
Apr 28 22:13:44 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c972c1bb-7ee8-480b-84cc-ee64a73c4eb4 tempest-VolumesSnapshotTestJSON-845556625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55927b0a-96f0-4346-a0eb-5fb22e704e1d -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-55927b0a-96f0-4346-a0eb-5fb22e704e1d.ce462ef1-4869-4c23-a518-0564436eedd4" returned: 0 in 0.614s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:13:44 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-c972c1bb-7ee8-480b-84cc-ee64a73c4eb4 tempest-VolumesSnapshotTestJSON-845556625 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-55927b0a-96f0-4346-a0eb-5fb22e704e1d.ce462ef1-4869-4c23-a518-0564436eedd4 is being set with open permissions: ugo+rw
Apr 28 22:13:44 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c972c1bb-7ee8-480b-84cc-ee64a73c4eb4 tempest-VolumesSnapshotTestJSON-845556625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-55927b0a-96f0-4346-a0eb-5fb22e704e1d.ce462ef1-4869-4c23-a518-0564436eedd4 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:13:44 devstack sudo[91381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-55927b0a-96f0-4346-a0eb-5fb22e704e1d.ce462ef1-4869-4c23-a518-0564436eedd4
Apr 28 22:13:44 devstack sudo[91381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:13:44 devstack sudo[91377]: pam_unix(sudo:session): session closed for user root
Apr 28 22:13:44 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-eec1f543-0e55-45ab-bf4b-6c0657869e3b tempest-VolumesActionsTest-569706945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-c17d843a-5dfd-4ba2-badf-3f20cb5c4dcc" returned: 0 in 0.631s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:13:44 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-eec1f543-0e55-45ab-bf4b-6c0657869e3b tempest-VolumesActionsTest-569706945 None] Lock "cinder-quobyte-c17d843a-5dfd-4ba2-badf-3f20cb5c4dcc" released by "delete_volume" :: held 1.365s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:13:44 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-eec1f543-0e55-45ab-bf4b-6c0657869e3b tempest-VolumesActionsTest-569706945 None] Created reservations ['9eef3593-7326-4f95-8853-8c91d3bdfdbf', '89ed146f-2d63-4d6c-b6ad-d1517663dfca', 'b8da20da-1df7-4eae-b58c-d9291e802519', 'ec638ac6-6f62-4005-90bf-3615f108c16c'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:13:44 devstack sudo[91381]: pam_unix(sudo:session): session closed for user root
Apr 28 22:13:44 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c972c1bb-7ee8-480b-84cc-ee64a73c4eb4 tempest-VolumesSnapshotTestJSON-845556625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-55927b0a-96f0-4346-a0eb-5fb22e704e1d.ce462ef1-4869-4c23-a518-0564436eedd4" returned: 0 in 0.609s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:13:44 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-eec1f543-0e55-45ab-bf4b-6c0657869e3b tempest-VolumesActionsTest-569706945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:13:44 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-eec1f543-0e55-45ab-bf4b-6c0657869e3b tempest-VolumesActionsTest-569706945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:13:44 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-eec1f543-0e55-45ab-bf4b-6c0657869e3b tempest-VolumesActionsTest-569706945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:13:44 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-eec1f543-0e55-45ab-bf4b-6c0657869e3b tempest-VolumesActionsTest-569706945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:13:44 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-eec1f543-0e55-45ab-bf4b-6c0657869e3b tempest-VolumesActionsTest-569706945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:13:44 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-eec1f543-0e55-45ab-bf4b-6c0657869e3b tempest-VolumesActionsTest-569706945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:13:44 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c972c1bb-7ee8-480b-84cc-ee64a73c4eb4 tempest-VolumesSnapshotTestJSON-845556625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-55927b0a-96f0-4346-a0eb-5fb22e704e1d.info {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:13:44 devstack sudo[91385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:13:44 devstack sudo[91385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:13:44 devstack sudo[91386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-55927b0a-96f0-4346-a0eb-5fb22e704e1d.info
Apr 28 22:13:44 devstack sudo[91386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:13:45 devstack sudo[91385]: pam_unix(sudo:session): session closed for user root
Apr 28 22:13:45 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-eec1f543-0e55-45ab-bf4b-6c0657869e3b tempest-VolumesActionsTest-569706945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.649s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:13:45 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-eec1f543-0e55-45ab-bf4b-6c0657869e3b tempest-VolumesActionsTest-569706945 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:13:45 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-eec1f543-0e55-45ab-bf4b-6c0657869e3b tempest-VolumesActionsTest-569706945 None] Deleted volume successfully.
Apr 28 22:13:45 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-eec1f543-0e55-45ab-bf4b-6c0657869e3b tempest-VolumesActionsTest-569706945 None] Lock "cinder-c17d843a-5dfd-4ba2-badf-3f20cb5c4dcc-delete_volume" released by "delete_volume" :: held 2.240s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:13:45 devstack sudo[91386]: pam_unix(sudo:session): session closed for user root
Apr 28 22:13:45 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c972c1bb-7ee8-480b-84cc-ee64a73c4eb4 tempest-VolumesSnapshotTestJSON-845556625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-55927b0a-96f0-4346-a0eb-5fb22e704e1d.info" returned: 0 in 0.676s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:13:45 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-c972c1bb-7ee8-480b-84cc-ee64a73c4eb4 tempest-VolumesSnapshotTestJSON-845556625 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-55927b0a-96f0-4346-a0eb-5fb22e704e1d.info is being set with open permissions: ugo+rw
Apr 28 22:13:45 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c972c1bb-7ee8-480b-84cc-ee64a73c4eb4 tempest-VolumesSnapshotTestJSON-845556625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-55927b0a-96f0-4346-a0eb-5fb22e704e1d.info {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:13:45 devstack sudo[91391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-55927b0a-96f0-4346-a0eb-5fb22e704e1d.info
Apr 28 22:13:45 devstack sudo[91391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:13:46 devstack sudo[91391]: pam_unix(sudo:session): session closed for user root
Apr 28 22:13:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c972c1bb-7ee8-480b-84cc-ee64a73c4eb4 tempest-VolumesSnapshotTestJSON-845556625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-55927b0a-96f0-4346-a0eb-5fb22e704e1d.info" returned: 0 in 0.630s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:13:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-c972c1bb-7ee8-480b-84cc-ee64a73c4eb4 tempest-VolumesSnapshotTestJSON-845556625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.186s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:13:46 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-c972c1bb-7ee8-480b-84cc-ee64a73c4eb4 tempest-VolumesSnapshotTestJSON-845556625 None] Create snapshot completed successfully
Apr 28 22:13:46 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-e15a3c76-9593-43e6-b85e-f47464c1e26d tempest-VolumesSnapshotTestJSON-845556625 None] Acquiring lock "cinder-ce462ef1-4869-4c23-a518-0564436eedd4-delete_snapshot" by "delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:13:46 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-e15a3c76-9593-43e6-b85e-f47464c1e26d tempest-VolumesSnapshotTestJSON-845556625 None] Lock "cinder-ce462ef1-4869-4c23-a518-0564436eedd4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:13:46 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-e15a3c76-9593-43e6-b85e-f47464c1e26d tempest-VolumesSnapshotTestJSON-845556625 None] Acquiring lock "cinder-quobyte-55927b0a-96f0-4346-a0eb-5fb22e704e1d" by "delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:13:46 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-e15a3c76-9593-43e6-b85e-f47464c1e26d tempest-VolumesSnapshotTestJSON-845556625 None] Lock "cinder-quobyte-55927b0a-96f0-4346-a0eb-5fb22e704e1d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:13:46 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-e15a3c76-9593-43e6-b85e-f47464c1e26d tempest-VolumesSnapshotTestJSON-845556625 None] Acquiring lock "cinder-quobyte-ce462ef1-4869-4c23-a518-0564436eedd4" by "_delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:13:46 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-e15a3c76-9593-43e6-b85e-f47464c1e26d tempest-VolumesSnapshotTestJSON-845556625 None] Lock "cinder-quobyte-ce462ef1-4869-4c23-a518-0564436eedd4" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:13:46 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-e15a3c76-9593-43e6-b85e-f47464c1e26d tempest-VolumesSnapshotTestJSON-845556625 None] Deleting offline snapshot ce462ef1-4869-4c23-a518-0564436eedd4 of volume 55927b0a-96f0-4346-a0eb-5fb22e704e1d {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 22:13:46 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-e15a3c76-9593-43e6-b85e-f47464c1e26d tempest-VolumesSnapshotTestJSON-845556625 None] snapshot_file for this snap is: volume-55927b0a-96f0-4346-a0eb-5fb22e704e1d.ce462ef1-4869-4c23-a518-0564436eedd4 {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 22:13:46 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d946a4-876f-4d05-b0ce-e2302669b542]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:13:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e15a3c76-9593-43e6-b85e-f47464c1e26d tempest-VolumesSnapshotTestJSON-845556625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-55927b0a-96f0-4346-a0eb-5fb22e704e1d.ce462ef1-4869-4c23-a518-0564436eedd4 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:13:46 devstack sudo[91394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-55927b0a-96f0-4346-a0eb-5fb22e704e1d.ce462ef1-4869-4c23-a518-0564436eedd4
Apr 28 22:13:46 devstack sudo[91394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:13:47 devstack sudo[91394]: pam_unix(sudo:session): session closed for user root
Apr 28 22:13:47 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e15a3c76-9593-43e6-b85e-f47464c1e26d tempest-VolumesSnapshotTestJSON-845556625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-55927b0a-96f0-4346-a0eb-5fb22e704e1d.ce462ef1-4869-4c23-a518-0564436eedd4" returned: 0 in 0.735s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:13:47 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-e15a3c76-9593-43e6-b85e-f47464c1e26d tempest-VolumesSnapshotTestJSON-845556625 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55927b0a-96f0-4346-a0eb-5fb22e704e1d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 22:13:47 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a8879a-4488-48fd-96d2-709cddc134e1]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:13:47 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e15a3c76-9593-43e6-b85e-f47464c1e26d tempest-VolumesSnapshotTestJSON-845556625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-55927b0a-96f0-4346-a0eb-5fb22e704e1d {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:13:47 devstack sudo[91400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-55927b0a-96f0-4346-a0eb-5fb22e704e1d
Apr 28 22:13:47 devstack sudo[91400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:13:48 devstack sudo[91400]: pam_unix(sudo:session): session closed for user root
Apr 28 22:13:48 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e15a3c76-9593-43e6-b85e-f47464c1e26d tempest-VolumesSnapshotTestJSON-845556625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-55927b0a-96f0-4346-a0eb-5fb22e704e1d" returned: 0 in 0.801s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:13:48 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e15a3c76-9593-43e6-b85e-f47464c1e26d tempest-VolumesSnapshotTestJSON-845556625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-55927b0a-96f0-4346-a0eb-5fb22e704e1d.ce462ef1-4869-4c23-a518-0564436eedd4 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:13:48 devstack sudo[91405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-55927b0a-96f0-4346-a0eb-5fb22e704e1d.ce462ef1-4869-4c23-a518-0564436eedd4
Apr 28 22:13:48 devstack sudo[91405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:13:48 devstack sudo[91405]: pam_unix(sudo:session): session closed for user root
Apr 28 22:13:48 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e15a3c76-9593-43e6-b85e-f47464c1e26d tempest-VolumesSnapshotTestJSON-845556625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-55927b0a-96f0-4346-a0eb-5fb22e704e1d.ce462ef1-4869-4c23-a518-0564436eedd4" returned: 0 in 0.770s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:13:48 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e15a3c76-9593-43e6-b85e-f47464c1e26d tempest-VolumesSnapshotTestJSON-845556625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-55927b0a-96f0-4346-a0eb-5fb22e704e1d.ce462ef1-4869-4c23-a518-0564436eedd4 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:13:48 devstack sudo[91412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-55927b0a-96f0-4346-a0eb-5fb22e704e1d.ce462ef1-4869-4c23-a518-0564436eedd4
Apr 28 22:13:48 devstack sudo[91412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:13:49 devstack sudo[91412]: pam_unix(sudo:session): session closed for user root
Apr 28 22:13:49 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e15a3c76-9593-43e6-b85e-f47464c1e26d tempest-VolumesSnapshotTestJSON-845556625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-55927b0a-96f0-4346-a0eb-5fb22e704e1d.ce462ef1-4869-4c23-a518-0564436eedd4" returned: 0 in 0.610s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:13:49 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-e15a3c76-9593-43e6-b85e-f47464c1e26d tempest-VolumesSnapshotTestJSON-845556625 None] Lock "cinder-quobyte-ce462ef1-4869-4c23-a518-0564436eedd4" released by "_delete_snapshot" :: held 3.056s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:13:49 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-e15a3c76-9593-43e6-b85e-f47464c1e26d tempest-VolumesSnapshotTestJSON-845556625 None] Lock "cinder-quobyte-55927b0a-96f0-4346-a0eb-5fb22e704e1d" released by "delete_snapshot" :: held 3.089s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:13:49 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-e15a3c76-9593-43e6-b85e-f47464c1e26d tempest-VolumesSnapshotTestJSON-845556625 None] Created reservations ['6d18b40e-bc66-486f-9cd5-975467915fe4', '8688cfa8-a81f-48de-9431-77532e22669b', '90969329-2ddb-4ef8-863f-604b7472e566', '37855892-69e1-4f3b-b60f-7ba62eea7947'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:13:49 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-e15a3c76-9593-43e6-b85e-f47464c1e26d tempest-VolumesSnapshotTestJSON-845556625 None] Delete snapshot completed successfully.
Apr 28 22:13:49 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-e15a3c76-9593-43e6-b85e-f47464c1e26d tempest-VolumesSnapshotTestJSON-845556625 None] Lock "cinder-ce462ef1-4869-4c23-a518-0564436eedd4-delete_snapshot" released by "delete_snapshot" :: held 3.255s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:13:51 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-b89ab0f2-8df8-42a0-b6dd-2e53b0ef83d3 tempest-VolumesSnapshotTestJSON-845556625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:13:51 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b89ab0f2-8df8-42a0-b6dd-2e53b0ef83d3 tempest-VolumesSnapshotTestJSON-845556625 None] Flow 'volume_create_manager' (7864a01c-6d25-4211-ae50-55e3d29fed00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:13:51 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b89ab0f2-8df8-42a0-b6dd-2e53b0ef83d3 tempest-VolumesSnapshotTestJSON-845556625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb86619f-ca43-4fba-b92b-8352ebb66a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:13:51 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b89ab0f2-8df8-42a0-b6dd-2e53b0ef83d3 tempest-VolumesSnapshotTestJSON-845556625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb86619f-ca43-4fba-b92b-8352ebb66a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-755331750',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99f72696-ca9a-441e-9fee-f97002f0ca31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='943f06ac94cc45fd8931aec9663110b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:13:51Z,use_quota=True,user_id='4fa9b35ee1914787baad9599186a3f4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:13:51 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b89ab0f2-8df8-42a0-b6dd-2e53b0ef83d3 tempest-VolumesSnapshotTestJSON-845556625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab0e9185-e97c-46fa-b05a-5614fbc3de80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:13:51 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b89ab0f2-8df8-42a0-b6dd-2e53b0ef83d3 tempest-VolumesSnapshotTestJSON-845556625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab0e9185-e97c-46fa-b05a-5614fbc3de80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:13:51 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b89ab0f2-8df8-42a0-b6dd-2e53b0ef83d3 tempest-VolumesSnapshotTestJSON-845556625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6babdce-43b7-4c9b-a601-ddd69aef61ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:13:51 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b89ab0f2-8df8-42a0-b6dd-2e53b0ef83d3 tempest-VolumesSnapshotTestJSON-845556625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6babdce-43b7-4c9b-a601-ddd69aef61ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99f72696-ca9a-441e-9fee-f97002f0ca31', 'volume_name': 'volume-99f72696-ca9a-441e-9fee-f97002f0ca31', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:13:51 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b89ab0f2-8df8-42a0-b6dd-2e53b0ef83d3 tempest-VolumesSnapshotTestJSON-845556625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (264c538a-e659-420c-840f-4b964732eb44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:13:51 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b89ab0f2-8df8-42a0-b6dd-2e53b0ef83d3 tempest-VolumesSnapshotTestJSON-845556625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (264c538a-e659-420c-840f-4b964732eb44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:13:51 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b89ab0f2-8df8-42a0-b6dd-2e53b0ef83d3 tempest-VolumesSnapshotTestJSON-845556625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b648ecac-0bfe-400b-936b-f576bdcd95f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:13:51 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-b89ab0f2-8df8-42a0-b6dd-2e53b0ef83d3 tempest-VolumesSnapshotTestJSON-845556625 None] Volume 99f72696-ca9a-441e-9fee-f97002f0ca31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99f72696-ca9a-441e-9fee-f97002f0ca31', 'volume_size': 1}
Apr 28 22:13:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b89ab0f2-8df8-42a0-b6dd-2e53b0ef83d3 tempest-VolumesSnapshotTestJSON-845556625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:13:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b89ab0f2-8df8-42a0-b6dd-2e53b0ef83d3 tempest-VolumesSnapshotTestJSON-845556625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:13:51 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-b89ab0f2-8df8-42a0-b6dd-2e53b0ef83d3 tempest-VolumesSnapshotTestJSON-845556625 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-755331750',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99f72696-ca9a-441e-9fee-f97002f0ca31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='943f06ac94cc45fd8931aec9663110b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:13:51Z,use_quota=True,user_id='4fa9b35ee1914787baad9599186a3f4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:13:51 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-b89ab0f2-8df8-42a0-b6dd-2e53b0ef83d3 tempest-VolumesSnapshotTestJSON-845556625 None] Creating volume 99f72696-ca9a-441e-9fee-f97002f0ca31 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:13:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b89ab0f2-8df8-42a0-b6dd-2e53b0ef83d3 tempest-VolumesSnapshotTestJSON-845556625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:13:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b89ab0f2-8df8-42a0-b6dd-2e53b0ef83d3 tempest-VolumesSnapshotTestJSON-845556625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:13:51 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-b89ab0f2-8df8-42a0-b6dd-2e53b0ef83d3 tempest-VolumesSnapshotTestJSON-845556625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:13:51 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-b89ab0f2-8df8-42a0-b6dd-2e53b0ef83d3 tempest-VolumesSnapshotTestJSON-845556625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:13:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b89ab0f2-8df8-42a0-b6dd-2e53b0ef83d3 tempest-VolumesSnapshotTestJSON-845556625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:13:51 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-b89ab0f2-8df8-42a0-b6dd-2e53b0ef83d3 tempest-VolumesSnapshotTestJSON-845556625 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:13:51 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-b89ab0f2-8df8-42a0-b6dd-2e53b0ef83d3 tempest-VolumesSnapshotTestJSON-845556625 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:13:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b89ab0f2-8df8-42a0-b6dd-2e53b0ef83d3 tempest-VolumesSnapshotTestJSON-845556625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-99f72696-ca9a-441e-9fee-f97002f0ca31 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:13:51 devstack sudo[91416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-99f72696-ca9a-441e-9fee-f97002f0ca31 1073741824
Apr 28 22:13:51 devstack sudo[91416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:13:52 devstack sudo[91416]: pam_unix(sudo:session): session closed for user root
Apr 28 22:13:52 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b89ab0f2-8df8-42a0-b6dd-2e53b0ef83d3 tempest-VolumesSnapshotTestJSON-845556625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-99f72696-ca9a-441e-9fee-f97002f0ca31 1073741824" returned: 0 in 0.820s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:13:52 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b89ab0f2-8df8-42a0-b6dd-2e53b0ef83d3 tempest-VolumesSnapshotTestJSON-845556625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-99f72696-ca9a-441e-9fee-f97002f0ca31 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:13:52 devstack sudo[91422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-99f72696-ca9a-441e-9fee-f97002f0ca31
Apr 28 22:13:52 devstack sudo[91422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:13:52 devstack sudo[91422]: pam_unix(sudo:session): session closed for user root
Apr 28 22:13:52 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b89ab0f2-8df8-42a0-b6dd-2e53b0ef83d3 tempest-VolumesSnapshotTestJSON-845556625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-99f72696-ca9a-441e-9fee-f97002f0ca31" returned: 0 in 0.642s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:13:52 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-b89ab0f2-8df8-42a0-b6dd-2e53b0ef83d3 tempest-VolumesSnapshotTestJSON-845556625 None] <== create_volume: return (1517ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:13:52 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b89ab0f2-8df8-42a0-b6dd-2e53b0ef83d3 tempest-VolumesSnapshotTestJSON-845556625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.519s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:13:52 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b89ab0f2-8df8-42a0-b6dd-2e53b0ef83d3 tempest-VolumesSnapshotTestJSON-845556625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b648ecac-0bfe-400b-936b-f576bdcd95f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99f72696-ca9a-441e-9fee-f97002f0ca31', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:13:52 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b89ab0f2-8df8-42a0-b6dd-2e53b0ef83d3 tempest-VolumesSnapshotTestJSON-845556625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (637ca3e6-3ac9-41c2-ac63-fe15a31ca092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:13:52 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-b89ab0f2-8df8-42a0-b6dd-2e53b0ef83d3 tempest-VolumesSnapshotTestJSON-845556625 None] Volume volume-99f72696-ca9a-441e-9fee-f97002f0ca31 (99f72696-ca9a-441e-9fee-f97002f0ca31): created successfully
Apr 28 22:13:52 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b89ab0f2-8df8-42a0-b6dd-2e53b0ef83d3 tempest-VolumesSnapshotTestJSON-845556625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (637ca3e6-3ac9-41c2-ac63-fe15a31ca092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:13:52 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b89ab0f2-8df8-42a0-b6dd-2e53b0ef83d3 tempest-VolumesSnapshotTestJSON-845556625 None] Flow 'volume_create_manager' (7864a01c-6d25-4211-ae50-55e3d29fed00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:13:52 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-b89ab0f2-8df8-42a0-b6dd-2e53b0ef83d3 tempest-VolumesSnapshotTestJSON-845556625 None] Created volume successfully.
Apr 28 22:13:53 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-ba8e210d-3c1b-4610-a949-6a1467e33f8b tempest-VolumesSnapshotTestJSON-845556625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:13:53 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-ba8e210d-3c1b-4610-a949-6a1467e33f8b tempest-VolumesSnapshotTestJSON-845556625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:13:53 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-ba8e210d-3c1b-4610-a949-6a1467e33f8b tempest-VolumesSnapshotTestJSON-845556625 None] Creating offline snapshot 1f95d121-1a7d-4efa-987e-9423b54c67ba of volume 99f72696-ca9a-441e-9fee-f97002f0ca31 {{(pid=83924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 22:13:53 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[908d591a-3f15-47df-be11-224253d39cd8]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:13:53 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-ba8e210d-3c1b-4610-a949-6a1467e33f8b tempest-VolumesSnapshotTestJSON-845556625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-99f72696-ca9a-441e-9fee-f97002f0ca31 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:13:53 devstack sudo[91427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-99f72696-ca9a-441e-9fee-f97002f0ca31
Apr 28 22:13:53 devstack sudo[91427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:13:54 devstack sudo[91427]: pam_unix(sudo:session): session closed for user root
Apr 28 22:13:54 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-ba8e210d-3c1b-4610-a949-6a1467e33f8b tempest-VolumesSnapshotTestJSON-845556625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-99f72696-ca9a-441e-9fee-f97002f0ca31" returned: 0 in 0.724s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:13:54 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-ba8e210d-3c1b-4610-a949-6a1467e33f8b tempest-VolumesSnapshotTestJSON-845556625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-99f72696-ca9a-441e-9fee-f97002f0ca31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-99f72696-ca9a-441e-9fee-f97002f0ca31.1f95d121-1a7d-4efa-987e-9423b54c67ba 1G {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:13:54 devstack sudo[91432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-99f72696-ca9a-441e-9fee-f97002f0ca31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-99f72696-ca9a-441e-9fee-f97002f0ca31.1f95d121-1a7d-4efa-987e-9423b54c67ba 1G
Apr 28 22:13:54 devstack sudo[91432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:13:55 devstack sudo[91432]: pam_unix(sudo:session): session closed for user root
Apr 28 22:13:55 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-ba8e210d-3c1b-4610-a949-6a1467e33f8b tempest-VolumesSnapshotTestJSON-845556625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-99f72696-ca9a-441e-9fee-f97002f0ca31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-99f72696-ca9a-441e-9fee-f97002f0ca31.1f95d121-1a7d-4efa-987e-9423b54c67ba 1G" returned: 0 in 0.836s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:13:55 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-ba8e210d-3c1b-4610-a949-6a1467e33f8b tempest-VolumesSnapshotTestJSON-845556625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99f72696-ca9a-441e-9fee-f97002f0ca31 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-99f72696-ca9a-441e-9fee-f97002f0ca31.1f95d121-1a7d-4efa-987e-9423b54c67ba {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:13:55 devstack sudo[91438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99f72696-ca9a-441e-9fee-f97002f0ca31 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-99f72696-ca9a-441e-9fee-f97002f0ca31.1f95d121-1a7d-4efa-987e-9423b54c67ba
Apr 28 22:13:55 devstack sudo[91438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:13:55 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-50df055e-6e7e-491c-a446-fed7430a6973 tempest-VolumesDeleteCascade-344788728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:13:55 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-50df055e-6e7e-491c-a446-fed7430a6973 tempest-VolumesDeleteCascade-344788728 None] Flow 'volume_create_manager' (1ec605ef-4e43-4723-a5d5-f19d47fdb0bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:13:55 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-50df055e-6e7e-491c-a446-fed7430a6973 tempest-VolumesDeleteCascade-344788728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41b1ff21-9256-4d32-884e-bf300d1f582b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:13:55 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-50df055e-6e7e-491c-a446-fed7430a6973 tempest-VolumesDeleteCascade-344788728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41b1ff21-9256-4d32-884e-bf300d1f582b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:13:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-656047121',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6064c2a6-33b0-436d-a1af-17b66b258bb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07ec76fb287340bdaefa189ee009b506',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:13:55Z,use_quota=True,user_id='1b65c92297354fb38aef4cce0104c325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:13:55 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-50df055e-6e7e-491c-a446-fed7430a6973 tempest-VolumesDeleteCascade-344788728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (810792ec-1ce4-413d-8445-fa4b08b7bbdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:13:55 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-50df055e-6e7e-491c-a446-fed7430a6973 tempest-VolumesDeleteCascade-344788728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (810792ec-1ce4-413d-8445-fa4b08b7bbdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:13:55 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-50df055e-6e7e-491c-a446-fed7430a6973 tempest-VolumesDeleteCascade-344788728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5578744c-895c-4d06-b64d-9b344c81ea91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:13:55 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-50df055e-6e7e-491c-a446-fed7430a6973 tempest-VolumesDeleteCascade-344788728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5578744c-895c-4d06-b64d-9b344c81ea91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6064c2a6-33b0-436d-a1af-17b66b258bb2', 'volume_name': 'volume-6064c2a6-33b0-436d-a1af-17b66b258bb2', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:13:55 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-50df055e-6e7e-491c-a446-fed7430a6973 tempest-VolumesDeleteCascade-344788728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72381e04-6362-4b50-a6de-37a016732932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:13:55 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-50df055e-6e7e-491c-a446-fed7430a6973 tempest-VolumesDeleteCascade-344788728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72381e04-6362-4b50-a6de-37a016732932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:13:55 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-50df055e-6e7e-491c-a446-fed7430a6973 tempest-VolumesDeleteCascade-344788728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12f59035-b9f0-4a5d-beab-7e36231acf7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:13:55 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-50df055e-6e7e-491c-a446-fed7430a6973 tempest-VolumesDeleteCascade-344788728 None] Volume 6064c2a6-33b0-436d-a1af-17b66b258bb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6064c2a6-33b0-436d-a1af-17b66b258bb2', 'volume_size': 1}
Apr 28 22:13:55 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-50df055e-6e7e-491c-a446-fed7430a6973 tempest-VolumesDeleteCascade-344788728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:13:55 devstack sudo[91438]: pam_unix(sudo:session): session closed for user root
Apr 28 22:13:55 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-ba8e210d-3c1b-4610-a949-6a1467e33f8b tempest-VolumesSnapshotTestJSON-845556625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99f72696-ca9a-441e-9fee-f97002f0ca31 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-99f72696-ca9a-441e-9fee-f97002f0ca31.1f95d121-1a7d-4efa-987e-9423b54c67ba" returned: 0 in 0.645s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:13:55 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-ba8e210d-3c1b-4610-a949-6a1467e33f8b tempest-VolumesSnapshotTestJSON-845556625 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-99f72696-ca9a-441e-9fee-f97002f0ca31.1f95d121-1a7d-4efa-987e-9423b54c67ba is being set with open permissions: ugo+rw
Apr 28 22:13:55 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-ba8e210d-3c1b-4610-a949-6a1467e33f8b tempest-VolumesSnapshotTestJSON-845556625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-99f72696-ca9a-441e-9fee-f97002f0ca31.1f95d121-1a7d-4efa-987e-9423b54c67ba {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:13:55 devstack sudo[91443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-99f72696-ca9a-441e-9fee-f97002f0ca31.1f95d121-1a7d-4efa-987e-9423b54c67ba
Apr 28 22:13:55 devstack sudo[91443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:13:56 devstack sudo[91443]: pam_unix(sudo:session): session closed for user root
Apr 28 22:13:56 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-ba8e210d-3c1b-4610-a949-6a1467e33f8b tempest-VolumesSnapshotTestJSON-845556625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-99f72696-ca9a-441e-9fee-f97002f0ca31.1f95d121-1a7d-4efa-987e-9423b54c67ba" returned: 0 in 0.562s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:13:56 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-ba8e210d-3c1b-4610-a949-6a1467e33f8b tempest-VolumesSnapshotTestJSON-845556625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-99f72696-ca9a-441e-9fee-f97002f0ca31.info {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:13:56 devstack sudo[91446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-99f72696-ca9a-441e-9fee-f97002f0ca31.info
Apr 28 22:13:56 devstack sudo[91446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:13:56 devstack sudo[91446]: pam_unix(sudo:session): session closed for user root
Apr 28 22:13:56 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-ba8e210d-3c1b-4610-a949-6a1467e33f8b tempest-VolumesSnapshotTestJSON-845556625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-99f72696-ca9a-441e-9fee-f97002f0ca31.info" returned: 0 in 0.566s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:13:56 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-ba8e210d-3c1b-4610-a949-6a1467e33f8b tempest-VolumesSnapshotTestJSON-845556625 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-99f72696-ca9a-441e-9fee-f97002f0ca31.info is being set with open permissions: ugo+rw
Apr 28 22:13:56 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-ba8e210d-3c1b-4610-a949-6a1467e33f8b tempest-VolumesSnapshotTestJSON-845556625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-99f72696-ca9a-441e-9fee-f97002f0ca31.info {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:13:56 devstack sudo[91449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-99f72696-ca9a-441e-9fee-f97002f0ca31.info
Apr 28 22:13:56 devstack sudo[91449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:13:57 devstack sudo[91449]: pam_unix(sudo:session): session closed for user root
Apr 28 22:13:57 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-ba8e210d-3c1b-4610-a949-6a1467e33f8b tempest-VolumesSnapshotTestJSON-845556625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-99f72696-ca9a-441e-9fee-f97002f0ca31.info" returned: 0 in 0.577s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:13:57 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-ba8e210d-3c1b-4610-a949-6a1467e33f8b tempest-VolumesSnapshotTestJSON-845556625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.993s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:13:57 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-50df055e-6e7e-491c-a446-fed7430a6973 tempest-VolumesDeleteCascade-344788728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.889s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:13:57 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-50df055e-6e7e-491c-a446-fed7430a6973 tempest-VolumesDeleteCascade-344788728 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:13:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-656047121',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6064c2a6-33b0-436d-a1af-17b66b258bb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07ec76fb287340bdaefa189ee009b506',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:13:55Z,use_quota=True,user_id='1b65c92297354fb38aef4cce0104c325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:13:57 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-50df055e-6e7e-491c-a446-fed7430a6973 tempest-VolumesDeleteCascade-344788728 None] Creating volume 6064c2a6-33b0-436d-a1af-17b66b258bb2 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:13:57 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-50df055e-6e7e-491c-a446-fed7430a6973 tempest-VolumesDeleteCascade-344788728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:13:57 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-50df055e-6e7e-491c-a446-fed7430a6973 tempest-VolumesDeleteCascade-344788728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:13:57 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-50df055e-6e7e-491c-a446-fed7430a6973 tempest-VolumesDeleteCascade-344788728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:13:57 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-50df055e-6e7e-491c-a446-fed7430a6973 tempest-VolumesDeleteCascade-344788728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:13:57 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-50df055e-6e7e-491c-a446-fed7430a6973 tempest-VolumesDeleteCascade-344788728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:13:57 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-50df055e-6e7e-491c-a446-fed7430a6973 tempest-VolumesDeleteCascade-344788728 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:13:57 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-50df055e-6e7e-491c-a446-fed7430a6973 tempest-VolumesDeleteCascade-344788728 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:13:57 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-50df055e-6e7e-491c-a446-fed7430a6973 tempest-VolumesDeleteCascade-344788728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:13:57 devstack sudo[91452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2 1073741824
Apr 28 22:13:57 devstack sudo[91452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:13:57 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-ba8e210d-3c1b-4610-a949-6a1467e33f8b tempest-VolumesSnapshotTestJSON-845556625 None] Create snapshot completed successfully
Apr 28 22:13:58 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-48a84e34-ba2d-4dcc-999d-060e3999c20c tempest-VolumesSnapshotTestJSON-845556625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:13:58 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-48a84e34-ba2d-4dcc-999d-060e3999c20c tempest-VolumesSnapshotTestJSON-845556625 None] Flow 'volume_create_manager' (41fca3b9-8fb9-4498-9134-9cd2f7da05fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:13:58 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-48a84e34-ba2d-4dcc-999d-060e3999c20c tempest-VolumesSnapshotTestJSON-845556625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f61dd59b-6ae7-460d-b02a-90208be6ba6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:13:58 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-48a84e34-ba2d-4dcc-999d-060e3999c20c tempest-VolumesSnapshotTestJSON-845556625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f61dd59b-6ae7-460d-b02a-90208be6ba6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1073100746',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64f16460-4321-4d11-a585-15f80729dda8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='943f06ac94cc45fd8931aec9663110b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:13:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=1f95d121-1a7d-4efa-987e-9423b54c67ba,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:13:58Z,use_quota=True,user_id='4fa9b35ee1914787baad9599186a3f4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:13:58 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-48a84e34-ba2d-4dcc-999d-060e3999c20c tempest-VolumesSnapshotTestJSON-845556625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1848c2f2-c50b-401a-a78b-8335639416e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:13:58 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-48a84e34-ba2d-4dcc-999d-060e3999c20c tempest-VolumesSnapshotTestJSON-845556625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1848c2f2-c50b-401a-a78b-8335639416e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:13:58 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-48a84e34-ba2d-4dcc-999d-060e3999c20c tempest-VolumesSnapshotTestJSON-845556625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe5f6d4d-d284-4921-806b-7d196328d276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:13:58 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-48a84e34-ba2d-4dcc-999d-060e3999c20c tempest-VolumesSnapshotTestJSON-845556625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe5f6d4d-d284-4921-806b-7d196328d276) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '64f16460-4321-4d11-a585-15f80729dda8', 'volume_name': 'volume-64f16460-4321-4d11-a585-15f80729dda8', 'volume_size': 2, 'snapshot_id': '1f95d121-1a7d-4efa-987e-9423b54c67ba'}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:13:58 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-48a84e34-ba2d-4dcc-999d-060e3999c20c tempest-VolumesSnapshotTestJSON-845556625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80b78d14-cdce-43c3-b6bb-732f62e1acc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:13:58 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-48a84e34-ba2d-4dcc-999d-060e3999c20c tempest-VolumesSnapshotTestJSON-845556625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80b78d14-cdce-43c3-b6bb-732f62e1acc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:13:58 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-48a84e34-ba2d-4dcc-999d-060e3999c20c tempest-VolumesSnapshotTestJSON-845556625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4ab842b-e2b8-4c17-9816-633574f89ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:13:58 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-48a84e34-ba2d-4dcc-999d-060e3999c20c tempest-VolumesSnapshotTestJSON-845556625 None] Volume 64f16460-4321-4d11-a585-15f80729dda8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-64f16460-4321-4d11-a585-15f80729dda8', 'volume_size': 2, 'snapshot_id': '1f95d121-1a7d-4efa-987e-9423b54c67ba'}
Apr 28 22:13:58 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-48a84e34-ba2d-4dcc-999d-060e3999c20c tempest-VolumesSnapshotTestJSON-845556625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:13:58 devstack sudo[91452]: pam_unix(sudo:session): session closed for user root
Apr 28 22:13:58 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-50df055e-6e7e-491c-a446-fed7430a6973 tempest-VolumesDeleteCascade-344788728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2 1073741824" returned: 0 in 0.874s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:13:58 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-50df055e-6e7e-491c-a446-fed7430a6973 tempest-VolumesDeleteCascade-344788728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:13:58 devstack sudo[91457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2
Apr 28 22:13:58 devstack sudo[91457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:13:58 devstack sudo[91457]: pam_unix(sudo:session): session closed for user root
Apr 28 22:13:58 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-50df055e-6e7e-491c-a446-fed7430a6973 tempest-VolumesDeleteCascade-344788728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2" returned: 0 in 0.592s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:13:58 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-50df055e-6e7e-491c-a446-fed7430a6973 tempest-VolumesDeleteCascade-344788728 None] <== create_volume: return (1501ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:13:58 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-50df055e-6e7e-491c-a446-fed7430a6973 tempest-VolumesDeleteCascade-344788728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.504s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:13:58 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-48a84e34-ba2d-4dcc-999d-060e3999c20c tempest-VolumesSnapshotTestJSON-845556625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.724s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:13:58 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-48a84e34-ba2d-4dcc-999d-060e3999c20c tempest-VolumesSnapshotTestJSON-845556625 None] Acquiring lock "cinder-quobyte-1f95d121-1a7d-4efa-987e-9423b54c67ba-64f16460-4321-4d11-a585-15f80729dda8" by "_create_volume_from_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:13:58 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-50df055e-6e7e-491c-a446-fed7430a6973 tempest-VolumesDeleteCascade-344788728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12f59035-b9f0-4a5d-beab-7e36231acf7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6064c2a6-33b0-436d-a1af-17b66b258bb2', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:13:59 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-50df055e-6e7e-491c-a446-fed7430a6973 tempest-VolumesDeleteCascade-344788728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e7c2191-cd40-4218-ad5b-770af1278f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:13:59 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-48a84e34-ba2d-4dcc-999d-060e3999c20c tempest-VolumesSnapshotTestJSON-845556625 None] Lock "cinder-quobyte-1f95d121-1a7d-4efa-987e-9423b54c67ba-64f16460-4321-4d11-a585-15f80729dda8" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:13:59 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-48a84e34-ba2d-4dcc-999d-060e3999c20c tempest-VolumesSnapshotTestJSON-845556625 None] Creating volume 64f16460-4321-4d11-a585-15f80729dda8 from snapshot 1f95d121-1a7d-4efa-987e-9423b54c67ba {{(pid=83924) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 28 22:13:59 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-48a84e34-ba2d-4dcc-999d-060e3999c20c tempest-VolumesSnapshotTestJSON-845556625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:13:59 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-48a84e34-ba2d-4dcc-999d-060e3999c20c tempest-VolumesSnapshotTestJSON-845556625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:13:59 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-48a84e34-ba2d-4dcc-999d-060e3999c20c tempest-VolumesSnapshotTestJSON-845556625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:13:59 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-48a84e34-ba2d-4dcc-999d-060e3999c20c tempest-VolumesSnapshotTestJSON-845556625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:13:59 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-48a84e34-ba2d-4dcc-999d-060e3999c20c tempest-VolumesSnapshotTestJSON-845556625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:13:59 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-48a84e34-ba2d-4dcc-999d-060e3999c20c tempest-VolumesSnapshotTestJSON-845556625 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:13:59 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-48a84e34-ba2d-4dcc-999d-060e3999c20c tempest-VolumesSnapshotTestJSON-845556625 None] Acquiring lock "cinder-quobyte-64f16460-4321-4d11-a585-15f80729dda8" by "_copy_volume_from_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:13:59 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-50df055e-6e7e-491c-a446-fed7430a6973 tempest-VolumesDeleteCascade-344788728 None] Volume volume-6064c2a6-33b0-436d-a1af-17b66b258bb2 (6064c2a6-33b0-436d-a1af-17b66b258bb2): created successfully
Apr 28 22:13:59 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-50df055e-6e7e-491c-a446-fed7430a6973 tempest-VolumesDeleteCascade-344788728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e7c2191-cd40-4218-ad5b-770af1278f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:13:59 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-50df055e-6e7e-491c-a446-fed7430a6973 tempest-VolumesDeleteCascade-344788728 None] Flow 'volume_create_manager' (1ec605ef-4e43-4723-a5d5-f19d47fdb0bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:13:59 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-48a84e34-ba2d-4dcc-999d-060e3999c20c tempest-VolumesSnapshotTestJSON-845556625 None] Lock "cinder-quobyte-64f16460-4321-4d11-a585-15f80729dda8" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:13:59 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-48a84e34-ba2d-4dcc-999d-060e3999c20c tempest-VolumesSnapshotTestJSON-845556625 None] snapshot: 1f95d121-1a7d-4efa-987e-9423b54c67ba, volume: 64f16460-4321-4d11-a585-15f80729dda8,  {{(pid=83924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 28 22:13:59 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-50df055e-6e7e-491c-a446-fed7430a6973 tempest-VolumesDeleteCascade-344788728 None] Created volume successfully.
Apr 28 22:13:59 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-48a84e34-ba2d-4dcc-999d-060e3999c20c tempest-VolumesSnapshotTestJSON-845556625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:13:59 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-48a84e34-ba2d-4dcc-999d-060e3999c20c tempest-VolumesSnapshotTestJSON-845556625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:13:59 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-48a84e34-ba2d-4dcc-999d-060e3999c20c tempest-VolumesSnapshotTestJSON-845556625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:13:59 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-48a84e34-ba2d-4dcc-999d-060e3999c20c tempest-VolumesSnapshotTestJSON-845556625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:13:59 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-48a84e34-ba2d-4dcc-999d-060e3999c20c tempest-VolumesSnapshotTestJSON-845556625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:13:59 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9e90b8-b026-45f3-944e-efccd529aa14]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:13:59 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-48a84e34-ba2d-4dcc-999d-060e3999c20c tempest-VolumesSnapshotTestJSON-845556625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-99f72696-ca9a-441e-9fee-f97002f0ca31.1f95d121-1a7d-4efa-987e-9423b54c67ba {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:13:59 devstack sudo[91460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-99f72696-ca9a-441e-9fee-f97002f0ca31.1f95d121-1a7d-4efa-987e-9423b54c67ba
Apr 28 22:13:59 devstack sudo[91460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:13:59 devstack sudo[91460]: pam_unix(sudo:session): session closed for user root
Apr 28 22:13:59 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-48a84e34-ba2d-4dcc-999d-060e3999c20c tempest-VolumesSnapshotTestJSON-845556625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-99f72696-ca9a-441e-9fee-f97002f0ca31.1f95d121-1a7d-4efa-987e-9423b54c67ba" returned: 0 in 0.730s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:13:59 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-48a84e34-ba2d-4dcc-999d-060e3999c20c tempest-VolumesSnapshotTestJSON-845556625 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99f72696-ca9a-441e-9fee-f97002f0ca31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 22:13:59 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-48a84e34-ba2d-4dcc-999d-060e3999c20c tempest-VolumesSnapshotTestJSON-845556625 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-99f72696-ca9a-441e-9fee-f97002f0ca31 {{(pid=83924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 28 22:13:59 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-48a84e34-ba2d-4dcc-999d-060e3999c20c tempest-VolumesSnapshotTestJSON-845556625 None] Creating direct copy from snapshot {{(pid=83924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 28 22:13:59 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a4fa35-c72c-427a-a6e6-77ab082acf9e]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:13:59 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-48a84e34-ba2d-4dcc-999d-060e3999c20c tempest-VolumesSnapshotTestJSON-845556625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-99f72696-ca9a-441e-9fee-f97002f0ca31 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:13:59 devstack sudo[91465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-99f72696-ca9a-441e-9fee-f97002f0ca31
Apr 28 22:13:59 devstack sudo[91465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:00 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-4d8db43f-c140-4098-bbe7-f0d552c82a76 tempest-VolumesDeleteCascade-344788728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:14:00 devstack sudo[91465]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:00 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-48a84e34-ba2d-4dcc-999d-060e3999c20c tempest-VolumesSnapshotTestJSON-845556625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-99f72696-ca9a-441e-9fee-f97002f0ca31" returned: 0 in 0.815s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:00 devstack cinder-volume[83924]: DEBUG cinder.utils [None req-48a84e34-ba2d-4dcc-999d-060e3999c20c tempest-VolumesSnapshotTestJSON-845556625 None] Path /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-64f16460-4321-4d11-a585-15f80729dda8 not found in is_blk_device check {{(pid=83924) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 28 22:14:00 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-48a84e34-ba2d-4dcc-999d-060e3999c20c tempest-VolumesSnapshotTestJSON-845556625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-99f72696-ca9a-441e-9fee-f97002f0ca31 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-64f16460-4321-4d11-a585-15f80729dda8 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:00 devstack sudo[91470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-99f72696-ca9a-441e-9fee-f97002f0ca31 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-64f16460-4321-4d11-a585-15f80729dda8
Apr 28 22:14:00 devstack sudo[91470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:05 devstack sudo[91470]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:05 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-48a84e34-ba2d-4dcc-999d-060e3999c20c tempest-VolumesSnapshotTestJSON-845556625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-99f72696-ca9a-441e-9fee-f97002f0ca31 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-64f16460-4321-4d11-a585-15f80729dda8" returned: 0 in 4.384s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:05 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11ac033-e421-4305-8358-472ca5df32c0]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:14:05 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-48a84e34-ba2d-4dcc-999d-060e3999c20c tempest-VolumesSnapshotTestJSON-845556625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-99f72696-ca9a-441e-9fee-f97002f0ca31 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:05 devstack sudo[91484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-99f72696-ca9a-441e-9fee-f97002f0ca31
Apr 28 22:14:05 devstack sudo[91484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:05 devstack sudo[91484]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:05 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-48a84e34-ba2d-4dcc-999d-060e3999c20c tempest-VolumesSnapshotTestJSON-845556625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-99f72696-ca9a-441e-9fee-f97002f0ca31" returned: 0 in 0.824s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:05 devstack cinder-volume[83924]: DEBUG cinder.image.image_utils [None req-48a84e34-ba2d-4dcc-999d-060e3999c20c tempest-VolumesSnapshotTestJSON-845556625 None] Image conversion details: src /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-99f72696-ca9a-441e-9fee-f97002f0ca31, size 1024.00 MB, duration 4.38 sec, destination /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-64f16460-4321-4d11-a585-15f80729dda8 {{(pid=83924) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 28 22:14:05 devstack cinder-volume[83924]: INFO cinder.image.image_utils [None req-48a84e34-ba2d-4dcc-999d-060e3999c20c tempest-VolumesSnapshotTestJSON-845556625 None] Converted 1024.00 MB image at 233.53 MB/s
Apr 28 22:14:05 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-48a84e34-ba2d-4dcc-999d-060e3999c20c tempest-VolumesSnapshotTestJSON-845556625 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-64f16460-4321-4d11-a585-15f80729dda8 is being set with open permissions: ugo+rw
Apr 28 22:14:05 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-48a84e34-ba2d-4dcc-999d-060e3999c20c tempest-VolumesSnapshotTestJSON-845556625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-64f16460-4321-4d11-a585-15f80729dda8 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:05 devstack sudo[91489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-64f16460-4321-4d11-a585-15f80729dda8
Apr 28 22:14:05 devstack sudo[91489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:06 devstack sudo[91489]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:06 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-48a84e34-ba2d-4dcc-999d-060e3999c20c tempest-VolumesSnapshotTestJSON-845556625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-64f16460-4321-4d11-a585-15f80729dda8" returned: 0 in 0.553s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:06 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-48a84e34-ba2d-4dcc-999d-060e3999c20c tempest-VolumesSnapshotTestJSON-845556625 None] Lock "cinder-quobyte-64f16460-4321-4d11-a585-15f80729dda8" released by "_copy_volume_from_snapshot" :: held 7.419s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:14:06 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-48a84e34-ba2d-4dcc-999d-060e3999c20c tempest-VolumesSnapshotTestJSON-845556625 None] Lock "cinder-quobyte-1f95d121-1a7d-4efa-987e-9423b54c67ba-64f16460-4321-4d11-a585-15f80729dda8" released by "_create_volume_from_snapshot" :: held 7.465s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:14:06 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-48a84e34-ba2d-4dcc-999d-060e3999c20c tempest-VolumesSnapshotTestJSON-845556625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.499s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:14:06 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-4d8db43f-c140-4098-bbe7-f0d552c82a76 tempest-VolumesDeleteCascade-344788728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.444s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:14:06 devstack cinder-volume[83924]: DEBUG dbcounter [-] [83924] Writing DB stats cinder:UPDATE=101,cinder:INSERT=21,cinder:DELETE=10,cinder:SELECT=84 {{(pid=83924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 28 22:14:06 devstack cinder-volume[83924]: DEBUG dbcounter [-] [83924] Writing DB stats cinder:SELECT=84,cinder:UPDATE=93,cinder:INSERT=24,cinder:DELETE=8 {{(pid=83924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 28 22:14:06 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-4d8db43f-c140-4098-bbe7-f0d552c82a76 tempest-VolumesDeleteCascade-344788728 None] Creating offline snapshot 6adfbe05-6c4a-4aa1-b91b-b7442c9eca64 of volume 6064c2a6-33b0-436d-a1af-17b66b258bb2 {{(pid=83924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 22:14:06 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-48a84e34-ba2d-4dcc-999d-060e3999c20c tempest-VolumesSnapshotTestJSON-845556625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4ab842b-e2b8-4c17-9816-633574f89ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64f16460-4321-4d11-a585-15f80729dda8', 'volume_size': 2, 'snapshot_id': '1f95d121-1a7d-4efa-987e-9423b54c67ba'}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:14:06 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-48a84e34-ba2d-4dcc-999d-060e3999c20c tempest-VolumesSnapshotTestJSON-845556625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c485cbd-2ce2-48a2-bcee-68c12dcf6080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:14:06 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9a574d-a21b-4aa1-820b-a940b560ea19]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:14:06 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4d8db43f-c140-4098-bbe7-f0d552c82a76 tempest-VolumesDeleteCascade-344788728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:06 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-48a84e34-ba2d-4dcc-999d-060e3999c20c tempest-VolumesSnapshotTestJSON-845556625 None] Volume volume-64f16460-4321-4d11-a585-15f80729dda8 (64f16460-4321-4d11-a585-15f80729dda8): created successfully
Apr 28 22:14:06 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-48a84e34-ba2d-4dcc-999d-060e3999c20c tempest-VolumesSnapshotTestJSON-845556625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c485cbd-2ce2-48a2-bcee-68c12dcf6080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:14:06 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-48a84e34-ba2d-4dcc-999d-060e3999c20c tempest-VolumesSnapshotTestJSON-845556625 None] Flow 'volume_create_manager' (41fca3b9-8fb9-4498-9134-9cd2f7da05fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:14:06 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-48a84e34-ba2d-4dcc-999d-060e3999c20c tempest-VolumesSnapshotTestJSON-845556625 None] Created volume successfully.
Apr 28 22:14:06 devstack sudo[91492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2
Apr 28 22:14:06 devstack sudo[91492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:06 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-be7ac255-e2a9-4392-bb1c-99ffa88e9119 tempest-VolumesSnapshotTestJSON-845556625 None] Acquiring lock "cinder-64f16460-4321-4d11-a585-15f80729dda8-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:14:06 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-be7ac255-e2a9-4392-bb1c-99ffa88e9119 tempest-VolumesSnapshotTestJSON-845556625 None] Lock "cinder-64f16460-4321-4d11-a585-15f80729dda8-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:14:07 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-be7ac255-e2a9-4392-bb1c-99ffa88e9119 tempest-VolumesSnapshotTestJSON-845556625 None] Acquiring lock "cinder-quobyte-64f16460-4321-4d11-a585-15f80729dda8" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:14:07 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-be7ac255-e2a9-4392-bb1c-99ffa88e9119 tempest-VolumesSnapshotTestJSON-845556625 None] Lock "cinder-quobyte-64f16460-4321-4d11-a585-15f80729dda8" acquired by "delete_volume" :: waited 0.016s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:14:07 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c5c0d81-2c1d-454d-a18e-760c63f506a4]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:14:07 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-be7ac255-e2a9-4392-bb1c-99ffa88e9119 tempest-VolumesSnapshotTestJSON-845556625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-64f16460-4321-4d11-a585-15f80729dda8 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:07 devstack sudo[91494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-64f16460-4321-4d11-a585-15f80729dda8
Apr 28 22:14:07 devstack sudo[91494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:07 devstack sudo[91492]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:07 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4d8db43f-c140-4098-bbe7-f0d552c82a76 tempest-VolumesDeleteCascade-344788728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2" returned: 0 in 0.721s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:07 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4d8db43f-c140-4098-bbe7-f0d552c82a76 tempest-VolumesDeleteCascade-344788728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2.6adfbe05-6c4a-4aa1-b91b-b7442c9eca64 1G {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:07 devstack sudo[91499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2.6adfbe05-6c4a-4aa1-b91b-b7442c9eca64 1G
Apr 28 22:14:07 devstack sudo[91499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:07 devstack sudo[91494]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:07 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-be7ac255-e2a9-4392-bb1c-99ffa88e9119 tempest-VolumesSnapshotTestJSON-845556625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-64f16460-4321-4d11-a585-15f80729dda8" returned: 0 in 0.748s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:07 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-be7ac255-e2a9-4392-bb1c-99ffa88e9119 tempest-VolumesSnapshotTestJSON-845556625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-64f16460-4321-4d11-a585-15f80729dda8 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:07 devstack sudo[91507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-64f16460-4321-4d11-a585-15f80729dda8
Apr 28 22:14:07 devstack sudo[91507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:08 devstack sudo[91499]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:08 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4d8db43f-c140-4098-bbe7-f0d552c82a76 tempest-VolumesDeleteCascade-344788728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2.6adfbe05-6c4a-4aa1-b91b-b7442c9eca64 1G" returned: 0 in 0.764s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:08 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4d8db43f-c140-4098-bbe7-f0d552c82a76 tempest-VolumesDeleteCascade-344788728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6064c2a6-33b0-436d-a1af-17b66b258bb2 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2.6adfbe05-6c4a-4aa1-b91b-b7442c9eca64 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:08 devstack sudo[91509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6064c2a6-33b0-436d-a1af-17b66b258bb2 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2.6adfbe05-6c4a-4aa1-b91b-b7442c9eca64
Apr 28 22:14:08 devstack sudo[91509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:08 devstack sudo[91507]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:08 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-be7ac255-e2a9-4392-bb1c-99ffa88e9119 tempest-VolumesSnapshotTestJSON-845556625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-64f16460-4321-4d11-a585-15f80729dda8" returned: 0 in 0.664s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:08 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-be7ac255-e2a9-4392-bb1c-99ffa88e9119 tempest-VolumesSnapshotTestJSON-845556625 None] Lock "cinder-quobyte-64f16460-4321-4d11-a585-15f80729dda8" released by "delete_volume" :: held 1.459s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:14:08 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-be7ac255-e2a9-4392-bb1c-99ffa88e9119 tempest-VolumesSnapshotTestJSON-845556625 None] Created reservations ['5ad24511-2291-46f2-843a-090644bc5c97', 'c058a48f-19c7-4b97-90fd-1938e39f1997', '8b121398-d594-418e-ab05-2ecc7e4a6aaa', '312a0cea-eea7-47f8-906d-52b3105dea30'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:14:08 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-be7ac255-e2a9-4392-bb1c-99ffa88e9119 tempest-VolumesSnapshotTestJSON-845556625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:14:08 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-be7ac255-e2a9-4392-bb1c-99ffa88e9119 tempest-VolumesSnapshotTestJSON-845556625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:14:08 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-be7ac255-e2a9-4392-bb1c-99ffa88e9119 tempest-VolumesSnapshotTestJSON-845556625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:14:08 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-be7ac255-e2a9-4392-bb1c-99ffa88e9119 tempest-VolumesSnapshotTestJSON-845556625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:14:08 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-be7ac255-e2a9-4392-bb1c-99ffa88e9119 tempest-VolumesSnapshotTestJSON-845556625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:14:08 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-be7ac255-e2a9-4392-bb1c-99ffa88e9119 tempest-VolumesSnapshotTestJSON-845556625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:08 devstack sudo[91515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:14:08 devstack sudo[91515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:08 devstack sudo[91509]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:08 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4d8db43f-c140-4098-bbe7-f0d552c82a76 tempest-VolumesDeleteCascade-344788728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6064c2a6-33b0-436d-a1af-17b66b258bb2 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2.6adfbe05-6c4a-4aa1-b91b-b7442c9eca64" returned: 0 in 0.704s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:08 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-4d8db43f-c140-4098-bbe7-f0d552c82a76 tempest-VolumesDeleteCascade-344788728 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2.6adfbe05-6c4a-4aa1-b91b-b7442c9eca64 is being set with open permissions: ugo+rw
Apr 28 22:14:08 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4d8db43f-c140-4098-bbe7-f0d552c82a76 tempest-VolumesDeleteCascade-344788728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2.6adfbe05-6c4a-4aa1-b91b-b7442c9eca64 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:08 devstack sudo[91517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2.6adfbe05-6c4a-4aa1-b91b-b7442c9eca64
Apr 28 22:14:08 devstack sudo[91517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:09 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-a444b3e3-22a4-4bb6-985f-b5878f176dea tempest-VolumesSnapshotTestJSON-845556625 None] Acquiring lock "cinder-1f95d121-1a7d-4efa-987e-9423b54c67ba-delete_snapshot" by "delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:14:09 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-a444b3e3-22a4-4bb6-985f-b5878f176dea tempest-VolumesSnapshotTestJSON-845556625 None] Lock "cinder-1f95d121-1a7d-4efa-987e-9423b54c67ba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:14:09 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-a444b3e3-22a4-4bb6-985f-b5878f176dea tempest-VolumesSnapshotTestJSON-845556625 None] Acquiring lock "cinder-quobyte-99f72696-ca9a-441e-9fee-f97002f0ca31" by "delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:14:09 devstack sudo[91515]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:09 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-be7ac255-e2a9-4392-bb1c-99ffa88e9119 tempest-VolumesSnapshotTestJSON-845556625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.662s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:09 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-be7ac255-e2a9-4392-bb1c-99ffa88e9119 tempest-VolumesSnapshotTestJSON-845556625 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:14:09 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-be7ac255-e2a9-4392-bb1c-99ffa88e9119 tempest-VolumesSnapshotTestJSON-845556625 None] Deleted volume successfully.
Apr 28 22:14:09 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-a444b3e3-22a4-4bb6-985f-b5878f176dea tempest-VolumesSnapshotTestJSON-845556625 None] Lock "cinder-quobyte-99f72696-ca9a-441e-9fee-f97002f0ca31" acquired by "delete_snapshot" :: waited 0.023s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:14:09 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-a444b3e3-22a4-4bb6-985f-b5878f176dea tempest-VolumesSnapshotTestJSON-845556625 None] Acquiring lock "cinder-quobyte-1f95d121-1a7d-4efa-987e-9423b54c67ba" by "_delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:14:09 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-be7ac255-e2a9-4392-bb1c-99ffa88e9119 tempest-VolumesSnapshotTestJSON-845556625 None] Lock "cinder-64f16460-4321-4d11-a585-15f80729dda8-delete_volume" released by "delete_volume" :: held 2.341s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:14:09 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-a444b3e3-22a4-4bb6-985f-b5878f176dea tempest-VolumesSnapshotTestJSON-845556625 None] Lock "cinder-quobyte-1f95d121-1a7d-4efa-987e-9423b54c67ba" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:14:09 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-a444b3e3-22a4-4bb6-985f-b5878f176dea tempest-VolumesSnapshotTestJSON-845556625 None] Deleting offline snapshot 1f95d121-1a7d-4efa-987e-9423b54c67ba of volume 99f72696-ca9a-441e-9fee-f97002f0ca31 {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 22:14:09 devstack sudo[91517]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:09 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-a444b3e3-22a4-4bb6-985f-b5878f176dea tempest-VolumesSnapshotTestJSON-845556625 None] snapshot_file for this snap is: volume-99f72696-ca9a-441e-9fee-f97002f0ca31.1f95d121-1a7d-4efa-987e-9423b54c67ba {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 22:14:09 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4d8db43f-c140-4098-bbe7-f0d552c82a76 tempest-VolumesDeleteCascade-344788728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2.6adfbe05-6c4a-4aa1-b91b-b7442c9eca64" returned: 0 in 0.614s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:09 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[049912fd-4130-4e1a-9404-4ce8c710fee6]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:14:09 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a444b3e3-22a4-4bb6-985f-b5878f176dea tempest-VolumesSnapshotTestJSON-845556625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-99f72696-ca9a-441e-9fee-f97002f0ca31.1f95d121-1a7d-4efa-987e-9423b54c67ba {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:09 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4d8db43f-c140-4098-bbe7-f0d552c82a76 tempest-VolumesDeleteCascade-344788728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2.info {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:09 devstack sudo[91522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2.info
Apr 28 22:14:09 devstack sudo[91522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:09 devstack sudo[91521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-99f72696-ca9a-441e-9fee-f97002f0ca31.1f95d121-1a7d-4efa-987e-9423b54c67ba
Apr 28 22:14:09 devstack sudo[91521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:09 devstack sudo[91522]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:09 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4d8db43f-c140-4098-bbe7-f0d552c82a76 tempest-VolumesDeleteCascade-344788728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2.info" returned: 0 in 0.598s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:09 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-4d8db43f-c140-4098-bbe7-f0d552c82a76 tempest-VolumesDeleteCascade-344788728 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2.info is being set with open permissions: ugo+rw
Apr 28 22:14:09 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4d8db43f-c140-4098-bbe7-f0d552c82a76 tempest-VolumesDeleteCascade-344788728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2.info {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:10 devstack sudo[91529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2.info
Apr 28 22:14:10 devstack sudo[91529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:10 devstack sudo[91521]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:10 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a444b3e3-22a4-4bb6-985f-b5878f176dea tempest-VolumesSnapshotTestJSON-845556625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-99f72696-ca9a-441e-9fee-f97002f0ca31.1f95d121-1a7d-4efa-987e-9423b54c67ba" returned: 0 in 0.751s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:10 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-a444b3e3-22a4-4bb6-985f-b5878f176dea tempest-VolumesSnapshotTestJSON-845556625 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99f72696-ca9a-441e-9fee-f97002f0ca31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 22:14:10 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc2e012-4159-4b6b-b640-b53b913ea55f]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:14:10 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a444b3e3-22a4-4bb6-985f-b5878f176dea tempest-VolumesSnapshotTestJSON-845556625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-99f72696-ca9a-441e-9fee-f97002f0ca31 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:10 devstack sudo[91531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-99f72696-ca9a-441e-9fee-f97002f0ca31
Apr 28 22:14:10 devstack sudo[91531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:10 devstack sudo[91529]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:10 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4d8db43f-c140-4098-bbe7-f0d552c82a76 tempest-VolumesDeleteCascade-344788728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2.info" returned: 0 in 0.584s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:10 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-4d8db43f-c140-4098-bbe7-f0d552c82a76 tempest-VolumesDeleteCascade-344788728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.118s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:14:10 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-4d8db43f-c140-4098-bbe7-f0d552c82a76 tempest-VolumesDeleteCascade-344788728 None] Create snapshot completed successfully
Apr 28 22:14:10 devstack sudo[91531]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:10 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a444b3e3-22a4-4bb6-985f-b5878f176dea tempest-VolumesSnapshotTestJSON-845556625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-99f72696-ca9a-441e-9fee-f97002f0ca31" returned: 0 in 0.713s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:10 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a444b3e3-22a4-4bb6-985f-b5878f176dea tempest-VolumesSnapshotTestJSON-845556625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-99f72696-ca9a-441e-9fee-f97002f0ca31.1f95d121-1a7d-4efa-987e-9423b54c67ba {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:10 devstack sudo[91537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-99f72696-ca9a-441e-9fee-f97002f0ca31.1f95d121-1a7d-4efa-987e-9423b54c67ba
Apr 28 22:14:10 devstack sudo[91537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:11 devstack sudo[91537]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:11 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a444b3e3-22a4-4bb6-985f-b5878f176dea tempest-VolumesSnapshotTestJSON-845556625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-99f72696-ca9a-441e-9fee-f97002f0ca31.1f95d121-1a7d-4efa-987e-9423b54c67ba" returned: 0 in 0.658s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:11 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a444b3e3-22a4-4bb6-985f-b5878f176dea tempest-VolumesSnapshotTestJSON-845556625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-99f72696-ca9a-441e-9fee-f97002f0ca31.1f95d121-1a7d-4efa-987e-9423b54c67ba {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:11 devstack sudo[91542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-99f72696-ca9a-441e-9fee-f97002f0ca31.1f95d121-1a7d-4efa-987e-9423b54c67ba
Apr 28 22:14:11 devstack sudo[91542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:11 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-9f379268-3ce2-416e-bf97-4f01027f2757 tempest-VolumesDeleteCascade-344788728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:14:11 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-9f379268-3ce2-416e-bf97-4f01027f2757 tempest-VolumesDeleteCascade-344788728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:14:11 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-9f379268-3ce2-416e-bf97-4f01027f2757 tempest-VolumesDeleteCascade-344788728 None] Creating offline snapshot c5d03637-c28b-4ded-a0b3-57ac1f11e3eb of volume 6064c2a6-33b0-436d-a1af-17b66b258bb2 {{(pid=83924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 22:14:11 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[1543e2b5-5786-4479-859c-84be49bff9d4]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:14:11 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-9f379268-3ce2-416e-bf97-4f01027f2757 tempest-VolumesDeleteCascade-344788728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2.6adfbe05-6c4a-4aa1-b91b-b7442c9eca64 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:11 devstack sudo[91544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2.6adfbe05-6c4a-4aa1-b91b-b7442c9eca64
Apr 28 22:14:11 devstack sudo[91544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:12 devstack sudo[91542]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:12 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a444b3e3-22a4-4bb6-985f-b5878f176dea tempest-VolumesSnapshotTestJSON-845556625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-99f72696-ca9a-441e-9fee-f97002f0ca31.1f95d121-1a7d-4efa-987e-9423b54c67ba" returned: 0 in 0.619s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:12 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-a444b3e3-22a4-4bb6-985f-b5878f176dea tempest-VolumesSnapshotTestJSON-845556625 None] Lock "cinder-quobyte-1f95d121-1a7d-4efa-987e-9423b54c67ba" released by "_delete_snapshot" :: held 2.847s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:14:12 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-a444b3e3-22a4-4bb6-985f-b5878f176dea tempest-VolumesSnapshotTestJSON-845556625 None] Lock "cinder-quobyte-99f72696-ca9a-441e-9fee-f97002f0ca31" released by "delete_snapshot" :: held 2.878s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:14:12 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-a444b3e3-22a4-4bb6-985f-b5878f176dea tempest-VolumesSnapshotTestJSON-845556625 None] Created reservations ['2be36bf7-984b-4ea4-88cf-92ce7a77d4e7', '6b9941cf-b25f-4238-b5a6-7a20e8873bf8', 'd5c4488c-b47c-464d-a360-0cdfb3405b57', '09039d9a-3473-4f00-a36d-1de7ec69a9f9'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:14:12 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-a444b3e3-22a4-4bb6-985f-b5878f176dea tempest-VolumesSnapshotTestJSON-845556625 None] Delete snapshot completed successfully.
Apr 28 22:14:12 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-a444b3e3-22a4-4bb6-985f-b5878f176dea tempest-VolumesSnapshotTestJSON-845556625 None] Lock "cinder-1f95d121-1a7d-4efa-987e-9423b54c67ba-delete_snapshot" released by "delete_snapshot" :: held 3.024s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:14:12 devstack sudo[91544]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:12 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-9f379268-3ce2-416e-bf97-4f01027f2757 tempest-VolumesDeleteCascade-344788728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2.6adfbe05-6c4a-4aa1-b91b-b7442c9eca64" returned: 0 in 0.703s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:12 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-9f379268-3ce2-416e-bf97-4f01027f2757 tempest-VolumesDeleteCascade-344788728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6064c2a6-33b0-436d-a1af-17b66b258bb2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 22:14:12 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-9f379268-3ce2-416e-bf97-4f01027f2757 tempest-VolumesDeleteCascade-344788728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2.6adfbe05-6c4a-4aa1-b91b-b7442c9eca64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2.c5d03637-c28b-4ded-a0b3-57ac1f11e3eb 1G {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:12 devstack sudo[91551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2.6adfbe05-6c4a-4aa1-b91b-b7442c9eca64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2.c5d03637-c28b-4ded-a0b3-57ac1f11e3eb 1G
Apr 28 22:14:12 devstack sudo[91551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:12 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-97497eaf-fe86-41d5-b81d-2437a4e46b8e tempest-VolumesSnapshotTestJSON-845556625 None] Acquiring lock "cinder-99f72696-ca9a-441e-9fee-f97002f0ca31-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:14:12 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-97497eaf-fe86-41d5-b81d-2437a4e46b8e tempest-VolumesSnapshotTestJSON-845556625 None] Lock "cinder-99f72696-ca9a-441e-9fee-f97002f0ca31-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:14:12 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-97497eaf-fe86-41d5-b81d-2437a4e46b8e tempest-VolumesSnapshotTestJSON-845556625 None] Acquiring lock "cinder-quobyte-99f72696-ca9a-441e-9fee-f97002f0ca31" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:14:12 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-97497eaf-fe86-41d5-b81d-2437a4e46b8e tempest-VolumesSnapshotTestJSON-845556625 None] Lock "cinder-quobyte-99f72696-ca9a-441e-9fee-f97002f0ca31" acquired by "delete_volume" :: waited 0.021s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:14:12 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c5bf2b-990d-4d48-8153-4491ba33dc10]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:14:12 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-97497eaf-fe86-41d5-b81d-2437a4e46b8e tempest-VolumesSnapshotTestJSON-845556625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-99f72696-ca9a-441e-9fee-f97002f0ca31 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:12 devstack sudo[91553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-99f72696-ca9a-441e-9fee-f97002f0ca31
Apr 28 22:14:12 devstack sudo[91553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:13 devstack sudo[91551]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:13 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-9f379268-3ce2-416e-bf97-4f01027f2757 tempest-VolumesDeleteCascade-344788728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2.6adfbe05-6c4a-4aa1-b91b-b7442c9eca64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2.c5d03637-c28b-4ded-a0b3-57ac1f11e3eb 1G" returned: 0 in 0.841s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:13 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-9f379268-3ce2-416e-bf97-4f01027f2757 tempest-VolumesDeleteCascade-344788728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6064c2a6-33b0-436d-a1af-17b66b258bb2.6adfbe05-6c4a-4aa1-b91b-b7442c9eca64 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2.c5d03637-c28b-4ded-a0b3-57ac1f11e3eb {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:13 devstack sudo[91562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6064c2a6-33b0-436d-a1af-17b66b258bb2.6adfbe05-6c4a-4aa1-b91b-b7442c9eca64 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2.c5d03637-c28b-4ded-a0b3-57ac1f11e3eb
Apr 28 22:14:13 devstack sudo[91562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:13 devstack sudo[91553]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:13 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-97497eaf-fe86-41d5-b81d-2437a4e46b8e tempest-VolumesSnapshotTestJSON-845556625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-99f72696-ca9a-441e-9fee-f97002f0ca31" returned: 0 in 0.742s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:13 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-97497eaf-fe86-41d5-b81d-2437a4e46b8e tempest-VolumesSnapshotTestJSON-845556625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-99f72696-ca9a-441e-9fee-f97002f0ca31 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:13 devstack sudo[91564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-99f72696-ca9a-441e-9fee-f97002f0ca31
Apr 28 22:14:13 devstack sudo[91564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:13 devstack sudo[91564]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:13 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-97497eaf-fe86-41d5-b81d-2437a4e46b8e tempest-VolumesSnapshotTestJSON-845556625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-99f72696-ca9a-441e-9fee-f97002f0ca31" returned: 0 in 0.581s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:13 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-97497eaf-fe86-41d5-b81d-2437a4e46b8e tempest-VolumesSnapshotTestJSON-845556625 None] Lock "cinder-quobyte-99f72696-ca9a-441e-9fee-f97002f0ca31" released by "delete_volume" :: held 1.392s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:14:14 devstack sudo[91562]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:14 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-9f379268-3ce2-416e-bf97-4f01027f2757 tempest-VolumesDeleteCascade-344788728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6064c2a6-33b0-436d-a1af-17b66b258bb2.6adfbe05-6c4a-4aa1-b91b-b7442c9eca64 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2.c5d03637-c28b-4ded-a0b3-57ac1f11e3eb" returned: 0 in 0.712s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:14 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-9f379268-3ce2-416e-bf97-4f01027f2757 tempest-VolumesDeleteCascade-344788728 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2.c5d03637-c28b-4ded-a0b3-57ac1f11e3eb is being set with open permissions: ugo+rw
Apr 28 22:14:14 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-9f379268-3ce2-416e-bf97-4f01027f2757 tempest-VolumesDeleteCascade-344788728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2.c5d03637-c28b-4ded-a0b3-57ac1f11e3eb {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:14 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-97497eaf-fe86-41d5-b81d-2437a4e46b8e tempest-VolumesSnapshotTestJSON-845556625 None] Created reservations ['2a5beea3-ba6a-4c30-94af-8715ba6325a8', '0ff743db-72c5-42fe-82ab-dcc359f6d82b', 'e66e0c9e-b782-427d-9b30-6a5bdaed108f', '0b61863e-7a90-4f73-bff5-cd312aed77d6'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:14:14 devstack sudo[91570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2.c5d03637-c28b-4ded-a0b3-57ac1f11e3eb
Apr 28 22:14:14 devstack sudo[91570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:14 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-97497eaf-fe86-41d5-b81d-2437a4e46b8e tempest-VolumesSnapshotTestJSON-845556625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:14:14 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-97497eaf-fe86-41d5-b81d-2437a4e46b8e tempest-VolumesSnapshotTestJSON-845556625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:14:14 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-97497eaf-fe86-41d5-b81d-2437a4e46b8e tempest-VolumesSnapshotTestJSON-845556625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:14:14 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-97497eaf-fe86-41d5-b81d-2437a4e46b8e tempest-VolumesSnapshotTestJSON-845556625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:14:14 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-97497eaf-fe86-41d5-b81d-2437a4e46b8e tempest-VolumesSnapshotTestJSON-845556625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:14:14 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-97497eaf-fe86-41d5-b81d-2437a4e46b8e tempest-VolumesSnapshotTestJSON-845556625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:14 devstack sudo[91572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:14:14 devstack sudo[91572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:14 devstack sudo[91570]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:14 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-9f379268-3ce2-416e-bf97-4f01027f2757 tempest-VolumesDeleteCascade-344788728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2.c5d03637-c28b-4ded-a0b3-57ac1f11e3eb" returned: 0 in 0.592s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:14 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-9f379268-3ce2-416e-bf97-4f01027f2757 tempest-VolumesDeleteCascade-344788728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.946s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:14:14 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-9f379268-3ce2-416e-bf97-4f01027f2757 tempest-VolumesDeleteCascade-344788728 None] Create snapshot completed successfully
Apr 28 22:14:14 devstack sudo[91572]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:14 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-97497eaf-fe86-41d5-b81d-2437a4e46b8e tempest-VolumesSnapshotTestJSON-845556625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.610s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:14 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-97497eaf-fe86-41d5-b81d-2437a4e46b8e tempest-VolumesSnapshotTestJSON-845556625 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:14:14 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-97497eaf-fe86-41d5-b81d-2437a4e46b8e tempest-VolumesSnapshotTestJSON-845556625 None] Deleted volume successfully.
Apr 28 22:14:14 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-97497eaf-fe86-41d5-b81d-2437a4e46b8e tempest-VolumesSnapshotTestJSON-845556625 None] Lock "cinder-99f72696-ca9a-441e-9fee-f97002f0ca31-delete_volume" released by "delete_volume" :: held 2.228s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:14:14 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] Acquiring lock "cinder-6064c2a6-33b0-436d-a1af-17b66b258bb2-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:14:14 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] Lock "cinder-6064c2a6-33b0-436d-a1af-17b66b258bb2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:14:14 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] Performing cascade delete. {{(pid=83924) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 28 22:14:14 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] Acquiring lock "cinder-6adfbe05-6c4a-4aa1-b91b-b7442c9eca64-delete_snapshot" by "delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:14:14 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] Lock "cinder-6adfbe05-6c4a-4aa1-b91b-b7442c9eca64-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:14:14 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] Acquiring lock "cinder-quobyte-6064c2a6-33b0-436d-a1af-17b66b258bb2" by "delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:14:15 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] Lock "cinder-quobyte-6064c2a6-33b0-436d-a1af-17b66b258bb2" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:14:15 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] Acquiring lock "cinder-quobyte-6adfbe05-6c4a-4aa1-b91b-b7442c9eca64" by "_delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:14:15 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] Lock "cinder-quobyte-6adfbe05-6c4a-4aa1-b91b-b7442c9eca64" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:14:15 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] Deleting offline snapshot 6adfbe05-6c4a-4aa1-b91b-b7442c9eca64 of volume 6064c2a6-33b0-436d-a1af-17b66b258bb2 {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 22:14:15 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] snapshot_file for this snap is: volume-6064c2a6-33b0-436d-a1af-17b66b258bb2.6adfbe05-6c4a-4aa1-b91b-b7442c9eca64 {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 22:14:15 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e10cfd-f96d-4996-b621-f3af0ed89e25]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:14:15 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2.6adfbe05-6c4a-4aa1-b91b-b7442c9eca64 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:15 devstack sudo[91576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2.6adfbe05-6c4a-4aa1-b91b-b7442c9eca64
Apr 28 22:14:15 devstack sudo[91576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:15 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c0699dc-37cf-4c94-865c-0d5274afe8ed tempest-VolumesSnapshotTestJSON-845556625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:14:15 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-0c0699dc-37cf-4c94-865c-0d5274afe8ed tempest-VolumesSnapshotTestJSON-845556625 None] Flow 'volume_create_manager' (50db40a4-af32-4660-8ea3-0985e961c164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:14:15 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-0c0699dc-37cf-4c94-865c-0d5274afe8ed tempest-VolumesSnapshotTestJSON-845556625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e401feae-afa4-4c5b-9005-a8c1cfb6429d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:14:15 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-0c0699dc-37cf-4c94-865c-0d5274afe8ed tempest-VolumesSnapshotTestJSON-845556625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e401feae-afa4-4c5b-9005-a8c1cfb6429d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:14:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1100062386',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b35b14af-5a14-465f-ae68-2b6c740b4944,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='943f06ac94cc45fd8931aec9663110b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:14:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:14:15Z,use_quota=True,user_id='4fa9b35ee1914787baad9599186a3f4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:14:15 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-0c0699dc-37cf-4c94-865c-0d5274afe8ed tempest-VolumesSnapshotTestJSON-845556625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a563579c-7b9d-4448-9b05-30e89fc1e17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:14:15 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-0c0699dc-37cf-4c94-865c-0d5274afe8ed tempest-VolumesSnapshotTestJSON-845556625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a563579c-7b9d-4448-9b05-30e89fc1e17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:14:15 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-0c0699dc-37cf-4c94-865c-0d5274afe8ed tempest-VolumesSnapshotTestJSON-845556625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67669237-824a-4a3d-9c07-4bb8d2035fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:14:15 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-0c0699dc-37cf-4c94-865c-0d5274afe8ed tempest-VolumesSnapshotTestJSON-845556625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67669237-824a-4a3d-9c07-4bb8d2035fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b35b14af-5a14-465f-ae68-2b6c740b4944', 'volume_name': 'volume-b35b14af-5a14-465f-ae68-2b6c740b4944', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:14:15 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-0c0699dc-37cf-4c94-865c-0d5274afe8ed tempest-VolumesSnapshotTestJSON-845556625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fd08e74-f8f1-424b-88b7-697c6804a748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:14:15 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-0c0699dc-37cf-4c94-865c-0d5274afe8ed tempest-VolumesSnapshotTestJSON-845556625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fd08e74-f8f1-424b-88b7-697c6804a748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:14:15 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-0c0699dc-37cf-4c94-865c-0d5274afe8ed tempest-VolumesSnapshotTestJSON-845556625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ea70d4d-4448-4ed7-b20a-72c5d912df04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:14:15 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-0c0699dc-37cf-4c94-865c-0d5274afe8ed tempest-VolumesSnapshotTestJSON-845556625 None] Volume b35b14af-5a14-465f-ae68-2b6c740b4944: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b35b14af-5a14-465f-ae68-2b6c740b4944', 'volume_size': 1}
Apr 28 22:14:15 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-0c0699dc-37cf-4c94-865c-0d5274afe8ed tempest-VolumesSnapshotTestJSON-845556625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:14:15 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-0c0699dc-37cf-4c94-865c-0d5274afe8ed tempest-VolumesSnapshotTestJSON-845556625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:14:15 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-0c0699dc-37cf-4c94-865c-0d5274afe8ed tempest-VolumesSnapshotTestJSON-845556625 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:14:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1100062386',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b35b14af-5a14-465f-ae68-2b6c740b4944,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='943f06ac94cc45fd8931aec9663110b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:14:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:14:15Z,use_quota=True,user_id='4fa9b35ee1914787baad9599186a3f4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:14:15 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-0c0699dc-37cf-4c94-865c-0d5274afe8ed tempest-VolumesSnapshotTestJSON-845556625 None] Creating volume b35b14af-5a14-465f-ae68-2b6c740b4944 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:14:15 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-0c0699dc-37cf-4c94-865c-0d5274afe8ed tempest-VolumesSnapshotTestJSON-845556625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:14:15 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-0c0699dc-37cf-4c94-865c-0d5274afe8ed tempest-VolumesSnapshotTestJSON-845556625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:14:15 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-0c0699dc-37cf-4c94-865c-0d5274afe8ed tempest-VolumesSnapshotTestJSON-845556625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:14:15 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-0c0699dc-37cf-4c94-865c-0d5274afe8ed tempest-VolumesSnapshotTestJSON-845556625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:14:15 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-0c0699dc-37cf-4c94-865c-0d5274afe8ed tempest-VolumesSnapshotTestJSON-845556625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:14:15 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-0c0699dc-37cf-4c94-865c-0d5274afe8ed tempest-VolumesSnapshotTestJSON-845556625 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:14:15 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-0c0699dc-37cf-4c94-865c-0d5274afe8ed tempest-VolumesSnapshotTestJSON-845556625 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:14:15 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-0c0699dc-37cf-4c94-865c-0d5274afe8ed tempest-VolumesSnapshotTestJSON-845556625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b35b14af-5a14-465f-ae68-2b6c740b4944 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:15 devstack sudo[91578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b35b14af-5a14-465f-ae68-2b6c740b4944 1073741824
Apr 28 22:14:15 devstack sudo[91578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:15 devstack sudo[91576]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:15 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2.6adfbe05-6c4a-4aa1-b91b-b7442c9eca64" returned: 0 in 0.693s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:15 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6064c2a6-33b0-436d-a1af-17b66b258bb2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 22:14:15 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d93170-ca73-4bb9-9bc9-def2a1bdc0d7]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:14:15 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:15 devstack sudo[91583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2
Apr 28 22:14:15 devstack sudo[91583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:16 devstack sudo[91578]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:16 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-0c0699dc-37cf-4c94-865c-0d5274afe8ed tempest-VolumesSnapshotTestJSON-845556625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b35b14af-5a14-465f-ae68-2b6c740b4944 1073741824" returned: 0 in 0.794s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:16 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-0c0699dc-37cf-4c94-865c-0d5274afe8ed tempest-VolumesSnapshotTestJSON-845556625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b35b14af-5a14-465f-ae68-2b6c740b4944 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:16 devstack sudo[91588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b35b14af-5a14-465f-ae68-2b6c740b4944
Apr 28 22:14:16 devstack sudo[91588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:16 devstack sudo[91583]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:16 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2" returned: 0 in 0.713s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:16 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b676ce7b-c197-44f7-814b-d015a3d19c9d]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:14:16 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2.c5d03637-c28b-4ded-a0b3-57ac1f11e3eb {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:16 devstack sudo[91593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2.c5d03637-c28b-4ded-a0b3-57ac1f11e3eb
Apr 28 22:14:16 devstack sudo[91593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:16 devstack sudo[91588]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:16 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-0c0699dc-37cf-4c94-865c-0d5274afe8ed tempest-VolumesSnapshotTestJSON-845556625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b35b14af-5a14-465f-ae68-2b6c740b4944" returned: 0 in 0.610s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:16 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-0c0699dc-37cf-4c94-865c-0d5274afe8ed tempest-VolumesSnapshotTestJSON-845556625 None] <== create_volume: return (1446ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:14:16 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-0c0699dc-37cf-4c94-865c-0d5274afe8ed tempest-VolumesSnapshotTestJSON-845556625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.448s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:14:16 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-0c0699dc-37cf-4c94-865c-0d5274afe8ed tempest-VolumesSnapshotTestJSON-845556625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ea70d4d-4448-4ed7-b20a-72c5d912df04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b35b14af-5a14-465f-ae68-2b6c740b4944', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:14:16 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-0c0699dc-37cf-4c94-865c-0d5274afe8ed tempest-VolumesSnapshotTestJSON-845556625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4ab9f14-9586-4f6b-aae2-fe9e60755216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:14:16 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-0c0699dc-37cf-4c94-865c-0d5274afe8ed tempest-VolumesSnapshotTestJSON-845556625 None] Volume volume-b35b14af-5a14-465f-ae68-2b6c740b4944 (b35b14af-5a14-465f-ae68-2b6c740b4944): created successfully
Apr 28 22:14:16 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-0c0699dc-37cf-4c94-865c-0d5274afe8ed tempest-VolumesSnapshotTestJSON-845556625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4ab9f14-9586-4f6b-aae2-fe9e60755216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:14:16 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-0c0699dc-37cf-4c94-865c-0d5274afe8ed tempest-VolumesSnapshotTestJSON-845556625 None] Flow 'volume_create_manager' (50db40a4-af32-4660-8ea3-0985e961c164) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:14:16 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-0c0699dc-37cf-4c94-865c-0d5274afe8ed tempest-VolumesSnapshotTestJSON-845556625 None] Created volume successfully.
Apr 28 22:14:17 devstack sudo[91593]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:17 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2.c5d03637-c28b-4ded-a0b3-57ac1f11e3eb" returned: 0 in 0.699s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:17 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6064c2a6-33b0-436d-a1af-17b66b258bb2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 22:14:17 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[436dc09f-4107-42d8-a225-90b0f2895066]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:14:17 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2.6adfbe05-6c4a-4aa1-b91b-b7442c9eca64 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:17 devstack sudo[91599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2.6adfbe05-6c4a-4aa1-b91b-b7442c9eca64
Apr 28 22:14:17 devstack sudo[91599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:17 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-96f3e6d2-a28f-4f72-a023-a6d5de19f181 tempest-VolumesSnapshotTestJSON-845556625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:14:17 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-96f3e6d2-a28f-4f72-a023-a6d5de19f181 tempest-VolumesSnapshotTestJSON-845556625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:14:17 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-96f3e6d2-a28f-4f72-a023-a6d5de19f181 tempest-VolumesSnapshotTestJSON-845556625 None] Creating offline snapshot db435df1-a447-4dc7-bc9b-13afe7a4e469 of volume b35b14af-5a14-465f-ae68-2b6c740b4944 {{(pid=83924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 22:14:17 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2275f364-cbe1-42ef-991d-1bacd90f7d57]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:14:17 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-96f3e6d2-a28f-4f72-a023-a6d5de19f181 tempest-VolumesSnapshotTestJSON-845556625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b35b14af-5a14-465f-ae68-2b6c740b4944 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:17 devstack sudo[91601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b35b14af-5a14-465f-ae68-2b6c740b4944
Apr 28 22:14:17 devstack sudo[91601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:17 devstack sudo[91599]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:17 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2.6adfbe05-6c4a-4aa1-b91b-b7442c9eca64" returned: 0 in 0.724s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:17 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6064c2a6-33b0-436d-a1af-17b66b258bb2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 22:14:17 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9077cc18-2f09-4cd2-b78d-24c134c1a679]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:14:17 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:18 devstack sudo[91606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2
Apr 28 22:14:18 devstack sudo[91606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:18 devstack sudo[91601]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:18 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-96f3e6d2-a28f-4f72-a023-a6d5de19f181 tempest-VolumesSnapshotTestJSON-845556625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b35b14af-5a14-465f-ae68-2b6c740b4944" returned: 0 in 0.784s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:18 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-96f3e6d2-a28f-4f72-a023-a6d5de19f181 tempest-VolumesSnapshotTestJSON-845556625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b35b14af-5a14-465f-ae68-2b6c740b4944,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b35b14af-5a14-465f-ae68-2b6c740b4944.db435df1-a447-4dc7-bc9b-13afe7a4e469 1G {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:18 devstack sudo[91611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b35b14af-5a14-465f-ae68-2b6c740b4944,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b35b14af-5a14-465f-ae68-2b6c740b4944.db435df1-a447-4dc7-bc9b-13afe7a4e469 1G
Apr 28 22:14:18 devstack sudo[91611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:18 devstack sudo[91606]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:18 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2" returned: 0 in 0.698s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:18 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2.6adfbe05-6c4a-4aa1-b91b-b7442c9eca64 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:18 devstack sudo[91616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2.6adfbe05-6c4a-4aa1-b91b-b7442c9eca64
Apr 28 22:14:18 devstack sudo[91616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:19 devstack sudo[91611]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:19 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-96f3e6d2-a28f-4f72-a023-a6d5de19f181 tempest-VolumesSnapshotTestJSON-845556625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b35b14af-5a14-465f-ae68-2b6c740b4944,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b35b14af-5a14-465f-ae68-2b6c740b4944.db435df1-a447-4dc7-bc9b-13afe7a4e469 1G" returned: 0 in 0.849s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:19 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-96f3e6d2-a28f-4f72-a023-a6d5de19f181 tempest-VolumesSnapshotTestJSON-845556625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b35b14af-5a14-465f-ae68-2b6c740b4944 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b35b14af-5a14-465f-ae68-2b6c740b4944.db435df1-a447-4dc7-bc9b-13afe7a4e469 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:19 devstack sudo[91621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b35b14af-5a14-465f-ae68-2b6c740b4944 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b35b14af-5a14-465f-ae68-2b6c740b4944.db435df1-a447-4dc7-bc9b-13afe7a4e469
Apr 28 22:14:19 devstack sudo[91621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:19 devstack sudo[91616]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:19 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2.6adfbe05-6c4a-4aa1-b91b-b7442c9eca64" returned: 0 in 0.728s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:19 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2.6adfbe05-6c4a-4aa1-b91b-b7442c9eca64 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:19 devstack sudo[91627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2.6adfbe05-6c4a-4aa1-b91b-b7442c9eca64
Apr 28 22:14:19 devstack sudo[91627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:19 devstack sudo[91621]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:19 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-96f3e6d2-a28f-4f72-a023-a6d5de19f181 tempest-VolumesSnapshotTestJSON-845556625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b35b14af-5a14-465f-ae68-2b6c740b4944 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b35b14af-5a14-465f-ae68-2b6c740b4944.db435df1-a447-4dc7-bc9b-13afe7a4e469" returned: 0 in 0.701s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:19 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-96f3e6d2-a28f-4f72-a023-a6d5de19f181 tempest-VolumesSnapshotTestJSON-845556625 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b35b14af-5a14-465f-ae68-2b6c740b4944.db435df1-a447-4dc7-bc9b-13afe7a4e469 is being set with open permissions: ugo+rw
Apr 28 22:14:19 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-96f3e6d2-a28f-4f72-a023-a6d5de19f181 tempest-VolumesSnapshotTestJSON-845556625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b35b14af-5a14-465f-ae68-2b6c740b4944.db435df1-a447-4dc7-bc9b-13afe7a4e469 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:19 devstack sudo[91632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b35b14af-5a14-465f-ae68-2b6c740b4944.db435df1-a447-4dc7-bc9b-13afe7a4e469
Apr 28 22:14:19 devstack sudo[91632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:20 devstack sudo[91627]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2.6adfbe05-6c4a-4aa1-b91b-b7442c9eca64" returned: 0 in 0.620s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6064c2a6-33b0-436d-a1af-17b66b258bb2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2.c5d03637-c28b-4ded-a0b3-57ac1f11e3eb -F qcow2 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:20 devstack sudo[91635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6064c2a6-33b0-436d-a1af-17b66b258bb2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2.c5d03637-c28b-4ded-a0b3-57ac1f11e3eb -F qcow2
Apr 28 22:14:20 devstack sudo[91635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:20 devstack sudo[91632]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-96f3e6d2-a28f-4f72-a023-a6d5de19f181 tempest-VolumesSnapshotTestJSON-845556625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b35b14af-5a14-465f-ae68-2b6c740b4944.db435df1-a447-4dc7-bc9b-13afe7a4e469" returned: 0 in 0.633s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-96f3e6d2-a28f-4f72-a023-a6d5de19f181 tempest-VolumesSnapshotTestJSON-845556625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b35b14af-5a14-465f-ae68-2b6c740b4944.info {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:20 devstack sudo[91642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b35b14af-5a14-465f-ae68-2b6c740b4944.info
Apr 28 22:14:20 devstack sudo[91642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:20 devstack sudo[91635]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6064c2a6-33b0-436d-a1af-17b66b258bb2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2.c5d03637-c28b-4ded-a0b3-57ac1f11e3eb -F qcow2" returned: 0 in 0.659s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:20 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] Lock "cinder-quobyte-6adfbe05-6c4a-4aa1-b91b-b7442c9eca64" released by "_delete_snapshot" :: held 5.704s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:14:20 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] Lock "cinder-quobyte-6064c2a6-33b0-436d-a1af-17b66b258bb2" released by "delete_snapshot" :: held 5.730s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:14:20 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] Created reservations ['af39bc05-769b-42c0-8170-23fe02ec762b', '4e98ba35-fd1a-436b-ad86-513148ad2a69', '9884263e-f659-4621-9d26-3a27c53b8244', '0a2b4f05-b33e-4ca4-a036-4e55ff5d5abb'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:14:20 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] Delete snapshot completed successfully.
Apr 28 22:14:20 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] Lock "cinder-6adfbe05-6c4a-4aa1-b91b-b7442c9eca64-delete_snapshot" released by "delete_snapshot" :: held 5.881s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:14:20 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] Acquiring lock "cinder-c5d03637-c28b-4ded-a0b3-57ac1f11e3eb-delete_snapshot" by "delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:14:20 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] Lock "cinder-c5d03637-c28b-4ded-a0b3-57ac1f11e3eb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:14:20 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] Acquiring lock "cinder-quobyte-6064c2a6-33b0-436d-a1af-17b66b258bb2" by "delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:14:20 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] Lock "cinder-quobyte-6064c2a6-33b0-436d-a1af-17b66b258bb2" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:14:20 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] Acquiring lock "cinder-quobyte-c5d03637-c28b-4ded-a0b3-57ac1f11e3eb" by "_delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:14:20 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] Lock "cinder-quobyte-c5d03637-c28b-4ded-a0b3-57ac1f11e3eb" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:14:20 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] Deleting offline snapshot c5d03637-c28b-4ded-a0b3-57ac1f11e3eb of volume 6064c2a6-33b0-436d-a1af-17b66b258bb2 {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 22:14:20 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] snapshot_file for this snap is: volume-6064c2a6-33b0-436d-a1af-17b66b258bb2.c5d03637-c28b-4ded-a0b3-57ac1f11e3eb {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 22:14:20 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1c7d51-749a-44a6-b6e2-a2499944f805]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:14:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2.c5d03637-c28b-4ded-a0b3-57ac1f11e3eb {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:21 devstack sudo[91644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2.c5d03637-c28b-4ded-a0b3-57ac1f11e3eb
Apr 28 22:14:21 devstack sudo[91644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:21 devstack sudo[91642]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:21 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-96f3e6d2-a28f-4f72-a023-a6d5de19f181 tempest-VolumesSnapshotTestJSON-845556625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b35b14af-5a14-465f-ae68-2b6c740b4944.info" returned: 0 in 0.650s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:21 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-96f3e6d2-a28f-4f72-a023-a6d5de19f181 tempest-VolumesSnapshotTestJSON-845556625 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b35b14af-5a14-465f-ae68-2b6c740b4944.info is being set with open permissions: ugo+rw
Apr 28 22:14:21 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-96f3e6d2-a28f-4f72-a023-a6d5de19f181 tempest-VolumesSnapshotTestJSON-845556625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b35b14af-5a14-465f-ae68-2b6c740b4944.info {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:21 devstack sudo[91681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b35b14af-5a14-465f-ae68-2b6c740b4944.info
Apr 28 22:14:21 devstack sudo[91681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:21 devstack sudo[91644]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:21 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2.c5d03637-c28b-4ded-a0b3-57ac1f11e3eb" returned: 0 in 0.752s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:21 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6064c2a6-33b0-436d-a1af-17b66b258bb2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 22:14:21 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cad976e-d34e-40dd-9df1-c89223314e12]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:14:21 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:21 devstack sudo[91688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2
Apr 28 22:14:21 devstack sudo[91688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:21 devstack sudo[91681]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:21 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-96f3e6d2-a28f-4f72-a023-a6d5de19f181 tempest-VolumesSnapshotTestJSON-845556625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b35b14af-5a14-465f-ae68-2b6c740b4944.info" returned: 0 in 0.624s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:21 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-96f3e6d2-a28f-4f72-a023-a6d5de19f181 tempest-VolumesSnapshotTestJSON-845556625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.345s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:14:21 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-96f3e6d2-a28f-4f72-a023-a6d5de19f181 tempest-VolumesSnapshotTestJSON-845556625 None] Create snapshot completed successfully
Apr 28 22:14:22 devstack sudo[91688]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:22 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2" returned: 0 in 0.745s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:22 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2.c5d03637-c28b-4ded-a0b3-57ac1f11e3eb {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:22 devstack sudo[91694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2.c5d03637-c28b-4ded-a0b3-57ac1f11e3eb
Apr 28 22:14:22 devstack sudo[91694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:23 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f510212-ed16-4ac6-9172-b3319a7bb8d9 tempest-VolumesSnapshotTestJSON-845556625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:14:23 devstack sudo[91694]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:23 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2.c5d03637-c28b-4ded-a0b3-57ac1f11e3eb" returned: 0 in 0.782s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:23 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2.c5d03637-c28b-4ded-a0b3-57ac1f11e3eb {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:23 devstack sudo[91700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2.c5d03637-c28b-4ded-a0b3-57ac1f11e3eb
Apr 28 22:14:23 devstack sudo[91700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:23 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-4f510212-ed16-4ac6-9172-b3319a7bb8d9 tempest-VolumesSnapshotTestJSON-845556625 None] Flow 'volume_create_manager' (5850d8c4-2faa-4487-946e-288f08d31ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:14:23 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-4f510212-ed16-4ac6-9172-b3319a7bb8d9 tempest-VolumesSnapshotTestJSON-845556625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9230e55-fdfa-457d-aca2-e3d3aece6c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:14:23 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-4f510212-ed16-4ac6-9172-b3319a7bb8d9 tempest-VolumesSnapshotTestJSON-845556625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9230e55-fdfa-457d-aca2-e3d3aece6c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-335793224',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cda29583-2ba2-4841-b1dd-27abf8e48347,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='943f06ac94cc45fd8931aec9663110b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:14:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=db435df1-a447-4dc7-bc9b-13afe7a4e469,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:14:23Z,use_quota=True,user_id='4fa9b35ee1914787baad9599186a3f4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:14:23 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-4f510212-ed16-4ac6-9172-b3319a7bb8d9 tempest-VolumesSnapshotTestJSON-845556625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e16b1940-8730-4300-963a-1303a19a970b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:14:23 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-4f510212-ed16-4ac6-9172-b3319a7bb8d9 tempest-VolumesSnapshotTestJSON-845556625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e16b1940-8730-4300-963a-1303a19a970b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:14:23 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-4f510212-ed16-4ac6-9172-b3319a7bb8d9 tempest-VolumesSnapshotTestJSON-845556625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96e94d64-03b9-4c11-9081-81cb0eebc9e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:14:23 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-4f510212-ed16-4ac6-9172-b3319a7bb8d9 tempest-VolumesSnapshotTestJSON-845556625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96e94d64-03b9-4c11-9081-81cb0eebc9e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cda29583-2ba2-4841-b1dd-27abf8e48347', 'volume_name': 'volume-cda29583-2ba2-4841-b1dd-27abf8e48347', 'volume_size': 1, 'snapshot_id': 'db435df1-a447-4dc7-bc9b-13afe7a4e469'}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:14:23 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-4f510212-ed16-4ac6-9172-b3319a7bb8d9 tempest-VolumesSnapshotTestJSON-845556625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d78ab231-70fe-4aa5-a0f2-c8434f5e81d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:14:23 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-4f510212-ed16-4ac6-9172-b3319a7bb8d9 tempest-VolumesSnapshotTestJSON-845556625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d78ab231-70fe-4aa5-a0f2-c8434f5e81d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:14:23 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-4f510212-ed16-4ac6-9172-b3319a7bb8d9 tempest-VolumesSnapshotTestJSON-845556625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5fcf02b-0492-44c3-a787-628f9c077683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:14:23 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-4f510212-ed16-4ac6-9172-b3319a7bb8d9 tempest-VolumesSnapshotTestJSON-845556625 None] Volume cda29583-2ba2-4841-b1dd-27abf8e48347: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cda29583-2ba2-4841-b1dd-27abf8e48347', 'volume_size': 1, 'snapshot_id': 'db435df1-a447-4dc7-bc9b-13afe7a4e469'}
Apr 28 22:14:23 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-4f510212-ed16-4ac6-9172-b3319a7bb8d9 tempest-VolumesSnapshotTestJSON-845556625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:14:23 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-4f510212-ed16-4ac6-9172-b3319a7bb8d9 tempest-VolumesSnapshotTestJSON-845556625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:14:23 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-4f510212-ed16-4ac6-9172-b3319a7bb8d9 tempest-VolumesSnapshotTestJSON-845556625 None] Acquiring lock "cinder-quobyte-db435df1-a447-4dc7-bc9b-13afe7a4e469-cda29583-2ba2-4841-b1dd-27abf8e48347" by "_create_volume_from_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:14:23 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-4f510212-ed16-4ac6-9172-b3319a7bb8d9 tempest-VolumesSnapshotTestJSON-845556625 None] Lock "cinder-quobyte-db435df1-a447-4dc7-bc9b-13afe7a4e469-cda29583-2ba2-4841-b1dd-27abf8e48347" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:14:23 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-4f510212-ed16-4ac6-9172-b3319a7bb8d9 tempest-VolumesSnapshotTestJSON-845556625 None] Creating volume cda29583-2ba2-4841-b1dd-27abf8e48347 from snapshot db435df1-a447-4dc7-bc9b-13afe7a4e469 {{(pid=83924) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 28 22:14:23 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-4f510212-ed16-4ac6-9172-b3319a7bb8d9 tempest-VolumesSnapshotTestJSON-845556625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:14:23 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-4f510212-ed16-4ac6-9172-b3319a7bb8d9 tempest-VolumesSnapshotTestJSON-845556625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:14:23 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-4f510212-ed16-4ac6-9172-b3319a7bb8d9 tempest-VolumesSnapshotTestJSON-845556625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:14:23 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-4f510212-ed16-4ac6-9172-b3319a7bb8d9 tempest-VolumesSnapshotTestJSON-845556625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:14:23 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-4f510212-ed16-4ac6-9172-b3319a7bb8d9 tempest-VolumesSnapshotTestJSON-845556625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:14:23 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-4f510212-ed16-4ac6-9172-b3319a7bb8d9 tempest-VolumesSnapshotTestJSON-845556625 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:14:23 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-4f510212-ed16-4ac6-9172-b3319a7bb8d9 tempest-VolumesSnapshotTestJSON-845556625 None] Acquiring lock "cinder-quobyte-cda29583-2ba2-4841-b1dd-27abf8e48347" by "_copy_volume_from_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:14:23 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-4f510212-ed16-4ac6-9172-b3319a7bb8d9 tempest-VolumesSnapshotTestJSON-845556625 None] Lock "cinder-quobyte-cda29583-2ba2-4841-b1dd-27abf8e48347" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:14:23 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-4f510212-ed16-4ac6-9172-b3319a7bb8d9 tempest-VolumesSnapshotTestJSON-845556625 None] snapshot: db435df1-a447-4dc7-bc9b-13afe7a4e469, volume: cda29583-2ba2-4841-b1dd-27abf8e48347,  {{(pid=83924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 28 22:14:23 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-4f510212-ed16-4ac6-9172-b3319a7bb8d9 tempest-VolumesSnapshotTestJSON-845556625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:14:23 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-4f510212-ed16-4ac6-9172-b3319a7bb8d9 tempest-VolumesSnapshotTestJSON-845556625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:14:23 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-4f510212-ed16-4ac6-9172-b3319a7bb8d9 tempest-VolumesSnapshotTestJSON-845556625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:14:23 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-4f510212-ed16-4ac6-9172-b3319a7bb8d9 tempest-VolumesSnapshotTestJSON-845556625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:14:23 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-4f510212-ed16-4ac6-9172-b3319a7bb8d9 tempest-VolumesSnapshotTestJSON-845556625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:14:23 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d71c359-5c28-45dd-91b6-d77b73ca13a0]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:14:23 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4f510212-ed16-4ac6-9172-b3319a7bb8d9 tempest-VolumesSnapshotTestJSON-845556625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b35b14af-5a14-465f-ae68-2b6c740b4944.db435df1-a447-4dc7-bc9b-13afe7a4e469 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:23 devstack sudo[91702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b35b14af-5a14-465f-ae68-2b6c740b4944.db435df1-a447-4dc7-bc9b-13afe7a4e469
Apr 28 22:14:23 devstack sudo[91702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:23 devstack sudo[91700]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:23 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2.c5d03637-c28b-4ded-a0b3-57ac1f11e3eb" returned: 0 in 0.639s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:23 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] Lock "cinder-quobyte-c5d03637-c28b-4ded-a0b3-57ac1f11e3eb" released by "_delete_snapshot" :: held 3.008s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:14:23 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] Lock "cinder-quobyte-6064c2a6-33b0-436d-a1af-17b66b258bb2" released by "delete_snapshot" :: held 3.032s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:14:23 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] Created reservations ['2769979e-b568-4278-8c49-764ae3628372', '80dc77a1-8376-4793-81ee-bacc5a2b5f66', '90a079d1-2044-440a-a0ac-093ed40a0e07', '1c6737d3-1472-469f-8735-2d6683406278'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:14:24 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] Delete snapshot completed successfully.
Apr 28 22:14:24 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] Lock "cinder-c5d03637-c28b-4ded-a0b3-57ac1f11e3eb-delete_snapshot" released by "delete_snapshot" :: held 3.178s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:14:24 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] Snapshots deleted, issuing volume delete {{(pid=83924) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 28 22:14:24 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] Acquiring lock "cinder-quobyte-6064c2a6-33b0-436d-a1af-17b66b258bb2" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:14:24 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] Lock "cinder-quobyte-6064c2a6-33b0-436d-a1af-17b66b258bb2" acquired by "delete_volume" :: waited 0.016s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:14:24 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[614936f2-58ca-4d02-a96c-373c14215a00]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:14:24 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:24 devstack sudo[91702]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:24 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4f510212-ed16-4ac6-9172-b3319a7bb8d9 tempest-VolumesSnapshotTestJSON-845556625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b35b14af-5a14-465f-ae68-2b6c740b4944.db435df1-a447-4dc7-bc9b-13afe7a4e469" returned: 0 in 0.765s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:24 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-4f510212-ed16-4ac6-9172-b3319a7bb8d9 tempest-VolumesSnapshotTestJSON-845556625 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b35b14af-5a14-465f-ae68-2b6c740b4944(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 22:14:24 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-4f510212-ed16-4ac6-9172-b3319a7bb8d9 tempest-VolumesSnapshotTestJSON-845556625 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b35b14af-5a14-465f-ae68-2b6c740b4944 {{(pid=83924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 28 22:14:24 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-4f510212-ed16-4ac6-9172-b3319a7bb8d9 tempest-VolumesSnapshotTestJSON-845556625 None] Creating direct copy from snapshot {{(pid=83924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 28 22:14:24 devstack sudo[91708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2
Apr 28 22:14:24 devstack sudo[91708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:24 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2204d53-c413-41ac-99db-a89090b4de78]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:14:24 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4f510212-ed16-4ac6-9172-b3319a7bb8d9 tempest-VolumesSnapshotTestJSON-845556625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b35b14af-5a14-465f-ae68-2b6c740b4944 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:24 devstack sudo[91710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b35b14af-5a14-465f-ae68-2b6c740b4944
Apr 28 22:14:24 devstack sudo[91710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:24 devstack sudo[91708]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:24 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2" returned: 0 in 0.731s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:24 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:24 devstack sudo[91715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2
Apr 28 22:14:24 devstack sudo[91715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:25 devstack sudo[91710]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:25 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4f510212-ed16-4ac6-9172-b3319a7bb8d9 tempest-VolumesSnapshotTestJSON-845556625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b35b14af-5a14-465f-ae68-2b6c740b4944" returned: 0 in 0.787s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:25 devstack cinder-volume[83924]: DEBUG cinder.utils [None req-4f510212-ed16-4ac6-9172-b3319a7bb8d9 tempest-VolumesSnapshotTestJSON-845556625 None] Path /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cda29583-2ba2-4841-b1dd-27abf8e48347 not found in is_blk_device check {{(pid=83924) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 28 22:14:25 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4f510212-ed16-4ac6-9172-b3319a7bb8d9 tempest-VolumesSnapshotTestJSON-845556625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b35b14af-5a14-465f-ae68-2b6c740b4944 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cda29583-2ba2-4841-b1dd-27abf8e48347 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:25 devstack sudo[91720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b35b14af-5a14-465f-ae68-2b6c740b4944 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cda29583-2ba2-4841-b1dd-27abf8e48347
Apr 28 22:14:25 devstack sudo[91720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:25 devstack sudo[91715]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:25 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6064c2a6-33b0-436d-a1af-17b66b258bb2" returned: 0 in 0.644s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:25 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] Lock "cinder-quobyte-6064c2a6-33b0-436d-a1af-17b66b258bb2" released by "delete_volume" :: held 1.454s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:14:25 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] Created reservations ['12f00832-d21b-4833-8471-a63d8d2a5c6c', '3b9c539f-ec71-43ec-ae07-c42e1073afd8', '4150e13a-bf32-4714-b13c-5d1f0d8ee61b', 'b6aba51e-2c47-465b-a372-fdb564ddf876'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:14:25 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:14:25 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:14:25 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:14:25 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:14:25 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:14:25 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:25 devstack sudo[91733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:14:25 devstack sudo[91733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:26 devstack sudo[91733]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:26 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 1.024s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:26 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:14:26 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] Deleted volume successfully.
Apr 28 22:14:26 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-d8654608-ef87-4c61-bc6d-646a806b79f7 tempest-VolumesDeleteCascade-344788728 None] Lock "cinder-6064c2a6-33b0-436d-a1af-17b66b258bb2-delete_volume" released by "delete_volume" :: held 11.881s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:14:26 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-a04a1450-6504-4deb-8aca-b49ae18b9709 tempest-VolumesDeleteCascade-344788728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:14:27 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a04a1450-6504-4deb-8aca-b49ae18b9709 tempest-VolumesDeleteCascade-344788728 None] Flow 'volume_create_manager' (d69f7d9e-c6d6-4f78-8c04-bed4a75f347a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:14:27 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a04a1450-6504-4deb-8aca-b49ae18b9709 tempest-VolumesDeleteCascade-344788728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71b8c976-968a-4528-aa71-68bc08611311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:14:27 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a04a1450-6504-4deb-8aca-b49ae18b9709 tempest-VolumesDeleteCascade-344788728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71b8c976-968a-4528-aa71-68bc08611311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:14:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-698555998',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b212440b-29ab-46c7-9de4-1b634388d951,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07ec76fb287340bdaefa189ee009b506',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:14:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:14:27Z,use_quota=True,user_id='1b65c92297354fb38aef4cce0104c325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:14:27 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a04a1450-6504-4deb-8aca-b49ae18b9709 tempest-VolumesDeleteCascade-344788728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7abd8ca-cd2c-49c5-8f6e-125a74664e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:14:27 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a04a1450-6504-4deb-8aca-b49ae18b9709 tempest-VolumesDeleteCascade-344788728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7abd8ca-cd2c-49c5-8f6e-125a74664e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:14:27 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a04a1450-6504-4deb-8aca-b49ae18b9709 tempest-VolumesDeleteCascade-344788728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44992e87-2c1d-40d9-8f31-144a03408241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:14:27 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a04a1450-6504-4deb-8aca-b49ae18b9709 tempest-VolumesDeleteCascade-344788728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44992e87-2c1d-40d9-8f31-144a03408241) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b212440b-29ab-46c7-9de4-1b634388d951', 'volume_name': 'volume-b212440b-29ab-46c7-9de4-1b634388d951', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:14:27 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a04a1450-6504-4deb-8aca-b49ae18b9709 tempest-VolumesDeleteCascade-344788728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44e1fd75-2c6d-40db-b824-044278af1a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:14:27 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a04a1450-6504-4deb-8aca-b49ae18b9709 tempest-VolumesDeleteCascade-344788728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44e1fd75-2c6d-40db-b824-044278af1a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:14:27 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a04a1450-6504-4deb-8aca-b49ae18b9709 tempest-VolumesDeleteCascade-344788728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a735f601-958a-46e0-86c7-a66f7171b6c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:14:27 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-a04a1450-6504-4deb-8aca-b49ae18b9709 tempest-VolumesDeleteCascade-344788728 None] Volume b212440b-29ab-46c7-9de4-1b634388d951: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b212440b-29ab-46c7-9de4-1b634388d951', 'volume_size': 1}
Apr 28 22:14:27 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-a04a1450-6504-4deb-8aca-b49ae18b9709 tempest-VolumesDeleteCascade-344788728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:14:29 devstack sudo[91720]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4f510212-ed16-4ac6-9172-b3319a7bb8d9 tempest-VolumesSnapshotTestJSON-845556625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b35b14af-5a14-465f-ae68-2b6c740b4944 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cda29583-2ba2-4841-b1dd-27abf8e48347" returned: 0 in 4.965s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:30 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb291c2-c5bf-4cd5-ba9b-7d71dde78a03]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:14:30 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4f510212-ed16-4ac6-9172-b3319a7bb8d9 tempest-VolumesSnapshotTestJSON-845556625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b35b14af-5a14-465f-ae68-2b6c740b4944 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:30 devstack sudo[91744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b35b14af-5a14-465f-ae68-2b6c740b4944
Apr 28 22:14:30 devstack sudo[91744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:30 devstack sudo[91744]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:30 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4f510212-ed16-4ac6-9172-b3319a7bb8d9 tempest-VolumesSnapshotTestJSON-845556625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b35b14af-5a14-465f-ae68-2b6c740b4944" returned: 0 in 0.799s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:30 devstack cinder-volume[83924]: DEBUG cinder.image.image_utils [None req-4f510212-ed16-4ac6-9172-b3319a7bb8d9 tempest-VolumesSnapshotTestJSON-845556625 None] Image conversion details: src /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b35b14af-5a14-465f-ae68-2b6c740b4944, size 1024.00 MB, duration 4.97 sec, destination /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cda29583-2ba2-4841-b1dd-27abf8e48347 {{(pid=83924) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 28 22:14:30 devstack cinder-volume[83924]: INFO cinder.image.image_utils [None req-4f510212-ed16-4ac6-9172-b3319a7bb8d9 tempest-VolumesSnapshotTestJSON-845556625 None] Converted 1024.00 MB image at 206.20 MB/s
Apr 28 22:14:30 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-4f510212-ed16-4ac6-9172-b3319a7bb8d9 tempest-VolumesSnapshotTestJSON-845556625 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cda29583-2ba2-4841-b1dd-27abf8e48347 is being set with open permissions: ugo+rw
Apr 28 22:14:30 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4f510212-ed16-4ac6-9172-b3319a7bb8d9 tempest-VolumesSnapshotTestJSON-845556625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cda29583-2ba2-4841-b1dd-27abf8e48347 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:30 devstack sudo[91749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cda29583-2ba2-4841-b1dd-27abf8e48347
Apr 28 22:14:30 devstack sudo[91749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:31 devstack sudo[91749]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4f510212-ed16-4ac6-9172-b3319a7bb8d9 tempest-VolumesSnapshotTestJSON-845556625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cda29583-2ba2-4841-b1dd-27abf8e48347" returned: 0 in 0.602s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:31 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-4f510212-ed16-4ac6-9172-b3319a7bb8d9 tempest-VolumesSnapshotTestJSON-845556625 None] Lock "cinder-quobyte-cda29583-2ba2-4841-b1dd-27abf8e48347" released by "_copy_volume_from_snapshot" :: held 8.018s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:14:31 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-4f510212-ed16-4ac6-9172-b3319a7bb8d9 tempest-VolumesSnapshotTestJSON-845556625 None] Lock "cinder-quobyte-db435df1-a447-4dc7-bc9b-13afe7a4e469-cda29583-2ba2-4841-b1dd-27abf8e48347" released by "_create_volume_from_snapshot" :: held 8.050s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:14:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-4f510212-ed16-4ac6-9172-b3319a7bb8d9 tempest-VolumesSnapshotTestJSON-845556625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.067s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:14:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-a04a1450-6504-4deb-8aca-b49ae18b9709 tempest-VolumesDeleteCascade-344788728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.021s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:14:31 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-a04a1450-6504-4deb-8aca-b49ae18b9709 tempest-VolumesDeleteCascade-344788728 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:14:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-698555998',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b212440b-29ab-46c7-9de4-1b634388d951,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07ec76fb287340bdaefa189ee009b506',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:14:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:14:27Z,use_quota=True,user_id='1b65c92297354fb38aef4cce0104c325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:14:31 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-a04a1450-6504-4deb-8aca-b49ae18b9709 tempest-VolumesDeleteCascade-344788728 None] Creating volume b212440b-29ab-46c7-9de4-1b634388d951 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:14:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-a04a1450-6504-4deb-8aca-b49ae18b9709 tempest-VolumesDeleteCascade-344788728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:14:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-a04a1450-6504-4deb-8aca-b49ae18b9709 tempest-VolumesDeleteCascade-344788728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:14:31 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-a04a1450-6504-4deb-8aca-b49ae18b9709 tempest-VolumesDeleteCascade-344788728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:14:31 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-a04a1450-6504-4deb-8aca-b49ae18b9709 tempest-VolumesDeleteCascade-344788728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:14:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-a04a1450-6504-4deb-8aca-b49ae18b9709 tempest-VolumesDeleteCascade-344788728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:14:31 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-a04a1450-6504-4deb-8aca-b49ae18b9709 tempest-VolumesDeleteCascade-344788728 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:14:31 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-a04a1450-6504-4deb-8aca-b49ae18b9709 tempest-VolumesDeleteCascade-344788728 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:14:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a04a1450-6504-4deb-8aca-b49ae18b9709 tempest-VolumesDeleteCascade-344788728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b212440b-29ab-46c7-9de4-1b634388d951 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:31 devstack sudo[91752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b212440b-29ab-46c7-9de4-1b634388d951 1073741824
Apr 28 22:14:31 devstack sudo[91752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:31 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-4f510212-ed16-4ac6-9172-b3319a7bb8d9 tempest-VolumesSnapshotTestJSON-845556625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5fcf02b-0492-44c3-a787-628f9c077683) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cda29583-2ba2-4841-b1dd-27abf8e48347', 'volume_size': 1, 'snapshot_id': 'db435df1-a447-4dc7-bc9b-13afe7a4e469'}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:14:31 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-4f510212-ed16-4ac6-9172-b3319a7bb8d9 tempest-VolumesSnapshotTestJSON-845556625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb8019e6-b0ba-4e35-bf66-5509c78352e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:14:31 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-4f510212-ed16-4ac6-9172-b3319a7bb8d9 tempest-VolumesSnapshotTestJSON-845556625 None] Volume volume-cda29583-2ba2-4841-b1dd-27abf8e48347 (cda29583-2ba2-4841-b1dd-27abf8e48347): created successfully
Apr 28 22:14:31 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-4f510212-ed16-4ac6-9172-b3319a7bb8d9 tempest-VolumesSnapshotTestJSON-845556625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb8019e6-b0ba-4e35-bf66-5509c78352e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:14:31 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-4f510212-ed16-4ac6-9172-b3319a7bb8d9 tempest-VolumesSnapshotTestJSON-845556625 None] Flow 'volume_create_manager' (5850d8c4-2faa-4487-946e-288f08d31ff5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:14:31 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-4f510212-ed16-4ac6-9172-b3319a7bb8d9 tempest-VolumesSnapshotTestJSON-845556625 None] Created volume successfully.
Apr 28 22:14:32 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-c427c694-807d-4b70-a6d4-29457ed35eee tempest-VolumesSnapshotTestJSON-845556625 None] Acquiring lock "cinder-cda29583-2ba2-4841-b1dd-27abf8e48347-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:14:32 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-c427c694-807d-4b70-a6d4-29457ed35eee tempest-VolumesSnapshotTestJSON-845556625 None] Lock "cinder-cda29583-2ba2-4841-b1dd-27abf8e48347-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:14:32 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-c427c694-807d-4b70-a6d4-29457ed35eee tempest-VolumesSnapshotTestJSON-845556625 None] Acquiring lock "cinder-quobyte-cda29583-2ba2-4841-b1dd-27abf8e48347" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:14:32 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-c427c694-807d-4b70-a6d4-29457ed35eee tempest-VolumesSnapshotTestJSON-845556625 None] Lock "cinder-quobyte-cda29583-2ba2-4841-b1dd-27abf8e48347" acquired by "delete_volume" :: waited 0.016s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:14:32 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[702f563e-a481-4201-ae70-6f50e4ee3d89]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:14:32 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c427c694-807d-4b70-a6d4-29457ed35eee tempest-VolumesSnapshotTestJSON-845556625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cda29583-2ba2-4841-b1dd-27abf8e48347 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:32 devstack sudo[91752]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:32 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a04a1450-6504-4deb-8aca-b49ae18b9709 tempest-VolumesDeleteCascade-344788728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b212440b-29ab-46c7-9de4-1b634388d951 1073741824" returned: 0 in 0.861s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:32 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a04a1450-6504-4deb-8aca-b49ae18b9709 tempest-VolumesDeleteCascade-344788728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b212440b-29ab-46c7-9de4-1b634388d951 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:32 devstack sudo[91761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b212440b-29ab-46c7-9de4-1b634388d951
Apr 28 22:14:32 devstack sudo[91761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:32 devstack sudo[91760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cda29583-2ba2-4841-b1dd-27abf8e48347
Apr 28 22:14:32 devstack sudo[91760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:32 devstack sudo[91761]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:32 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a04a1450-6504-4deb-8aca-b49ae18b9709 tempest-VolumesDeleteCascade-344788728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b212440b-29ab-46c7-9de4-1b634388d951" returned: 0 in 0.583s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:32 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-a04a1450-6504-4deb-8aca-b49ae18b9709 tempest-VolumesDeleteCascade-344788728 None] <== create_volume: return (1483ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:14:32 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-a04a1450-6504-4deb-8aca-b49ae18b9709 tempest-VolumesDeleteCascade-344788728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.486s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:14:32 devstack sudo[91760]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:32 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a04a1450-6504-4deb-8aca-b49ae18b9709 tempest-VolumesDeleteCascade-344788728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a735f601-958a-46e0-86c7-a66f7171b6c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b212440b-29ab-46c7-9de4-1b634388d951', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:14:32 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a04a1450-6504-4deb-8aca-b49ae18b9709 tempest-VolumesDeleteCascade-344788728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f0332ed-4755-4df6-bd8b-9ea9ca90e0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:14:32 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c427c694-807d-4b70-a6d4-29457ed35eee tempest-VolumesSnapshotTestJSON-845556625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cda29583-2ba2-4841-b1dd-27abf8e48347" returned: 0 in 0.713s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:32 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c427c694-807d-4b70-a6d4-29457ed35eee tempest-VolumesSnapshotTestJSON-845556625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cda29583-2ba2-4841-b1dd-27abf8e48347 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:32 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-a04a1450-6504-4deb-8aca-b49ae18b9709 tempest-VolumesDeleteCascade-344788728 None] Volume volume-b212440b-29ab-46c7-9de4-1b634388d951 (b212440b-29ab-46c7-9de4-1b634388d951): created successfully
Apr 28 22:14:32 devstack sudo[91768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cda29583-2ba2-4841-b1dd-27abf8e48347
Apr 28 22:14:32 devstack sudo[91768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:32 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a04a1450-6504-4deb-8aca-b49ae18b9709 tempest-VolumesDeleteCascade-344788728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f0332ed-4755-4df6-bd8b-9ea9ca90e0bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:14:32 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a04a1450-6504-4deb-8aca-b49ae18b9709 tempest-VolumesDeleteCascade-344788728 None] Flow 'volume_create_manager' (d69f7d9e-c6d6-4f78-8c04-bed4a75f347a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:14:33 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-a04a1450-6504-4deb-8aca-b49ae18b9709 tempest-VolumesDeleteCascade-344788728 None] Created volume successfully.
Apr 28 22:14:33 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-cd477f2a-1bd9-44ad-808e-941a324c33ec tempest-VolumesDeleteCascade-344788728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:14:33 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-cd477f2a-1bd9-44ad-808e-941a324c33ec tempest-VolumesDeleteCascade-344788728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:14:33 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-cd477f2a-1bd9-44ad-808e-941a324c33ec tempest-VolumesDeleteCascade-344788728 None] Creating offline snapshot 2d28f757-daa1-4a78-a933-fa4973f557f7 of volume b212440b-29ab-46c7-9de4-1b634388d951 {{(pid=83924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 22:14:33 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c4ed29c-3896-46b3-b4c3-f7badd397dec]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:14:33 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-cd477f2a-1bd9-44ad-808e-941a324c33ec tempest-VolumesDeleteCascade-344788728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b212440b-29ab-46c7-9de4-1b634388d951 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:33 devstack sudo[91768]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:33 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c427c694-807d-4b70-a6d4-29457ed35eee tempest-VolumesSnapshotTestJSON-845556625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cda29583-2ba2-4841-b1dd-27abf8e48347" returned: 0 in 0.585s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:33 devstack sudo[91772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b212440b-29ab-46c7-9de4-1b634388d951
Apr 28 22:14:33 devstack sudo[91772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:33 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-c427c694-807d-4b70-a6d4-29457ed35eee tempest-VolumesSnapshotTestJSON-845556625 None] Lock "cinder-quobyte-cda29583-2ba2-4841-b1dd-27abf8e48347" released by "delete_volume" :: held 1.354s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:14:33 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-c427c694-807d-4b70-a6d4-29457ed35eee tempest-VolumesSnapshotTestJSON-845556625 None] Created reservations ['c888fe01-4ee0-49f4-aa43-25c59be4b9ee', 'f5d8b5df-6e0e-4b78-bfa8-317611c01263', '434a47c1-b1d2-4f0b-a90c-c72434d4870f', '99f484d1-28da-49d2-bfff-361376a368bf'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:14:33 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-c427c694-807d-4b70-a6d4-29457ed35eee tempest-VolumesSnapshotTestJSON-845556625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:14:33 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-c427c694-807d-4b70-a6d4-29457ed35eee tempest-VolumesSnapshotTestJSON-845556625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:14:33 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-c427c694-807d-4b70-a6d4-29457ed35eee tempest-VolumesSnapshotTestJSON-845556625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:14:33 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-c427c694-807d-4b70-a6d4-29457ed35eee tempest-VolumesSnapshotTestJSON-845556625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:14:33 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-c427c694-807d-4b70-a6d4-29457ed35eee tempest-VolumesSnapshotTestJSON-845556625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:14:33 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c427c694-807d-4b70-a6d4-29457ed35eee tempest-VolumesSnapshotTestJSON-845556625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:33 devstack sudo[91774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:14:33 devstack sudo[91774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:34 devstack sudo[91772]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:34 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-cd477f2a-1bd9-44ad-808e-941a324c33ec tempest-VolumesDeleteCascade-344788728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b212440b-29ab-46c7-9de4-1b634388d951" returned: 0 in 0.698s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:34 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-cd477f2a-1bd9-44ad-808e-941a324c33ec tempest-VolumesDeleteCascade-344788728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b212440b-29ab-46c7-9de4-1b634388d951,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b212440b-29ab-46c7-9de4-1b634388d951.2d28f757-daa1-4a78-a933-fa4973f557f7 1G {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:34 devstack sudo[91779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b212440b-29ab-46c7-9de4-1b634388d951,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b212440b-29ab-46c7-9de4-1b634388d951.2d28f757-daa1-4a78-a933-fa4973f557f7 1G
Apr 28 22:14:34 devstack sudo[91779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:34 devstack sudo[91774]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:34 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c427c694-807d-4b70-a6d4-29457ed35eee tempest-VolumesSnapshotTestJSON-845556625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.601s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:34 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-c427c694-807d-4b70-a6d4-29457ed35eee tempest-VolumesSnapshotTestJSON-845556625 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:14:34 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-c427c694-807d-4b70-a6d4-29457ed35eee tempest-VolumesSnapshotTestJSON-845556625 None] Deleted volume successfully.
Apr 28 22:14:34 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-c427c694-807d-4b70-a6d4-29457ed35eee tempest-VolumesSnapshotTestJSON-845556625 None] Lock "cinder-cda29583-2ba2-4841-b1dd-27abf8e48347-delete_volume" released by "delete_volume" :: held 2.166s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:14:34 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-e5f077a7-020d-4fe0-b2e5-96febf2392e2 tempest-VolumesSnapshotTestJSON-845556625 None] Acquiring lock "cinder-db435df1-a447-4dc7-bc9b-13afe7a4e469-delete_snapshot" by "delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:14:34 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-e5f077a7-020d-4fe0-b2e5-96febf2392e2 tempest-VolumesSnapshotTestJSON-845556625 None] Lock "cinder-db435df1-a447-4dc7-bc9b-13afe7a4e469-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:14:34 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-e5f077a7-020d-4fe0-b2e5-96febf2392e2 tempest-VolumesSnapshotTestJSON-845556625 None] Acquiring lock "cinder-quobyte-b35b14af-5a14-465f-ae68-2b6c740b4944" by "delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:14:34 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-e5f077a7-020d-4fe0-b2e5-96febf2392e2 tempest-VolumesSnapshotTestJSON-845556625 None] Lock "cinder-quobyte-b35b14af-5a14-465f-ae68-2b6c740b4944" acquired by "delete_snapshot" :: waited 0.019s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:14:34 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-e5f077a7-020d-4fe0-b2e5-96febf2392e2 tempest-VolumesSnapshotTestJSON-845556625 None] Acquiring lock "cinder-quobyte-db435df1-a447-4dc7-bc9b-13afe7a4e469" by "_delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:14:34 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-e5f077a7-020d-4fe0-b2e5-96febf2392e2 tempest-VolumesSnapshotTestJSON-845556625 None] Lock "cinder-quobyte-db435df1-a447-4dc7-bc9b-13afe7a4e469" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:14:34 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-e5f077a7-020d-4fe0-b2e5-96febf2392e2 tempest-VolumesSnapshotTestJSON-845556625 None] Deleting offline snapshot db435df1-a447-4dc7-bc9b-13afe7a4e469 of volume b35b14af-5a14-465f-ae68-2b6c740b4944 {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 22:14:34 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-e5f077a7-020d-4fe0-b2e5-96febf2392e2 tempest-VolumesSnapshotTestJSON-845556625 None] snapshot_file for this snap is: volume-b35b14af-5a14-465f-ae68-2b6c740b4944.db435df1-a447-4dc7-bc9b-13afe7a4e469 {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 22:14:34 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9625f0f-9995-49a0-83ea-2c61c19eb3ba]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:14:34 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e5f077a7-020d-4fe0-b2e5-96febf2392e2 tempest-VolumesSnapshotTestJSON-845556625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b35b14af-5a14-465f-ae68-2b6c740b4944.db435df1-a447-4dc7-bc9b-13afe7a4e469 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:34 devstack sudo[91782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b35b14af-5a14-465f-ae68-2b6c740b4944.db435df1-a447-4dc7-bc9b-13afe7a4e469
Apr 28 22:14:34 devstack sudo[91782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:34 devstack sudo[91779]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:34 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-cd477f2a-1bd9-44ad-808e-941a324c33ec tempest-VolumesDeleteCascade-344788728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b212440b-29ab-46c7-9de4-1b634388d951,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b212440b-29ab-46c7-9de4-1b634388d951.2d28f757-daa1-4a78-a933-fa4973f557f7 1G" returned: 0 in 0.751s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:34 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-cd477f2a-1bd9-44ad-808e-941a324c33ec tempest-VolumesDeleteCascade-344788728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b212440b-29ab-46c7-9de4-1b634388d951 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b212440b-29ab-46c7-9de4-1b634388d951.2d28f757-daa1-4a78-a933-fa4973f557f7 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:34 devstack sudo[91789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b212440b-29ab-46c7-9de4-1b634388d951 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b212440b-29ab-46c7-9de4-1b634388d951.2d28f757-daa1-4a78-a933-fa4973f557f7
Apr 28 22:14:34 devstack sudo[91789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:35 devstack sudo[91782]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:35 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e5f077a7-020d-4fe0-b2e5-96febf2392e2 tempest-VolumesSnapshotTestJSON-845556625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b35b14af-5a14-465f-ae68-2b6c740b4944.db435df1-a447-4dc7-bc9b-13afe7a4e469" returned: 0 in 0.739s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:35 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-e5f077a7-020d-4fe0-b2e5-96febf2392e2 tempest-VolumesSnapshotTestJSON-845556625 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b35b14af-5a14-465f-ae68-2b6c740b4944(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 22:14:35 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[262ee2d6-5698-46a9-8a59-bd698e976f22]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:14:35 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e5f077a7-020d-4fe0-b2e5-96febf2392e2 tempest-VolumesSnapshotTestJSON-845556625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b35b14af-5a14-465f-ae68-2b6c740b4944 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:35 devstack sudo[91794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b35b14af-5a14-465f-ae68-2b6c740b4944
Apr 28 22:14:35 devstack sudo[91794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:35 devstack sudo[91789]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:35 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-cd477f2a-1bd9-44ad-808e-941a324c33ec tempest-VolumesDeleteCascade-344788728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b212440b-29ab-46c7-9de4-1b634388d951 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b212440b-29ab-46c7-9de4-1b634388d951.2d28f757-daa1-4a78-a933-fa4973f557f7" returned: 0 in 0.678s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:35 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-cd477f2a-1bd9-44ad-808e-941a324c33ec tempest-VolumesDeleteCascade-344788728 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b212440b-29ab-46c7-9de4-1b634388d951.2d28f757-daa1-4a78-a933-fa4973f557f7 is being set with open permissions: ugo+rw
Apr 28 22:14:35 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-cd477f2a-1bd9-44ad-808e-941a324c33ec tempest-VolumesDeleteCascade-344788728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b212440b-29ab-46c7-9de4-1b634388d951.2d28f757-daa1-4a78-a933-fa4973f557f7 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:35 devstack sudo[91799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b212440b-29ab-46c7-9de4-1b634388d951.2d28f757-daa1-4a78-a933-fa4973f557f7
Apr 28 22:14:35 devstack sudo[91799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:36 devstack sudo[91794]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:36 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e5f077a7-020d-4fe0-b2e5-96febf2392e2 tempest-VolumesSnapshotTestJSON-845556625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b35b14af-5a14-465f-ae68-2b6c740b4944" returned: 0 in 0.743s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:36 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e5f077a7-020d-4fe0-b2e5-96febf2392e2 tempest-VolumesSnapshotTestJSON-845556625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b35b14af-5a14-465f-ae68-2b6c740b4944.db435df1-a447-4dc7-bc9b-13afe7a4e469 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:36 devstack sudo[91804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b35b14af-5a14-465f-ae68-2b6c740b4944.db435df1-a447-4dc7-bc9b-13afe7a4e469
Apr 28 22:14:36 devstack sudo[91804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:36 devstack sudo[91799]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:36 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-cd477f2a-1bd9-44ad-808e-941a324c33ec tempest-VolumesDeleteCascade-344788728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b212440b-29ab-46c7-9de4-1b634388d951.2d28f757-daa1-4a78-a933-fa4973f557f7" returned: 0 in 0.574s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:36 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-cd477f2a-1bd9-44ad-808e-941a324c33ec tempest-VolumesDeleteCascade-344788728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b212440b-29ab-46c7-9de4-1b634388d951.info {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:36 devstack sudo[91807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b212440b-29ab-46c7-9de4-1b634388d951.info
Apr 28 22:14:36 devstack sudo[91807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:36 devstack sudo[91804]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:36 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e5f077a7-020d-4fe0-b2e5-96febf2392e2 tempest-VolumesSnapshotTestJSON-845556625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b35b14af-5a14-465f-ae68-2b6c740b4944.db435df1-a447-4dc7-bc9b-13afe7a4e469" returned: 0 in 0.682s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:36 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e5f077a7-020d-4fe0-b2e5-96febf2392e2 tempest-VolumesSnapshotTestJSON-845556625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b35b14af-5a14-465f-ae68-2b6c740b4944.db435df1-a447-4dc7-bc9b-13afe7a4e469 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:36 devstack sudo[91813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b35b14af-5a14-465f-ae68-2b6c740b4944.db435df1-a447-4dc7-bc9b-13afe7a4e469
Apr 28 22:14:36 devstack sudo[91813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:36 devstack sudo[91807]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:36 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-cd477f2a-1bd9-44ad-808e-941a324c33ec tempest-VolumesDeleteCascade-344788728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b212440b-29ab-46c7-9de4-1b634388d951.info" returned: 0 in 0.588s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:36 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-cd477f2a-1bd9-44ad-808e-941a324c33ec tempest-VolumesDeleteCascade-344788728 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b212440b-29ab-46c7-9de4-1b634388d951.info is being set with open permissions: ugo+rw
Apr 28 22:14:36 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-cd477f2a-1bd9-44ad-808e-941a324c33ec tempest-VolumesDeleteCascade-344788728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b212440b-29ab-46c7-9de4-1b634388d951.info {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:36 devstack sudo[91815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b212440b-29ab-46c7-9de4-1b634388d951.info
Apr 28 22:14:36 devstack sudo[91815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:37 devstack sudo[91813]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:37 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e5f077a7-020d-4fe0-b2e5-96febf2392e2 tempest-VolumesSnapshotTestJSON-845556625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b35b14af-5a14-465f-ae68-2b6c740b4944.db435df1-a447-4dc7-bc9b-13afe7a4e469" returned: 0 in 0.583s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:37 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-e5f077a7-020d-4fe0-b2e5-96febf2392e2 tempest-VolumesSnapshotTestJSON-845556625 None] Lock "cinder-quobyte-db435df1-a447-4dc7-bc9b-13afe7a4e469" released by "_delete_snapshot" :: held 2.854s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:14:37 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-e5f077a7-020d-4fe0-b2e5-96febf2392e2 tempest-VolumesSnapshotTestJSON-845556625 None] Lock "cinder-quobyte-b35b14af-5a14-465f-ae68-2b6c740b4944" released by "delete_snapshot" :: held 2.882s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:14:37 devstack sudo[91815]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:37 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-cd477f2a-1bd9-44ad-808e-941a324c33ec tempest-VolumesDeleteCascade-344788728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b212440b-29ab-46c7-9de4-1b634388d951.info" returned: 0 in 0.605s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:37 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-cd477f2a-1bd9-44ad-808e-941a324c33ec tempest-VolumesDeleteCascade-344788728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.974s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:14:37 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-cd477f2a-1bd9-44ad-808e-941a324c33ec tempest-VolumesDeleteCascade-344788728 None] Create snapshot completed successfully
Apr 28 22:14:37 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-e5f077a7-020d-4fe0-b2e5-96febf2392e2 tempest-VolumesSnapshotTestJSON-845556625 None] Created reservations ['890a96b6-a4bc-4cd1-a6c7-415d327aca35', 'b45a9043-8184-488d-b975-c5de9203b6c1', 'ffa59ed7-649a-4700-95c0-83206212332b', 'c0b8e820-0ffa-44b2-9621-25f7d0615909'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:14:37 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-e5f077a7-020d-4fe0-b2e5-96febf2392e2 tempest-VolumesSnapshotTestJSON-845556625 None] Delete snapshot completed successfully.
Apr 28 22:14:37 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-e5f077a7-020d-4fe0-b2e5-96febf2392e2 tempest-VolumesSnapshotTestJSON-845556625 None] Lock "cinder-db435df1-a447-4dc7-bc9b-13afe7a4e469-delete_snapshot" released by "delete_snapshot" :: held 3.045s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:14:37 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-2d3272d6-a8c3-41b0-9403-751a09471657 tempest-VolumesSnapshotTestJSON-845556625 None] Acquiring lock "cinder-b35b14af-5a14-465f-ae68-2b6c740b4944-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:14:37 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-2d3272d6-a8c3-41b0-9403-751a09471657 tempest-VolumesSnapshotTestJSON-845556625 None] Lock "cinder-b35b14af-5a14-465f-ae68-2b6c740b4944-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:14:37 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-2d3272d6-a8c3-41b0-9403-751a09471657 tempest-VolumesSnapshotTestJSON-845556625 None] Acquiring lock "cinder-quobyte-b35b14af-5a14-465f-ae68-2b6c740b4944" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:14:37 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-2d3272d6-a8c3-41b0-9403-751a09471657 tempest-VolumesSnapshotTestJSON-845556625 None] Lock "cinder-quobyte-b35b14af-5a14-465f-ae68-2b6c740b4944" acquired by "delete_volume" :: waited 0.024s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:14:37 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[08119427-927e-4a90-beff-a603d14d7b23]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:14:37 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-2d3272d6-a8c3-41b0-9403-751a09471657 tempest-VolumesSnapshotTestJSON-845556625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b35b14af-5a14-465f-ae68-2b6c740b4944 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:37 devstack sudo[91819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b35b14af-5a14-465f-ae68-2b6c740b4944
Apr 28 22:14:37 devstack sudo[91819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:38 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6cc5315-1b47-4e01-aec2-a701c7bd6eb8 tempest-VolumesDeleteCascade-344788728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:14:38 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-e6cc5315-1b47-4e01-aec2-a701c7bd6eb8 tempest-VolumesDeleteCascade-344788728 None] Flow 'volume_create_manager' (f0842dc2-0417-434b-96ac-c12ff7dd10f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:14:38 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-e6cc5315-1b47-4e01-aec2-a701c7bd6eb8 tempest-VolumesDeleteCascade-344788728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ecc653f-83a9-4e46-b0a4-1fa06acc1945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:14:38 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-e6cc5315-1b47-4e01-aec2-a701c7bd6eb8 tempest-VolumesDeleteCascade-344788728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ecc653f-83a9-4e46-b0a4-1fa06acc1945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:14:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-347406331',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6cd7f50-7117-479f-a14a-e1ea23ac8894,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07ec76fb287340bdaefa189ee009b506',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:14:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2d28f757-daa1-4a78-a933-fa4973f557f7,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:14:38Z,use_quota=True,user_id='1b65c92297354fb38aef4cce0104c325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:14:38 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-e6cc5315-1b47-4e01-aec2-a701c7bd6eb8 tempest-VolumesDeleteCascade-344788728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (630a8108-cb7e-4020-b2d1-3f4b9e237ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:14:38 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-e6cc5315-1b47-4e01-aec2-a701c7bd6eb8 tempest-VolumesDeleteCascade-344788728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (630a8108-cb7e-4020-b2d1-3f4b9e237ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:14:38 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-e6cc5315-1b47-4e01-aec2-a701c7bd6eb8 tempest-VolumesDeleteCascade-344788728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52f07d96-99a4-430a-aab1-2ce5e1042320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:14:38 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-e6cc5315-1b47-4e01-aec2-a701c7bd6eb8 tempest-VolumesDeleteCascade-344788728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52f07d96-99a4-430a-aab1-2ce5e1042320) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e6cd7f50-7117-479f-a14a-e1ea23ac8894', 'volume_name': 'volume-e6cd7f50-7117-479f-a14a-e1ea23ac8894', 'volume_size': 1, 'snapshot_id': '2d28f757-daa1-4a78-a933-fa4973f557f7'}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:14:38 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-e6cc5315-1b47-4e01-aec2-a701c7bd6eb8 tempest-VolumesDeleteCascade-344788728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6243533-9be4-4b9b-afcb-8a82fa09c940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:14:38 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-e6cc5315-1b47-4e01-aec2-a701c7bd6eb8 tempest-VolumesDeleteCascade-344788728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6243533-9be4-4b9b-afcb-8a82fa09c940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:14:38 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-e6cc5315-1b47-4e01-aec2-a701c7bd6eb8 tempest-VolumesDeleteCascade-344788728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42c7b406-d6e9-47dd-8230-b59ea454d5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:14:38 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-e6cc5315-1b47-4e01-aec2-a701c7bd6eb8 tempest-VolumesDeleteCascade-344788728 None] Volume e6cd7f50-7117-479f-a14a-e1ea23ac8894: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e6cd7f50-7117-479f-a14a-e1ea23ac8894', 'volume_size': 1, 'snapshot_id': '2d28f757-daa1-4a78-a933-fa4973f557f7'}
Apr 28 22:14:38 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-e6cc5315-1b47-4e01-aec2-a701c7bd6eb8 tempest-VolumesDeleteCascade-344788728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:14:38 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-e6cc5315-1b47-4e01-aec2-a701c7bd6eb8 tempest-VolumesDeleteCascade-344788728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:14:38 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-e6cc5315-1b47-4e01-aec2-a701c7bd6eb8 tempest-VolumesDeleteCascade-344788728 None] Acquiring lock "cinder-quobyte-2d28f757-daa1-4a78-a933-fa4973f557f7-e6cd7f50-7117-479f-a14a-e1ea23ac8894" by "_create_volume_from_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:14:38 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-e6cc5315-1b47-4e01-aec2-a701c7bd6eb8 tempest-VolumesDeleteCascade-344788728 None] Lock "cinder-quobyte-2d28f757-daa1-4a78-a933-fa4973f557f7-e6cd7f50-7117-479f-a14a-e1ea23ac8894" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:14:38 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-e6cc5315-1b47-4e01-aec2-a701c7bd6eb8 tempest-VolumesDeleteCascade-344788728 None] Creating volume e6cd7f50-7117-479f-a14a-e1ea23ac8894 from snapshot 2d28f757-daa1-4a78-a933-fa4973f557f7 {{(pid=83924) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 28 22:14:38 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-e6cc5315-1b47-4e01-aec2-a701c7bd6eb8 tempest-VolumesDeleteCascade-344788728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:14:38 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-e6cc5315-1b47-4e01-aec2-a701c7bd6eb8 tempest-VolumesDeleteCascade-344788728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:14:38 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-e6cc5315-1b47-4e01-aec2-a701c7bd6eb8 tempest-VolumesDeleteCascade-344788728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:14:38 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-e6cc5315-1b47-4e01-aec2-a701c7bd6eb8 tempest-VolumesDeleteCascade-344788728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:14:38 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-e6cc5315-1b47-4e01-aec2-a701c7bd6eb8 tempest-VolumesDeleteCascade-344788728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:14:38 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-e6cc5315-1b47-4e01-aec2-a701c7bd6eb8 tempest-VolumesDeleteCascade-344788728 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:14:38 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-e6cc5315-1b47-4e01-aec2-a701c7bd6eb8 tempest-VolumesDeleteCascade-344788728 None] Acquiring lock "cinder-quobyte-e6cd7f50-7117-479f-a14a-e1ea23ac8894" by "_copy_volume_from_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:14:38 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-e6cc5315-1b47-4e01-aec2-a701c7bd6eb8 tempest-VolumesDeleteCascade-344788728 None] Lock "cinder-quobyte-e6cd7f50-7117-479f-a14a-e1ea23ac8894" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:14:38 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-e6cc5315-1b47-4e01-aec2-a701c7bd6eb8 tempest-VolumesDeleteCascade-344788728 None] snapshot: 2d28f757-daa1-4a78-a933-fa4973f557f7, volume: e6cd7f50-7117-479f-a14a-e1ea23ac8894,  {{(pid=83924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 28 22:14:38 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-e6cc5315-1b47-4e01-aec2-a701c7bd6eb8 tempest-VolumesDeleteCascade-344788728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:14:38 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-e6cc5315-1b47-4e01-aec2-a701c7bd6eb8 tempest-VolumesDeleteCascade-344788728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:14:38 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-e6cc5315-1b47-4e01-aec2-a701c7bd6eb8 tempest-VolumesDeleteCascade-344788728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:14:38 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-e6cc5315-1b47-4e01-aec2-a701c7bd6eb8 tempest-VolumesDeleteCascade-344788728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:14:38 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-e6cc5315-1b47-4e01-aec2-a701c7bd6eb8 tempest-VolumesDeleteCascade-344788728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:14:38 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ebb1fd5-8852-46cf-ab01-1a7a6ac268ae]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:14:38 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e6cc5315-1b47-4e01-aec2-a701c7bd6eb8 tempest-VolumesDeleteCascade-344788728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b212440b-29ab-46c7-9de4-1b634388d951.2d28f757-daa1-4a78-a933-fa4973f557f7 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:38 devstack sudo[91821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b212440b-29ab-46c7-9de4-1b634388d951.2d28f757-daa1-4a78-a933-fa4973f557f7
Apr 28 22:14:38 devstack sudo[91821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:38 devstack sudo[91819]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:38 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-2d3272d6-a8c3-41b0-9403-751a09471657 tempest-VolumesSnapshotTestJSON-845556625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b35b14af-5a14-465f-ae68-2b6c740b4944" returned: 0 in 0.761s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:38 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-2d3272d6-a8c3-41b0-9403-751a09471657 tempest-VolumesSnapshotTestJSON-845556625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b35b14af-5a14-465f-ae68-2b6c740b4944 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:38 devstack sudo[91826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b35b14af-5a14-465f-ae68-2b6c740b4944
Apr 28 22:14:38 devstack sudo[91826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:38 devstack sudo[91821]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:38 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e6cc5315-1b47-4e01-aec2-a701c7bd6eb8 tempest-VolumesDeleteCascade-344788728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b212440b-29ab-46c7-9de4-1b634388d951.2d28f757-daa1-4a78-a933-fa4973f557f7" returned: 0 in 0.728s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:38 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-e6cc5315-1b47-4e01-aec2-a701c7bd6eb8 tempest-VolumesDeleteCascade-344788728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b212440b-29ab-46c7-9de4-1b634388d951(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 22:14:38 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-e6cc5315-1b47-4e01-aec2-a701c7bd6eb8 tempest-VolumesDeleteCascade-344788728 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b212440b-29ab-46c7-9de4-1b634388d951 {{(pid=83924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 28 22:14:38 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-e6cc5315-1b47-4e01-aec2-a701c7bd6eb8 tempest-VolumesDeleteCascade-344788728 None] Creating direct copy from snapshot {{(pid=83924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 28 22:14:39 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[add93144-1e72-4979-ac84-359b93f4f32f]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:14:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e6cc5315-1b47-4e01-aec2-a701c7bd6eb8 tempest-VolumesDeleteCascade-344788728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b212440b-29ab-46c7-9de4-1b634388d951 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:39 devstack sudo[91831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b212440b-29ab-46c7-9de4-1b634388d951
Apr 28 22:14:39 devstack sudo[91831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:39 devstack sudo[91826]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-2d3272d6-a8c3-41b0-9403-751a09471657 tempest-VolumesSnapshotTestJSON-845556625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b35b14af-5a14-465f-ae68-2b6c740b4944" returned: 0 in 0.586s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:39 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-2d3272d6-a8c3-41b0-9403-751a09471657 tempest-VolumesSnapshotTestJSON-845556625 None] Lock "cinder-quobyte-b35b14af-5a14-465f-ae68-2b6c740b4944" released by "delete_volume" :: held 1.417s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:14:39 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-2d3272d6-a8c3-41b0-9403-751a09471657 tempest-VolumesSnapshotTestJSON-845556625 None] Created reservations ['a98212af-cb05-4983-9f36-b27fd12dae0d', '8ff93772-3dee-4b62-a8af-878683038803', '3ec52ba0-7d42-4f69-9f2c-572029404375', 'fdbb1ad4-a27c-44a0-b715-311ee8a79234'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:14:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-2d3272d6-a8c3-41b0-9403-751a09471657 tempest-VolumesSnapshotTestJSON-845556625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:14:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-2d3272d6-a8c3-41b0-9403-751a09471657 tempest-VolumesSnapshotTestJSON-845556625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:14:39 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-2d3272d6-a8c3-41b0-9403-751a09471657 tempest-VolumesSnapshotTestJSON-845556625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:14:39 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-2d3272d6-a8c3-41b0-9403-751a09471657 tempest-VolumesSnapshotTestJSON-845556625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:14:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-2d3272d6-a8c3-41b0-9403-751a09471657 tempest-VolumesSnapshotTestJSON-845556625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:14:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-2d3272d6-a8c3-41b0-9403-751a09471657 tempest-VolumesSnapshotTestJSON-845556625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:39 devstack sudo[91834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:14:39 devstack sudo[91834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:39 devstack cinder-volume[83924]: DEBUG oslo_service.periodic_task [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83924) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 28 22:14:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:14:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:14:39 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:14:39 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:14:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:14:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:39 devstack sudo[91831]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e6cc5315-1b47-4e01-aec2-a701c7bd6eb8 tempest-VolumesDeleteCascade-344788728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b212440b-29ab-46c7-9de4-1b634388d951" returned: 0 in 0.704s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:39 devstack cinder-volume[83924]: DEBUG cinder.utils [None req-e6cc5315-1b47-4e01-aec2-a701c7bd6eb8 tempest-VolumesDeleteCascade-344788728 None] Path /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-e6cd7f50-7117-479f-a14a-e1ea23ac8894 not found in is_blk_device check {{(pid=83924) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 28 22:14:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e6cc5315-1b47-4e01-aec2-a701c7bd6eb8 tempest-VolumesDeleteCascade-344788728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b212440b-29ab-46c7-9de4-1b634388d951 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-e6cd7f50-7117-479f-a14a-e1ea23ac8894 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:39 devstack sudo[91839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:14:39 devstack sudo[91839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:39 devstack sudo[91840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b212440b-29ab-46c7-9de4-1b634388d951 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-e6cd7f50-7117-479f-a14a-e1ea23ac8894
Apr 28 22:14:39 devstack sudo[91840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:39 devstack sudo[91834]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-2d3272d6-a8c3-41b0-9403-751a09471657 tempest-VolumesSnapshotTestJSON-845556625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.665s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:39 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-2d3272d6-a8c3-41b0-9403-751a09471657 tempest-VolumesSnapshotTestJSON-845556625 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:14:39 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-2d3272d6-a8c3-41b0-9403-751a09471657 tempest-VolumesSnapshotTestJSON-845556625 None] Deleted volume successfully.
Apr 28 22:14:40 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-2d3272d6-a8c3-41b0-9403-751a09471657 tempest-VolumesSnapshotTestJSON-845556625 None] Lock "cinder-b35b14af-5a14-465f-ae68-2b6c740b4944-delete_volume" released by "delete_volume" :: held 2.312s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:14:40 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-db70e2a5-aae0-4150-906c-49118566ccb1 tempest-VolumesSnapshotTestJSON-845556625 None] Acquiring lock "cinder-55927b0a-96f0-4346-a0eb-5fb22e704e1d-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:14:40 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-db70e2a5-aae0-4150-906c-49118566ccb1 tempest-VolumesSnapshotTestJSON-845556625 None] Lock "cinder-55927b0a-96f0-4346-a0eb-5fb22e704e1d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:14:40 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-db70e2a5-aae0-4150-906c-49118566ccb1 tempest-VolumesSnapshotTestJSON-845556625 None] Acquiring lock "cinder-quobyte-55927b0a-96f0-4346-a0eb-5fb22e704e1d" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:14:40 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-db70e2a5-aae0-4150-906c-49118566ccb1 tempest-VolumesSnapshotTestJSON-845556625 None] Lock "cinder-quobyte-55927b0a-96f0-4346-a0eb-5fb22e704e1d" acquired by "delete_volume" :: waited 0.032s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:14:40 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b68d25-239e-4b19-a9fb-0496671f52ee]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:14:40 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-db70e2a5-aae0-4150-906c-49118566ccb1 tempest-VolumesSnapshotTestJSON-845556625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-55927b0a-96f0-4346-a0eb-5fb22e704e1d {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:40 devstack sudo[91844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-55927b0a-96f0-4346-a0eb-5fb22e704e1d
Apr 28 22:14:40 devstack sudo[91844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:40 devstack sudo[91839]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:40 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.682s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:40 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:14:41 devstack sudo[91844]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:41 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-db70e2a5-aae0-4150-906c-49118566ccb1 tempest-VolumesSnapshotTestJSON-845556625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-55927b0a-96f0-4346-a0eb-5fb22e704e1d" returned: 0 in 1.292s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:41 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-db70e2a5-aae0-4150-906c-49118566ccb1 tempest-VolumesSnapshotTestJSON-845556625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-55927b0a-96f0-4346-a0eb-5fb22e704e1d {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:41 devstack sudo[91861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-55927b0a-96f0-4346-a0eb-5fb22e704e1d
Apr 28 22:14:41 devstack sudo[91861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:43 devstack sudo[91861]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:43 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-db70e2a5-aae0-4150-906c-49118566ccb1 tempest-VolumesSnapshotTestJSON-845556625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-55927b0a-96f0-4346-a0eb-5fb22e704e1d" returned: 0 in 2.381s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:43 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-db70e2a5-aae0-4150-906c-49118566ccb1 tempest-VolumesSnapshotTestJSON-845556625 None] Lock "cinder-quobyte-55927b0a-96f0-4346-a0eb-5fb22e704e1d" released by "delete_volume" :: held 3.768s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:14:44 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-db70e2a5-aae0-4150-906c-49118566ccb1 tempest-VolumesSnapshotTestJSON-845556625 None] Created reservations ['c83814b0-5d00-49e8-92e6-c56ef8fe269a', 'be589b37-af9d-436d-aa59-a4965bce593b', 'd1a32cfc-d1f7-46e5-850f-655e70110209', 'd2a6b871-35c0-466b-b539-97e3de3fe4a8'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:14:44 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-db70e2a5-aae0-4150-906c-49118566ccb1 tempest-VolumesSnapshotTestJSON-845556625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:14:44 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-db70e2a5-aae0-4150-906c-49118566ccb1 tempest-VolumesSnapshotTestJSON-845556625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:14:44 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-db70e2a5-aae0-4150-906c-49118566ccb1 tempest-VolumesSnapshotTestJSON-845556625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:14:44 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-db70e2a5-aae0-4150-906c-49118566ccb1 tempest-VolumesSnapshotTestJSON-845556625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:14:44 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-db70e2a5-aae0-4150-906c-49118566ccb1 tempest-VolumesSnapshotTestJSON-845556625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:14:44 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-db70e2a5-aae0-4150-906c-49118566ccb1 tempest-VolumesSnapshotTestJSON-845556625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:44 devstack sudo[91866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:14:44 devstack sudo[91866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:44 devstack sudo[91840]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:44 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e6cc5315-1b47-4e01-aec2-a701c7bd6eb8 tempest-VolumesDeleteCascade-344788728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b212440b-29ab-46c7-9de4-1b634388d951 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-e6cd7f50-7117-479f-a14a-e1ea23ac8894" returned: 0 in 4.605s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:44 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c795a127-5160-4865-95b1-c045b8a0413b]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:14:44 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e6cc5315-1b47-4e01-aec2-a701c7bd6eb8 tempest-VolumesDeleteCascade-344788728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b212440b-29ab-46c7-9de4-1b634388d951 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:44 devstack sudo[91868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b212440b-29ab-46c7-9de4-1b634388d951
Apr 28 22:14:44 devstack sudo[91868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:44 devstack sudo[91866]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:44 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-db70e2a5-aae0-4150-906c-49118566ccb1 tempest-VolumesSnapshotTestJSON-845556625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.630s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:44 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-db70e2a5-aae0-4150-906c-49118566ccb1 tempest-VolumesSnapshotTestJSON-845556625 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:14:44 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-db70e2a5-aae0-4150-906c-49118566ccb1 tempest-VolumesSnapshotTestJSON-845556625 None] Deleted volume successfully.
Apr 28 22:14:44 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-db70e2a5-aae0-4150-906c-49118566ccb1 tempest-VolumesSnapshotTestJSON-845556625 None] Lock "cinder-55927b0a-96f0-4346-a0eb-5fb22e704e1d-delete_volume" released by "delete_volume" :: held 4.798s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:14:45 devstack sudo[91868]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:45 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e6cc5315-1b47-4e01-aec2-a701c7bd6eb8 tempest-VolumesDeleteCascade-344788728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b212440b-29ab-46c7-9de4-1b634388d951" returned: 0 in 0.936s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:45 devstack cinder-volume[83924]: DEBUG cinder.image.image_utils [None req-e6cc5315-1b47-4e01-aec2-a701c7bd6eb8 tempest-VolumesDeleteCascade-344788728 None] Image conversion details: src /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b212440b-29ab-46c7-9de4-1b634388d951, size 1024.00 MB, duration 4.61 sec, destination /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-e6cd7f50-7117-479f-a14a-e1ea23ac8894 {{(pid=83924) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 28 22:14:45 devstack cinder-volume[83924]: INFO cinder.image.image_utils [None req-e6cc5315-1b47-4e01-aec2-a701c7bd6eb8 tempest-VolumesDeleteCascade-344788728 None] Converted 1024.00 MB image at 222.31 MB/s
Apr 28 22:14:45 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-e6cc5315-1b47-4e01-aec2-a701c7bd6eb8 tempest-VolumesDeleteCascade-344788728 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-e6cd7f50-7117-479f-a14a-e1ea23ac8894 is being set with open permissions: ugo+rw
Apr 28 22:14:45 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e6cc5315-1b47-4e01-aec2-a701c7bd6eb8 tempest-VolumesDeleteCascade-344788728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-e6cd7f50-7117-479f-a14a-e1ea23ac8894 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:45 devstack sudo[91874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-e6cd7f50-7117-479f-a14a-e1ea23ac8894
Apr 28 22:14:45 devstack sudo[91874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:45 devstack sudo[91874]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:45 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e6cc5315-1b47-4e01-aec2-a701c7bd6eb8 tempest-VolumesDeleteCascade-344788728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-e6cd7f50-7117-479f-a14a-e1ea23ac8894" returned: 0 in 0.703s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:45 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-e6cc5315-1b47-4e01-aec2-a701c7bd6eb8 tempest-VolumesDeleteCascade-344788728 None] Lock "cinder-quobyte-e6cd7f50-7117-479f-a14a-e1ea23ac8894" released by "_copy_volume_from_snapshot" :: held 7.784s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:14:45 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-e6cc5315-1b47-4e01-aec2-a701c7bd6eb8 tempest-VolumesDeleteCascade-344788728 None] Lock "cinder-quobyte-2d28f757-daa1-4a78-a933-fa4973f557f7-e6cd7f50-7117-479f-a14a-e1ea23ac8894" released by "_create_volume_from_snapshot" :: held 7.818s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:14:45 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-e6cc5315-1b47-4e01-aec2-a701c7bd6eb8 tempest-VolumesDeleteCascade-344788728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.834s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:14:46 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-e6cc5315-1b47-4e01-aec2-a701c7bd6eb8 tempest-VolumesDeleteCascade-344788728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42c7b406-d6e9-47dd-8230-b59ea454d5ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6cd7f50-7117-479f-a14a-e1ea23ac8894', 'volume_size': 1, 'snapshot_id': '2d28f757-daa1-4a78-a933-fa4973f557f7'}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:14:46 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-e6cc5315-1b47-4e01-aec2-a701c7bd6eb8 tempest-VolumesDeleteCascade-344788728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcf5ace3-c77d-417a-9d0c-59a2dde59ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:14:46 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-e6cc5315-1b47-4e01-aec2-a701c7bd6eb8 tempest-VolumesDeleteCascade-344788728 None] Volume volume-e6cd7f50-7117-479f-a14a-e1ea23ac8894 (e6cd7f50-7117-479f-a14a-e1ea23ac8894): created successfully
Apr 28 22:14:46 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-e6cc5315-1b47-4e01-aec2-a701c7bd6eb8 tempest-VolumesDeleteCascade-344788728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcf5ace3-c77d-417a-9d0c-59a2dde59ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:14:46 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-e6cc5315-1b47-4e01-aec2-a701c7bd6eb8 tempest-VolumesDeleteCascade-344788728 None] Flow 'volume_create_manager' (f0842dc2-0417-434b-96ac-c12ff7dd10f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:14:46 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-e6cc5315-1b47-4e01-aec2-a701c7bd6eb8 tempest-VolumesDeleteCascade-344788728 None] Created volume successfully.
Apr 28 22:14:47 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-76f5acc8-3822-48a5-9be6-7cc7e173c830 tempest-VolumesDeleteCascade-344788728 None] Acquiring lock "cinder-b212440b-29ab-46c7-9de4-1b634388d951-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:14:47 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-76f5acc8-3822-48a5-9be6-7cc7e173c830 tempest-VolumesDeleteCascade-344788728 None] Lock "cinder-b212440b-29ab-46c7-9de4-1b634388d951-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:14:47 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-76f5acc8-3822-48a5-9be6-7cc7e173c830 tempest-VolumesDeleteCascade-344788728 None] Performing cascade delete. {{(pid=83924) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 28 22:14:47 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-76f5acc8-3822-48a5-9be6-7cc7e173c830 tempest-VolumesDeleteCascade-344788728 None] Acquiring lock "cinder-2d28f757-daa1-4a78-a933-fa4973f557f7-delete_snapshot" by "delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:14:47 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-76f5acc8-3822-48a5-9be6-7cc7e173c830 tempest-VolumesDeleteCascade-344788728 None] Lock "cinder-2d28f757-daa1-4a78-a933-fa4973f557f7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:14:47 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-76f5acc8-3822-48a5-9be6-7cc7e173c830 tempest-VolumesDeleteCascade-344788728 None] Acquiring lock "cinder-quobyte-b212440b-29ab-46c7-9de4-1b634388d951" by "delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:14:47 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-76f5acc8-3822-48a5-9be6-7cc7e173c830 tempest-VolumesDeleteCascade-344788728 None] Lock "cinder-quobyte-b212440b-29ab-46c7-9de4-1b634388d951" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:14:47 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-76f5acc8-3822-48a5-9be6-7cc7e173c830 tempest-VolumesDeleteCascade-344788728 None] Acquiring lock "cinder-quobyte-2d28f757-daa1-4a78-a933-fa4973f557f7" by "_delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:14:47 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-76f5acc8-3822-48a5-9be6-7cc7e173c830 tempest-VolumesDeleteCascade-344788728 None] Lock "cinder-quobyte-2d28f757-daa1-4a78-a933-fa4973f557f7" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:14:47 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-76f5acc8-3822-48a5-9be6-7cc7e173c830 tempest-VolumesDeleteCascade-344788728 None] Deleting offline snapshot 2d28f757-daa1-4a78-a933-fa4973f557f7 of volume b212440b-29ab-46c7-9de4-1b634388d951 {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 22:14:47 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-76f5acc8-3822-48a5-9be6-7cc7e173c830 tempest-VolumesDeleteCascade-344788728 None] snapshot_file for this snap is: volume-b212440b-29ab-46c7-9de4-1b634388d951.2d28f757-daa1-4a78-a933-fa4973f557f7 {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 22:14:47 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c68fa2a-0489-4e01-ad6f-26d0ed78e5e3]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:14:47 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-76f5acc8-3822-48a5-9be6-7cc7e173c830 tempest-VolumesDeleteCascade-344788728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b212440b-29ab-46c7-9de4-1b634388d951.2d28f757-daa1-4a78-a933-fa4973f557f7 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:47 devstack sudo[91879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b212440b-29ab-46c7-9de4-1b634388d951.2d28f757-daa1-4a78-a933-fa4973f557f7
Apr 28 22:14:47 devstack sudo[91879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:47 devstack sudo[91879]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:47 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-76f5acc8-3822-48a5-9be6-7cc7e173c830 tempest-VolumesDeleteCascade-344788728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b212440b-29ab-46c7-9de4-1b634388d951.2d28f757-daa1-4a78-a933-fa4973f557f7" returned: 0 in 0.765s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:47 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-76f5acc8-3822-48a5-9be6-7cc7e173c830 tempest-VolumesDeleteCascade-344788728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b212440b-29ab-46c7-9de4-1b634388d951(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 22:14:47 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ddd69e-fea2-4d78-8a75-dce4c19872ec]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:14:47 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-76f5acc8-3822-48a5-9be6-7cc7e173c830 tempest-VolumesDeleteCascade-344788728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b212440b-29ab-46c7-9de4-1b634388d951 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:48 devstack sudo[91884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b212440b-29ab-46c7-9de4-1b634388d951
Apr 28 22:14:48 devstack sudo[91884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:48 devstack sudo[91884]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:48 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-76f5acc8-3822-48a5-9be6-7cc7e173c830 tempest-VolumesDeleteCascade-344788728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b212440b-29ab-46c7-9de4-1b634388d951" returned: 0 in 0.807s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:48 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-76f5acc8-3822-48a5-9be6-7cc7e173c830 tempest-VolumesDeleteCascade-344788728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b212440b-29ab-46c7-9de4-1b634388d951.2d28f757-daa1-4a78-a933-fa4973f557f7 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:48 devstack sudo[91890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b212440b-29ab-46c7-9de4-1b634388d951.2d28f757-daa1-4a78-a933-fa4973f557f7
Apr 28 22:14:48 devstack sudo[91890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:49 devstack sudo[91890]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:49 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-76f5acc8-3822-48a5-9be6-7cc7e173c830 tempest-VolumesDeleteCascade-344788728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b212440b-29ab-46c7-9de4-1b634388d951.2d28f757-daa1-4a78-a933-fa4973f557f7" returned: 0 in 0.757s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:49 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-76f5acc8-3822-48a5-9be6-7cc7e173c830 tempest-VolumesDeleteCascade-344788728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b212440b-29ab-46c7-9de4-1b634388d951.2d28f757-daa1-4a78-a933-fa4973f557f7 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:49 devstack sudo[91896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b212440b-29ab-46c7-9de4-1b634388d951.2d28f757-daa1-4a78-a933-fa4973f557f7
Apr 28 22:14:49 devstack sudo[91896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:50 devstack sudo[91896]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:50 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-76f5acc8-3822-48a5-9be6-7cc7e173c830 tempest-VolumesDeleteCascade-344788728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b212440b-29ab-46c7-9de4-1b634388d951.2d28f757-daa1-4a78-a933-fa4973f557f7" returned: 0 in 0.625s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:50 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-76f5acc8-3822-48a5-9be6-7cc7e173c830 tempest-VolumesDeleteCascade-344788728 None] Lock "cinder-quobyte-2d28f757-daa1-4a78-a933-fa4973f557f7" released by "_delete_snapshot" :: held 3.049s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:14:50 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-76f5acc8-3822-48a5-9be6-7cc7e173c830 tempest-VolumesDeleteCascade-344788728 None] Lock "cinder-quobyte-b212440b-29ab-46c7-9de4-1b634388d951" released by "delete_snapshot" :: held 3.075s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:14:50 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-76f5acc8-3822-48a5-9be6-7cc7e173c830 tempest-VolumesDeleteCascade-344788728 None] Created reservations ['beaf4e11-dd2e-4d8c-b7db-6e41f76c4e1c', 'f7846cb1-8668-4c3a-9d9d-b37c7f1500d9', 'd6f9cb04-8eab-4d81-9dbb-b05c9bc60d91', '0ca78bb4-d8ff-4866-b143-debaeb2443af'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:14:50 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-76f5acc8-3822-48a5-9be6-7cc7e173c830 tempest-VolumesDeleteCascade-344788728 None] Delete snapshot completed successfully.
Apr 28 22:14:50 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-76f5acc8-3822-48a5-9be6-7cc7e173c830 tempest-VolumesDeleteCascade-344788728 None] Lock "cinder-2d28f757-daa1-4a78-a933-fa4973f557f7-delete_snapshot" released by "delete_snapshot" :: held 3.240s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:14:50 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-76f5acc8-3822-48a5-9be6-7cc7e173c830 tempest-VolumesDeleteCascade-344788728 None] Snapshots deleted, issuing volume delete {{(pid=83924) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 28 22:14:50 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-76f5acc8-3822-48a5-9be6-7cc7e173c830 tempest-VolumesDeleteCascade-344788728 None] Acquiring lock "cinder-quobyte-b212440b-29ab-46c7-9de4-1b634388d951" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:14:50 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-76f5acc8-3822-48a5-9be6-7cc7e173c830 tempest-VolumesDeleteCascade-344788728 None] Lock "cinder-quobyte-b212440b-29ab-46c7-9de4-1b634388d951" acquired by "delete_volume" :: waited 0.014s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:14:50 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[57dd02ef-8eed-44e0-bd79-aea91345d463]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:14:50 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-76f5acc8-3822-48a5-9be6-7cc7e173c830 tempest-VolumesDeleteCascade-344788728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b212440b-29ab-46c7-9de4-1b634388d951 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:50 devstack sudo[91899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b212440b-29ab-46c7-9de4-1b634388d951
Apr 28 22:14:50 devstack sudo[91899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:51 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-97cad83e-9b27-4ffa-bff6-4a49fe3e8e05 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:14:51 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-97cad83e-9b27-4ffa-bff6-4a49fe3e8e05 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Flow 'volume_create_manager' (841e74ad-7d1f-402d-86b8-8008bbad4ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:14:51 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-97cad83e-9b27-4ffa-bff6-4a49fe3e8e05 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51fd5cd0-2aaf-47c5-8c6f-7ced9db9f378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:14:51 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-97cad83e-9b27-4ffa-bff6-4a49fe3e8e05 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51fd5cd0-2aaf-47c5-8c6f-7ced9db9f378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:14:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2126804888',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf34f225-ab9b-49a7-892f-fda11bb365ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2af69711e21a48b68ba8c65af3e133ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:14:51Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:14:51Z,use_quota=True,user_id='55d96be4f7164b3eb2f0473c1d0c29d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:14:51 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-97cad83e-9b27-4ffa-bff6-4a49fe3e8e05 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49146cbb-7fb2-49d5-b205-d73db9fd4293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:14:51 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-97cad83e-9b27-4ffa-bff6-4a49fe3e8e05 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49146cbb-7fb2-49d5-b205-d73db9fd4293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:14:51 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-97cad83e-9b27-4ffa-bff6-4a49fe3e8e05 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5552eb90-049f-4c8c-81f4-9a1ed3904eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:14:51 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-97cad83e-9b27-4ffa-bff6-4a49fe3e8e05 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5552eb90-049f-4c8c-81f4-9a1ed3904eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf34f225-ab9b-49a7-892f-fda11bb365ce', 'volume_name': 'volume-cf34f225-ab9b-49a7-892f-fda11bb365ce', 'volume_size': 2}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:14:51 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-97cad83e-9b27-4ffa-bff6-4a49fe3e8e05 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38f60956-1549-48da-8391-885a60377050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:14:51 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-97cad83e-9b27-4ffa-bff6-4a49fe3e8e05 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38f60956-1549-48da-8391-885a60377050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:14:51 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-97cad83e-9b27-4ffa-bff6-4a49fe3e8e05 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c646296-8dab-4bf4-8c52-c504afdf0cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:14:51 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-97cad83e-9b27-4ffa-bff6-4a49fe3e8e05 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Volume cf34f225-ab9b-49a7-892f-fda11bb365ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf34f225-ab9b-49a7-892f-fda11bb365ce', 'volume_size': 2}
Apr 28 22:14:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-97cad83e-9b27-4ffa-bff6-4a49fe3e8e05 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:14:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-97cad83e-9b27-4ffa-bff6-4a49fe3e8e05 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:14:51 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-97cad83e-9b27-4ffa-bff6-4a49fe3e8e05 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:14:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2126804888',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf34f225-ab9b-49a7-892f-fda11bb365ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2af69711e21a48b68ba8c65af3e133ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:14:51Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:14:51Z,use_quota=True,user_id='55d96be4f7164b3eb2f0473c1d0c29d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:14:51 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-97cad83e-9b27-4ffa-bff6-4a49fe3e8e05 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Creating volume cf34f225-ab9b-49a7-892f-fda11bb365ce {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:14:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-97cad83e-9b27-4ffa-bff6-4a49fe3e8e05 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:14:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-97cad83e-9b27-4ffa-bff6-4a49fe3e8e05 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:14:51 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-97cad83e-9b27-4ffa-bff6-4a49fe3e8e05 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:14:51 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-97cad83e-9b27-4ffa-bff6-4a49fe3e8e05 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:14:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-97cad83e-9b27-4ffa-bff6-4a49fe3e8e05 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:14:51 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-97cad83e-9b27-4ffa-bff6-4a49fe3e8e05 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:14:51 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-97cad83e-9b27-4ffa-bff6-4a49fe3e8e05 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:14:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-97cad83e-9b27-4ffa-bff6-4a49fe3e8e05 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cf34f225-ab9b-49a7-892f-fda11bb365ce 2147483648 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:51 devstack sudo[91904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cf34f225-ab9b-49a7-892f-fda11bb365ce 2147483648
Apr 28 22:14:51 devstack sudo[91904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:51 devstack sudo[91899]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-76f5acc8-3822-48a5-9be6-7cc7e173c830 tempest-VolumesDeleteCascade-344788728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b212440b-29ab-46c7-9de4-1b634388d951" returned: 0 in 0.727s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-76f5acc8-3822-48a5-9be6-7cc7e173c830 tempest-VolumesDeleteCascade-344788728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b212440b-29ab-46c7-9de4-1b634388d951 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:51 devstack sudo[91906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b212440b-29ab-46c7-9de4-1b634388d951
Apr 28 22:14:51 devstack sudo[91906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:51 devstack sudo[91906]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-76f5acc8-3822-48a5-9be6-7cc7e173c830 tempest-VolumesDeleteCascade-344788728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b212440b-29ab-46c7-9de4-1b634388d951" returned: 0 in 0.618s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:51 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-76f5acc8-3822-48a5-9be6-7cc7e173c830 tempest-VolumesDeleteCascade-344788728 None] Lock "cinder-quobyte-b212440b-29ab-46c7-9de4-1b634388d951" released by "delete_volume" :: held 1.424s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:14:51 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-76f5acc8-3822-48a5-9be6-7cc7e173c830 tempest-VolumesDeleteCascade-344788728 None] Created reservations ['e99119b5-6c1b-4c1e-9638-df12c083c560', '184116fd-3901-4523-abb7-b35d8559b6bd', '0283fd0d-abf2-48c5-8c19-207fff8eef16', '351caf2a-3d0e-400e-8cca-fba0f81666cf'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:14:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-76f5acc8-3822-48a5-9be6-7cc7e173c830 tempest-VolumesDeleteCascade-344788728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:14:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-76f5acc8-3822-48a5-9be6-7cc7e173c830 tempest-VolumesDeleteCascade-344788728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:14:51 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-76f5acc8-3822-48a5-9be6-7cc7e173c830 tempest-VolumesDeleteCascade-344788728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:14:51 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-76f5acc8-3822-48a5-9be6-7cc7e173c830 tempest-VolumesDeleteCascade-344788728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:14:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-76f5acc8-3822-48a5-9be6-7cc7e173c830 tempest-VolumesDeleteCascade-344788728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:14:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-76f5acc8-3822-48a5-9be6-7cc7e173c830 tempest-VolumesDeleteCascade-344788728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:51 devstack sudo[91913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:14:51 devstack sudo[91913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:51 devstack sudo[91904]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-97cad83e-9b27-4ffa-bff6-4a49fe3e8e05 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cf34f225-ab9b-49a7-892f-fda11bb365ce 2147483648" returned: 0 in 0.857s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:52 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-97cad83e-9b27-4ffa-bff6-4a49fe3e8e05 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cf34f225-ab9b-49a7-892f-fda11bb365ce {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:52 devstack sudo[91915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cf34f225-ab9b-49a7-892f-fda11bb365ce
Apr 28 22:14:52 devstack sudo[91915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:52 devstack sudo[91913]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:52 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-76f5acc8-3822-48a5-9be6-7cc7e173c830 tempest-VolumesDeleteCascade-344788728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.604s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:52 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-76f5acc8-3822-48a5-9be6-7cc7e173c830 tempest-VolumesDeleteCascade-344788728 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:14:52 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-76f5acc8-3822-48a5-9be6-7cc7e173c830 tempest-VolumesDeleteCascade-344788728 None] Deleted volume successfully.
Apr 28 22:14:52 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-76f5acc8-3822-48a5-9be6-7cc7e173c830 tempest-VolumesDeleteCascade-344788728 None] Lock "cinder-b212440b-29ab-46c7-9de4-1b634388d951-delete_volume" released by "delete_volume" :: held 5.521s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:14:52 devstack sudo[91915]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:52 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-97cad83e-9b27-4ffa-bff6-4a49fe3e8e05 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cf34f225-ab9b-49a7-892f-fda11bb365ce" returned: 0 in 0.615s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:52 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-97cad83e-9b27-4ffa-bff6-4a49fe3e8e05 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] <== create_volume: return (1514ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:14:52 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-97cad83e-9b27-4ffa-bff6-4a49fe3e8e05 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.516s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:14:52 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-97cad83e-9b27-4ffa-bff6-4a49fe3e8e05 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c646296-8dab-4bf4-8c52-c504afdf0cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf34f225-ab9b-49a7-892f-fda11bb365ce', 'volume_size': 2}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:14:52 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-97cad83e-9b27-4ffa-bff6-4a49fe3e8e05 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7f2a044-0ef3-4f56-9348-ce4ecec422d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:14:52 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-c67e7fbf-11d6-485e-9d27-ba1699304481 tempest-VolumesDeleteCascade-344788728 None] Acquiring lock "cinder-e6cd7f50-7117-479f-a14a-e1ea23ac8894-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:14:52 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-97cad83e-9b27-4ffa-bff6-4a49fe3e8e05 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Volume volume-cf34f225-ab9b-49a7-892f-fda11bb365ce (cf34f225-ab9b-49a7-892f-fda11bb365ce): created successfully
Apr 28 22:14:52 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-97cad83e-9b27-4ffa-bff6-4a49fe3e8e05 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7f2a044-0ef3-4f56-9348-ce4ecec422d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:14:52 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-97cad83e-9b27-4ffa-bff6-4a49fe3e8e05 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Flow 'volume_create_manager' (841e74ad-7d1f-402d-86b8-8008bbad4ddc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:14:52 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-c67e7fbf-11d6-485e-9d27-ba1699304481 tempest-VolumesDeleteCascade-344788728 None] Lock "cinder-e6cd7f50-7117-479f-a14a-e1ea23ac8894-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:14:52 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-97cad83e-9b27-4ffa-bff6-4a49fe3e8e05 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Created volume successfully.
Apr 28 22:14:52 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-c67e7fbf-11d6-485e-9d27-ba1699304481 tempest-VolumesDeleteCascade-344788728 None] Acquiring lock "cinder-quobyte-e6cd7f50-7117-479f-a14a-e1ea23ac8894" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:14:52 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-c67e7fbf-11d6-485e-9d27-ba1699304481 tempest-VolumesDeleteCascade-344788728 None] Lock "cinder-quobyte-e6cd7f50-7117-479f-a14a-e1ea23ac8894" acquired by "delete_volume" :: waited 0.019s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:14:52 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[8280e089-8b74-4e30-8737-1af95193d5b3]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:14:52 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c67e7fbf-11d6-485e-9d27-ba1699304481 tempest-VolumesDeleteCascade-344788728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-e6cd7f50-7117-479f-a14a-e1ea23ac8894 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:52 devstack sudo[91919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-e6cd7f50-7117-479f-a14a-e1ea23ac8894
Apr 28 22:14:52 devstack sudo[91919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:53 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-6714b86a-49e1-49f2-8f1d-ebf5b7115af2 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:14:53 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-6714b86a-49e1-49f2-8f1d-ebf5b7115af2 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:14:53 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-6714b86a-49e1-49f2-8f1d-ebf5b7115af2 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Creating offline snapshot 3d30b1b8-06f0-4189-a860-80462357b8fb of volume cf34f225-ab9b-49a7-892f-fda11bb365ce {{(pid=83924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 22:14:53 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed090a4-0ea5-4895-acd6-4f7d43d24a58]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:14:53 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-6714b86a-49e1-49f2-8f1d-ebf5b7115af2 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cf34f225-ab9b-49a7-892f-fda11bb365ce {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:53 devstack sudo[91922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cf34f225-ab9b-49a7-892f-fda11bb365ce
Apr 28 22:14:53 devstack sudo[91922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:53 devstack sudo[91919]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:53 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c67e7fbf-11d6-485e-9d27-ba1699304481 tempest-VolumesDeleteCascade-344788728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-e6cd7f50-7117-479f-a14a-e1ea23ac8894" returned: 0 in 0.737s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:53 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c67e7fbf-11d6-485e-9d27-ba1699304481 tempest-VolumesDeleteCascade-344788728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-e6cd7f50-7117-479f-a14a-e1ea23ac8894 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:53 devstack sudo[91927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-e6cd7f50-7117-479f-a14a-e1ea23ac8894
Apr 28 22:14:53 devstack sudo[91927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:54 devstack sudo[91922]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:54 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-6714b86a-49e1-49f2-8f1d-ebf5b7115af2 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cf34f225-ab9b-49a7-892f-fda11bb365ce" returned: 0 in 0.700s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:54 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-6714b86a-49e1-49f2-8f1d-ebf5b7115af2 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cf34f225-ab9b-49a7-892f-fda11bb365ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cf34f225-ab9b-49a7-892f-fda11bb365ce.3d30b1b8-06f0-4189-a860-80462357b8fb 2G {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:54 devstack sudo[91927]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:54 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c67e7fbf-11d6-485e-9d27-ba1699304481 tempest-VolumesDeleteCascade-344788728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-e6cd7f50-7117-479f-a14a-e1ea23ac8894" returned: 0 in 0.575s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:54 devstack sudo[91933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cf34f225-ab9b-49a7-892f-fda11bb365ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cf34f225-ab9b-49a7-892f-fda11bb365ce.3d30b1b8-06f0-4189-a860-80462357b8fb 2G
Apr 28 22:14:54 devstack sudo[91933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:54 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-c67e7fbf-11d6-485e-9d27-ba1699304481 tempest-VolumesDeleteCascade-344788728 None] Lock "cinder-quobyte-e6cd7f50-7117-479f-a14a-e1ea23ac8894" released by "delete_volume" :: held 1.351s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:14:54 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-c67e7fbf-11d6-485e-9d27-ba1699304481 tempest-VolumesDeleteCascade-344788728 None] Created reservations ['b217338a-c669-409d-809e-c1e4f4c43245', '2a00f829-b164-4582-a0ac-02647a961aa5', '9c9ed1e8-8610-4b18-998c-903dd5a53229', 'b81c58ab-0493-4d1e-9200-781e97a32813'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:14:54 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-c67e7fbf-11d6-485e-9d27-ba1699304481 tempest-VolumesDeleteCascade-344788728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:14:54 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-c67e7fbf-11d6-485e-9d27-ba1699304481 tempest-VolumesDeleteCascade-344788728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:14:54 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-c67e7fbf-11d6-485e-9d27-ba1699304481 tempest-VolumesDeleteCascade-344788728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:14:54 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-c67e7fbf-11d6-485e-9d27-ba1699304481 tempest-VolumesDeleteCascade-344788728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:14:54 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-c67e7fbf-11d6-485e-9d27-ba1699304481 tempest-VolumesDeleteCascade-344788728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:14:54 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c67e7fbf-11d6-485e-9d27-ba1699304481 tempest-VolumesDeleteCascade-344788728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:54 devstack sudo[91935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:14:54 devstack sudo[91935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:54 devstack sudo[91933]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:54 devstack sudo[91935]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:54 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-6714b86a-49e1-49f2-8f1d-ebf5b7115af2 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cf34f225-ab9b-49a7-892f-fda11bb365ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cf34f225-ab9b-49a7-892f-fda11bb365ce.3d30b1b8-06f0-4189-a860-80462357b8fb 2G" returned: 0 in 0.738s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:54 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-6714b86a-49e1-49f2-8f1d-ebf5b7115af2 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf34f225-ab9b-49a7-892f-fda11bb365ce -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cf34f225-ab9b-49a7-892f-fda11bb365ce.3d30b1b8-06f0-4189-a860-80462357b8fb {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:54 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c67e7fbf-11d6-485e-9d27-ba1699304481 tempest-VolumesDeleteCascade-344788728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.609s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:54 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-c67e7fbf-11d6-485e-9d27-ba1699304481 tempest-VolumesDeleteCascade-344788728 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:14:54 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-c67e7fbf-11d6-485e-9d27-ba1699304481 tempest-VolumesDeleteCascade-344788728 None] Deleted volume successfully.
Apr 28 22:14:54 devstack sudo[91941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf34f225-ab9b-49a7-892f-fda11bb365ce -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cf34f225-ab9b-49a7-892f-fda11bb365ce.3d30b1b8-06f0-4189-a860-80462357b8fb
Apr 28 22:14:54 devstack sudo[91941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:54 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-c67e7fbf-11d6-485e-9d27-ba1699304481 tempest-VolumesDeleteCascade-344788728 None] Lock "cinder-e6cd7f50-7117-479f-a14a-e1ea23ac8894-delete_volume" released by "delete_volume" :: held 2.160s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:14:55 devstack sudo[91941]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:55 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-6714b86a-49e1-49f2-8f1d-ebf5b7115af2 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf34f225-ab9b-49a7-892f-fda11bb365ce -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cf34f225-ab9b-49a7-892f-fda11bb365ce.3d30b1b8-06f0-4189-a860-80462357b8fb" returned: 0 in 0.667s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:55 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-6714b86a-49e1-49f2-8f1d-ebf5b7115af2 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cf34f225-ab9b-49a7-892f-fda11bb365ce.3d30b1b8-06f0-4189-a860-80462357b8fb is being set with open permissions: ugo+rw
Apr 28 22:14:55 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-6714b86a-49e1-49f2-8f1d-ebf5b7115af2 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cf34f225-ab9b-49a7-892f-fda11bb365ce.3d30b1b8-06f0-4189-a860-80462357b8fb {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:55 devstack sudo[91946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cf34f225-ab9b-49a7-892f-fda11bb365ce.3d30b1b8-06f0-4189-a860-80462357b8fb
Apr 28 22:14:55 devstack sudo[91946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:56 devstack sudo[91946]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:56 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-6714b86a-49e1-49f2-8f1d-ebf5b7115af2 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cf34f225-ab9b-49a7-892f-fda11bb365ce.3d30b1b8-06f0-4189-a860-80462357b8fb" returned: 0 in 0.617s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:56 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-6714b86a-49e1-49f2-8f1d-ebf5b7115af2 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cf34f225-ab9b-49a7-892f-fda11bb365ce.info {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:56 devstack sudo[91949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cf34f225-ab9b-49a7-892f-fda11bb365ce.info
Apr 28 22:14:56 devstack sudo[91949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:56 devstack sudo[91949]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:56 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-6714b86a-49e1-49f2-8f1d-ebf5b7115af2 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cf34f225-ab9b-49a7-892f-fda11bb365ce.info" returned: 0 in 0.659s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:56 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-6714b86a-49e1-49f2-8f1d-ebf5b7115af2 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cf34f225-ab9b-49a7-892f-fda11bb365ce.info is being set with open permissions: ugo+rw
Apr 28 22:14:56 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-6714b86a-49e1-49f2-8f1d-ebf5b7115af2 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cf34f225-ab9b-49a7-892f-fda11bb365ce.info {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:56 devstack sudo[91952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cf34f225-ab9b-49a7-892f-fda11bb365ce.info
Apr 28 22:14:56 devstack sudo[91952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:57 devstack sudo[91952]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:57 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-6714b86a-49e1-49f2-8f1d-ebf5b7115af2 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cf34f225-ab9b-49a7-892f-fda11bb365ce.info" returned: 0 in 0.613s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:57 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-6714b86a-49e1-49f2-8f1d-ebf5b7115af2 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.093s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:14:57 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-6714b86a-49e1-49f2-8f1d-ebf5b7115af2 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Create snapshot completed successfully
Apr 28 22:14:57 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-33e0d6fb-f1b4-4031-b837-85cf87674562 tempest-VolumesCloneNegativeTest-974290541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:14:57 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-33e0d6fb-f1b4-4031-b837-85cf87674562 tempest-VolumesCloneNegativeTest-974290541 None] Flow 'volume_create_manager' (3ffcf4a2-5896-4ae8-98a4-96017513df86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:14:57 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-33e0d6fb-f1b4-4031-b837-85cf87674562 tempest-VolumesCloneNegativeTest-974290541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc0b7392-1aea-45a1-b5f5-8b018ec6762e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:14:57 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-33e0d6fb-f1b4-4031-b837-85cf87674562 tempest-VolumesCloneNegativeTest-974290541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc0b7392-1aea-45a1-b5f5-8b018ec6762e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2005754059',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8eeca15d-f40e-4194-ac09-28e09366bb7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73a1749fb54344d8bb4d79d3f47bef83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:14:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:14:58Z,use_quota=True,user_id='7bbad63c86ef40e2a7ec72d4d4a7770c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:14:57 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-33e0d6fb-f1b4-4031-b837-85cf87674562 tempest-VolumesCloneNegativeTest-974290541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3901cb8a-8dcc-4e71-9256-71c55dbd8b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:14:57 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-33e0d6fb-f1b4-4031-b837-85cf87674562 tempest-VolumesCloneNegativeTest-974290541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3901cb8a-8dcc-4e71-9256-71c55dbd8b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:14:57 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-33e0d6fb-f1b4-4031-b837-85cf87674562 tempest-VolumesCloneNegativeTest-974290541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (389343b8-bb3f-4a1a-b443-bab646c07810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:14:57 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-33e0d6fb-f1b4-4031-b837-85cf87674562 tempest-VolumesCloneNegativeTest-974290541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (389343b8-bb3f-4a1a-b443-bab646c07810) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8eeca15d-f40e-4194-ac09-28e09366bb7b', 'volume_name': 'volume-8eeca15d-f40e-4194-ac09-28e09366bb7b', 'volume_size': 2}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:14:57 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-33e0d6fb-f1b4-4031-b837-85cf87674562 tempest-VolumesCloneNegativeTest-974290541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec8d30e9-a0c3-498c-ac60-b1d15aec9c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:14:57 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-33e0d6fb-f1b4-4031-b837-85cf87674562 tempest-VolumesCloneNegativeTest-974290541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec8d30e9-a0c3-498c-ac60-b1d15aec9c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:14:57 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-33e0d6fb-f1b4-4031-b837-85cf87674562 tempest-VolumesCloneNegativeTest-974290541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fb8c8a7-fdd4-4a36-a439-349508e86625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:14:57 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-33e0d6fb-f1b4-4031-b837-85cf87674562 tempest-VolumesCloneNegativeTest-974290541 None] Volume 8eeca15d-f40e-4194-ac09-28e09366bb7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8eeca15d-f40e-4194-ac09-28e09366bb7b', 'volume_size': 2}
Apr 28 22:14:57 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-33e0d6fb-f1b4-4031-b837-85cf87674562 tempest-VolumesCloneNegativeTest-974290541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:14:57 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-33e0d6fb-f1b4-4031-b837-85cf87674562 tempest-VolumesCloneNegativeTest-974290541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:14:57 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-33e0d6fb-f1b4-4031-b837-85cf87674562 tempest-VolumesCloneNegativeTest-974290541 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2005754059',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8eeca15d-f40e-4194-ac09-28e09366bb7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73a1749fb54344d8bb4d79d3f47bef83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:14:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:14:58Z,use_quota=True,user_id='7bbad63c86ef40e2a7ec72d4d4a7770c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:14:57 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-33e0d6fb-f1b4-4031-b837-85cf87674562 tempest-VolumesCloneNegativeTest-974290541 None] Creating volume 8eeca15d-f40e-4194-ac09-28e09366bb7b {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:14:57 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-33e0d6fb-f1b4-4031-b837-85cf87674562 tempest-VolumesCloneNegativeTest-974290541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:14:57 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-33e0d6fb-f1b4-4031-b837-85cf87674562 tempest-VolumesCloneNegativeTest-974290541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:14:57 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-33e0d6fb-f1b4-4031-b837-85cf87674562 tempest-VolumesCloneNegativeTest-974290541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:14:57 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-33e0d6fb-f1b4-4031-b837-85cf87674562 tempest-VolumesCloneNegativeTest-974290541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:14:57 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-33e0d6fb-f1b4-4031-b837-85cf87674562 tempest-VolumesCloneNegativeTest-974290541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:14:57 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-33e0d6fb-f1b4-4031-b837-85cf87674562 tempest-VolumesCloneNegativeTest-974290541 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:14:57 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-33e0d6fb-f1b4-4031-b837-85cf87674562 tempest-VolumesCloneNegativeTest-974290541 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:14:57 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-33e0d6fb-f1b4-4031-b837-85cf87674562 tempest-VolumesCloneNegativeTest-974290541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8eeca15d-f40e-4194-ac09-28e09366bb7b 2147483648 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:57 devstack sudo[91955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8eeca15d-f40e-4194-ac09-28e09366bb7b 2147483648
Apr 28 22:14:57 devstack sudo[91955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:58 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-55a9b1a2-e0c8-4ad6-9d1a-aa1d1e1f6126 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Acquiring lock "cinder-3d30b1b8-06f0-4189-a860-80462357b8fb-delete_snapshot" by "delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:14:58 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-55a9b1a2-e0c8-4ad6-9d1a-aa1d1e1f6126 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Lock "cinder-3d30b1b8-06f0-4189-a860-80462357b8fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:14:58 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-55a9b1a2-e0c8-4ad6-9d1a-aa1d1e1f6126 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Acquiring lock "cinder-quobyte-cf34f225-ab9b-49a7-892f-fda11bb365ce" by "delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:14:58 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-55a9b1a2-e0c8-4ad6-9d1a-aa1d1e1f6126 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Lock "cinder-quobyte-cf34f225-ab9b-49a7-892f-fda11bb365ce" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:14:58 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-55a9b1a2-e0c8-4ad6-9d1a-aa1d1e1f6126 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Acquiring lock "cinder-quobyte-3d30b1b8-06f0-4189-a860-80462357b8fb" by "_delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:14:58 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-55a9b1a2-e0c8-4ad6-9d1a-aa1d1e1f6126 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Lock "cinder-quobyte-3d30b1b8-06f0-4189-a860-80462357b8fb" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:14:58 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-55a9b1a2-e0c8-4ad6-9d1a-aa1d1e1f6126 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Deleting offline snapshot 3d30b1b8-06f0-4189-a860-80462357b8fb of volume cf34f225-ab9b-49a7-892f-fda11bb365ce {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 22:14:58 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-55a9b1a2-e0c8-4ad6-9d1a-aa1d1e1f6126 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] snapshot_file for this snap is: volume-cf34f225-ab9b-49a7-892f-fda11bb365ce.3d30b1b8-06f0-4189-a860-80462357b8fb {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 22:14:58 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2513e803-2316-42b1-a7a1-cc8ab2736856]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:14:58 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-55a9b1a2-e0c8-4ad6-9d1a-aa1d1e1f6126 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cf34f225-ab9b-49a7-892f-fda11bb365ce.3d30b1b8-06f0-4189-a860-80462357b8fb {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:58 devstack sudo[91955]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:58 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-33e0d6fb-f1b4-4031-b837-85cf87674562 tempest-VolumesCloneNegativeTest-974290541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8eeca15d-f40e-4194-ac09-28e09366bb7b 2147483648" returned: 0 in 0.836s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:58 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-33e0d6fb-f1b4-4031-b837-85cf87674562 tempest-VolumesCloneNegativeTest-974290541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8eeca15d-f40e-4194-ac09-28e09366bb7b {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:58 devstack sudo[91962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8eeca15d-f40e-4194-ac09-28e09366bb7b
Apr 28 22:14:58 devstack sudo[91962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:58 devstack sudo[91961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cf34f225-ab9b-49a7-892f-fda11bb365ce.3d30b1b8-06f0-4189-a860-80462357b8fb
Apr 28 22:14:58 devstack sudo[91961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:14:59 devstack sudo[91962]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:59 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-33e0d6fb-f1b4-4031-b837-85cf87674562 tempest-VolumesCloneNegativeTest-974290541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8eeca15d-f40e-4194-ac09-28e09366bb7b" returned: 0 in 0.590s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:59 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-33e0d6fb-f1b4-4031-b837-85cf87674562 tempest-VolumesCloneNegativeTest-974290541 None] <== create_volume: return (1468ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:14:59 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-33e0d6fb-f1b4-4031-b837-85cf87674562 tempest-VolumesCloneNegativeTest-974290541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.470s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:14:59 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-33e0d6fb-f1b4-4031-b837-85cf87674562 tempest-VolumesCloneNegativeTest-974290541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fb8c8a7-fdd4-4a36-a439-349508e86625) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8eeca15d-f40e-4194-ac09-28e09366bb7b', 'volume_size': 2}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:14:59 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-33e0d6fb-f1b4-4031-b837-85cf87674562 tempest-VolumesCloneNegativeTest-974290541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84bc06f1-88c6-4ced-98e5-7fc24a23897d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:14:59 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-33e0d6fb-f1b4-4031-b837-85cf87674562 tempest-VolumesCloneNegativeTest-974290541 None] Volume volume-8eeca15d-f40e-4194-ac09-28e09366bb7b (8eeca15d-f40e-4194-ac09-28e09366bb7b): created successfully
Apr 28 22:14:59 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-33e0d6fb-f1b4-4031-b837-85cf87674562 tempest-VolumesCloneNegativeTest-974290541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84bc06f1-88c6-4ced-98e5-7fc24a23897d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:14:59 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-33e0d6fb-f1b4-4031-b837-85cf87674562 tempest-VolumesCloneNegativeTest-974290541 None] Flow 'volume_create_manager' (3ffcf4a2-5896-4ae8-98a4-96017513df86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:14:59 devstack sudo[91961]: pam_unix(sudo:session): session closed for user root
Apr 28 22:14:59 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-33e0d6fb-f1b4-4031-b837-85cf87674562 tempest-VolumesCloneNegativeTest-974290541 None] Created volume successfully.
Apr 28 22:14:59 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-55a9b1a2-e0c8-4ad6-9d1a-aa1d1e1f6126 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cf34f225-ab9b-49a7-892f-fda11bb365ce.3d30b1b8-06f0-4189-a860-80462357b8fb" returned: 0 in 0.724s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:14:59 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-55a9b1a2-e0c8-4ad6-9d1a-aa1d1e1f6126 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf34f225-ab9b-49a7-892f-fda11bb365ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 22:14:59 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7a2c47-8139-4f57-b0c0-9b7c19955785]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:14:59 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-55a9b1a2-e0c8-4ad6-9d1a-aa1d1e1f6126 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cf34f225-ab9b-49a7-892f-fda11bb365ce {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:14:59 devstack sudo[91969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cf34f225-ab9b-49a7-892f-fda11bb365ce
Apr 28 22:14:59 devstack sudo[91969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:00 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-b05b6c3b-322a-41aa-8771-89853fa22498 tempest-VolumesCloneNegativeTest-974290541 None] Acquiring lock "cinder-8eeca15d-f40e-4194-ac09-28e09366bb7b-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:15:00 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-b05b6c3b-322a-41aa-8771-89853fa22498 tempest-VolumesCloneNegativeTest-974290541 None] Lock "cinder-8eeca15d-f40e-4194-ac09-28e09366bb7b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:15:00 devstack sudo[91969]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:00 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-55a9b1a2-e0c8-4ad6-9d1a-aa1d1e1f6126 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cf34f225-ab9b-49a7-892f-fda11bb365ce" returned: 0 in 0.681s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:00 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-55a9b1a2-e0c8-4ad6-9d1a-aa1d1e1f6126 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cf34f225-ab9b-49a7-892f-fda11bb365ce.3d30b1b8-06f0-4189-a860-80462357b8fb {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:00 devstack sudo[91974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cf34f225-ab9b-49a7-892f-fda11bb365ce.3d30b1b8-06f0-4189-a860-80462357b8fb
Apr 28 22:15:00 devstack sudo[91974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:00 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-b05b6c3b-322a-41aa-8771-89853fa22498 tempest-VolumesCloneNegativeTest-974290541 None] Acquiring lock "cinder-quobyte-8eeca15d-f40e-4194-ac09-28e09366bb7b" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:15:00 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-b05b6c3b-322a-41aa-8771-89853fa22498 tempest-VolumesCloneNegativeTest-974290541 None] Lock "cinder-quobyte-8eeca15d-f40e-4194-ac09-28e09366bb7b" acquired by "delete_volume" :: waited 0.016s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:15:00 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[08de0719-a42a-4913-95cf-4fb875e46fb1]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:15:00 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b05b6c3b-322a-41aa-8771-89853fa22498 tempest-VolumesCloneNegativeTest-974290541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8eeca15d-f40e-4194-ac09-28e09366bb7b {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:00 devstack sudo[91976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8eeca15d-f40e-4194-ac09-28e09366bb7b
Apr 28 22:15:00 devstack sudo[91976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:00 devstack sudo[91974]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:00 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-55a9b1a2-e0c8-4ad6-9d1a-aa1d1e1f6126 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cf34f225-ab9b-49a7-892f-fda11bb365ce.3d30b1b8-06f0-4189-a860-80462357b8fb" returned: 0 in 0.680s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:00 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-55a9b1a2-e0c8-4ad6-9d1a-aa1d1e1f6126 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cf34f225-ab9b-49a7-892f-fda11bb365ce.3d30b1b8-06f0-4189-a860-80462357b8fb {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:00 devstack sudo[91983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cf34f225-ab9b-49a7-892f-fda11bb365ce.3d30b1b8-06f0-4189-a860-80462357b8fb
Apr 28 22:15:00 devstack sudo[91983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:00 devstack sudo[91976]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:00 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b05b6c3b-322a-41aa-8771-89853fa22498 tempest-VolumesCloneNegativeTest-974290541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8eeca15d-f40e-4194-ac09-28e09366bb7b" returned: 0 in 0.707s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:00 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b05b6c3b-322a-41aa-8771-89853fa22498 tempest-VolumesCloneNegativeTest-974290541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8eeca15d-f40e-4194-ac09-28e09366bb7b {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:00 devstack sudo[91987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8eeca15d-f40e-4194-ac09-28e09366bb7b
Apr 28 22:15:00 devstack sudo[91987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:01 devstack sudo[91983]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:01 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-55a9b1a2-e0c8-4ad6-9d1a-aa1d1e1f6126 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cf34f225-ab9b-49a7-892f-fda11bb365ce.3d30b1b8-06f0-4189-a860-80462357b8fb" returned: 0 in 0.621s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:01 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-55a9b1a2-e0c8-4ad6-9d1a-aa1d1e1f6126 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Lock "cinder-quobyte-3d30b1b8-06f0-4189-a860-80462357b8fb" released by "_delete_snapshot" :: held 2.817s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:15:01 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-55a9b1a2-e0c8-4ad6-9d1a-aa1d1e1f6126 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Lock "cinder-quobyte-cf34f225-ab9b-49a7-892f-fda11bb365ce" released by "delete_snapshot" :: held 2.845s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:15:01 devstack sudo[91987]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:01 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b05b6c3b-322a-41aa-8771-89853fa22498 tempest-VolumesCloneNegativeTest-974290541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8eeca15d-f40e-4194-ac09-28e09366bb7b" returned: 0 in 0.584s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:01 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-b05b6c3b-322a-41aa-8771-89853fa22498 tempest-VolumesCloneNegativeTest-974290541 None] Lock "cinder-quobyte-8eeca15d-f40e-4194-ac09-28e09366bb7b" released by "delete_volume" :: held 1.331s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:15:01 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-55a9b1a2-e0c8-4ad6-9d1a-aa1d1e1f6126 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Created reservations ['bc958467-fc06-4061-9114-fee9998d3478', '59109b97-4056-493f-8e70-ca01c47fe890', '086d3ae0-196c-4480-99b5-b378b296b98e', 'eb59da22-6906-4899-9d4e-1468a2a771e0'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:15:01 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-b05b6c3b-322a-41aa-8771-89853fa22498 tempest-VolumesCloneNegativeTest-974290541 None] Created reservations ['ca6bc23c-91b8-4d46-9583-585995b2b533', 'f17ee685-e630-4813-a83e-9c25a9a04ad6', '95b5f75a-0872-48c2-b25d-810c56127389', 'd09e986b-e4aa-41f2-8f16-103494421da4'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:15:01 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-55a9b1a2-e0c8-4ad6-9d1a-aa1d1e1f6126 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Delete snapshot completed successfully.
Apr 28 22:15:01 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-55a9b1a2-e0c8-4ad6-9d1a-aa1d1e1f6126 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Lock "cinder-3d30b1b8-06f0-4189-a860-80462357b8fb-delete_snapshot" released by "delete_snapshot" :: held 3.022s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:15:01 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b05b6c3b-322a-41aa-8771-89853fa22498 tempest-VolumesCloneNegativeTest-974290541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:15:01 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b05b6c3b-322a-41aa-8771-89853fa22498 tempest-VolumesCloneNegativeTest-974290541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:15:01 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-b05b6c3b-322a-41aa-8771-89853fa22498 tempest-VolumesCloneNegativeTest-974290541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:15:01 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-b05b6c3b-322a-41aa-8771-89853fa22498 tempest-VolumesCloneNegativeTest-974290541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:15:01 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b05b6c3b-322a-41aa-8771-89853fa22498 tempest-VolumesCloneNegativeTest-974290541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:15:01 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b05b6c3b-322a-41aa-8771-89853fa22498 tempest-VolumesCloneNegativeTest-974290541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:01 devstack sudo[91994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:15:01 devstack sudo[91994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:01 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-05b43b35-d549-4b51-8ba4-60f8e3102c32 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Acquiring lock "cinder-cf34f225-ab9b-49a7-892f-fda11bb365ce-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:15:01 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-05b43b35-d549-4b51-8ba4-60f8e3102c32 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Lock "cinder-cf34f225-ab9b-49a7-892f-fda11bb365ce-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:15:01 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-05b43b35-d549-4b51-8ba4-60f8e3102c32 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Acquiring lock "cinder-quobyte-cf34f225-ab9b-49a7-892f-fda11bb365ce" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:15:01 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-05b43b35-d549-4b51-8ba4-60f8e3102c32 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Lock "cinder-quobyte-cf34f225-ab9b-49a7-892f-fda11bb365ce" acquired by "delete_volume" :: waited 0.013s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:15:02 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f42efe-f3df-4937-8e05-98cbb1b202ee]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:15:02 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-05b43b35-d549-4b51-8ba4-60f8e3102c32 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cf34f225-ab9b-49a7-892f-fda11bb365ce {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:02 devstack sudo[91996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cf34f225-ab9b-49a7-892f-fda11bb365ce
Apr 28 22:15:02 devstack sudo[91996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:02 devstack sudo[91994]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:02 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b05b6c3b-322a-41aa-8771-89853fa22498 tempest-VolumesCloneNegativeTest-974290541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.622s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:02 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-b05b6c3b-322a-41aa-8771-89853fa22498 tempest-VolumesCloneNegativeTest-974290541 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:15:02 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-b05b6c3b-322a-41aa-8771-89853fa22498 tempest-VolumesCloneNegativeTest-974290541 None] Deleted volume successfully.
Apr 28 22:15:02 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-b05b6c3b-322a-41aa-8771-89853fa22498 tempest-VolumesCloneNegativeTest-974290541 None] Lock "cinder-8eeca15d-f40e-4194-ac09-28e09366bb7b-delete_volume" released by "delete_volume" :: held 2.206s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:15:02 devstack sudo[91996]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:02 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-05b43b35-d549-4b51-8ba4-60f8e3102c32 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cf34f225-ab9b-49a7-892f-fda11bb365ce" returned: 0 in 0.791s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:02 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-05b43b35-d549-4b51-8ba4-60f8e3102c32 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cf34f225-ab9b-49a7-892f-fda11bb365ce {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:02 devstack sudo[92002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cf34f225-ab9b-49a7-892f-fda11bb365ce
Apr 28 22:15:02 devstack sudo[92002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:03 devstack sudo[92002]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:03 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-05b43b35-d549-4b51-8ba4-60f8e3102c32 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cf34f225-ab9b-49a7-892f-fda11bb365ce" returned: 0 in 0.644s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:03 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-05b43b35-d549-4b51-8ba4-60f8e3102c32 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Lock "cinder-quobyte-cf34f225-ab9b-49a7-892f-fda11bb365ce" released by "delete_volume" :: held 1.523s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:15:03 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-05b43b35-d549-4b51-8ba4-60f8e3102c32 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Created reservations ['b71ef3a7-7eef-4ae1-a16c-1c0b02ed917b', 'e2b627b9-d60e-46e8-b3c5-bbe9ffd07d72', '2399f93a-dc3e-467b-bffb-4c6f7e88946c', '86f3e0fb-5701-4c8a-9f96-a4d77d09a7f0'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:15:03 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-05b43b35-d549-4b51-8ba4-60f8e3102c32 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:15:03 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-05b43b35-d549-4b51-8ba4-60f8e3102c32 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:15:03 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-05b43b35-d549-4b51-8ba4-60f8e3102c32 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:15:03 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-05b43b35-d549-4b51-8ba4-60f8e3102c32 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:15:03 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-05b43b35-d549-4b51-8ba4-60f8e3102c32 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:15:03 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-05b43b35-d549-4b51-8ba4-60f8e3102c32 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:03 devstack sudo[92006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:15:03 devstack sudo[92006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:04 devstack sudo[92006]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:04 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-05b43b35-d549-4b51-8ba4-60f8e3102c32 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.647s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:04 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-05b43b35-d549-4b51-8ba4-60f8e3102c32 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:15:04 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-05b43b35-d549-4b51-8ba4-60f8e3102c32 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Deleted volume successfully.
Apr 28 22:15:04 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-05b43b35-d549-4b51-8ba4-60f8e3102c32 tempest-VolumesSnapshotNegativeTestJSON-1992622063 None] Lock "cinder-cf34f225-ab9b-49a7-892f-fda11bb365ce-delete_volume" released by "delete_volume" :: held 2.393s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:15:05 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7679847-e13b-4bd2-a13b-db13f8a843dd tempest-VolumesExtendTest-1115418900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:15:05 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f7679847-e13b-4bd2-a13b-db13f8a843dd tempest-VolumesExtendTest-1115418900 None] Flow 'volume_create_manager' (5d7e9c08-335c-45f9-baa0-d2fbc3600014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:15:05 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f7679847-e13b-4bd2-a13b-db13f8a843dd tempest-VolumesExtendTest-1115418900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e69a6ac-6de8-4b14-a27e-d2d10f0f9939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:15:05 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f7679847-e13b-4bd2-a13b-db13f8a843dd tempest-VolumesExtendTest-1115418900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e69a6ac-6de8-4b14-a27e-d2d10f0f9939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:15:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-419230504',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bf6ca01-96ff-4763-8cc9-0e5c2e79bd9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c15cfee07f994cf1a2cd5c02fb8cdd3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:15:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:15:06Z,use_quota=True,user_id='561e0cccae55410c995caa773f6f6c54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:15:05 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f7679847-e13b-4bd2-a13b-db13f8a843dd tempest-VolumesExtendTest-1115418900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2805b88-12a5-4c4f-9e8a-c86640ba5d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:15:05 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f7679847-e13b-4bd2-a13b-db13f8a843dd tempest-VolumesExtendTest-1115418900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2805b88-12a5-4c4f-9e8a-c86640ba5d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:15:05 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f7679847-e13b-4bd2-a13b-db13f8a843dd tempest-VolumesExtendTest-1115418900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f075944-faa1-42da-932f-5b043bf98fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:15:05 devstack cinder-volume[83924]: DEBUG cinder.image.glance [None req-f7679847-e13b-4bd2-a13b-db13f8a843dd tempest-VolumesExtendTest-1115418900 None] Creating Keystone auth plugin from conf {{(pid=83924) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 28 22:15:06 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f7679847-e13b-4bd2-a13b-db13f8a843dd tempest-VolumesExtendTest-1115418900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f075944-faa1-42da-932f-5b043bf98fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3bf6ca01-96ff-4763-8cc9-0e5c2e79bd9a', 'volume_name': 'volume-3bf6ca01-96ff-4763-8cc9-0e5c2e79bd9a', 'volume_size': 1, 'image_id': 'eea3f98a-f64b-4ae5-950b-6d03ae89a234', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eea3f98a-f64b-4ae5-950b-6d03ae89a234', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c4919824590f4575ada7761aea13c85e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eea3f98a-f64b-4ae5-950b-6d03ae89a234', 'created_at': datetime.datetime(2026, 4, 28, 19, 59, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 19, 59, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eea3f98a-f64b-4ae5-950b-6d03ae89a234/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7844d599c7a0>}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:15:06 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f7679847-e13b-4bd2-a13b-db13f8a843dd tempest-VolumesExtendTest-1115418900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e36da8e9-610a-45d2-aa86-8dab5292d71d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:15:06 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f7679847-e13b-4bd2-a13b-db13f8a843dd tempest-VolumesExtendTest-1115418900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e36da8e9-610a-45d2-aa86-8dab5292d71d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:15:06 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f7679847-e13b-4bd2-a13b-db13f8a843dd tempest-VolumesExtendTest-1115418900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93ace879-f42e-43fe-a7cb-1f71a55bc0d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:15:06 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-f7679847-e13b-4bd2-a13b-db13f8a843dd tempest-VolumesExtendTest-1115418900 None] Volume 3bf6ca01-96ff-4763-8cc9-0e5c2e79bd9a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3bf6ca01-96ff-4763-8cc9-0e5c2e79bd9a', 'volume_size': 1, 'image_id': 'eea3f98a-f64b-4ae5-950b-6d03ae89a234', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eea3f98a-f64b-4ae5-950b-6d03ae89a234', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c4919824590f4575ada7761aea13c85e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eea3f98a-f64b-4ae5-950b-6d03ae89a234', 'created_at': datetime.datetime(2026, 4, 28, 19, 59, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 19, 59, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eea3f98a-f64b-4ae5-950b-6d03ae89a234/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7844d599c7a0>}
Apr 28 22:15:06 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7679847-e13b-4bd2-a13b-db13f8a843dd tempest-VolumesExtendTest-1115418900 None] Trying to clone 3bf6ca01-96ff-4763-8cc9-0e5c2e79bd9a from image eea3f98a-f64b-4ae5-950b-6d03ae89a234 at location (None, [{'url': 'file:///opt/stack/data/glance/images/eea3f98a-f64b-4ae5-950b-6d03ae89a234', 'metadata': {}}]). {{(pid=83924) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 28 22:15:06 devstack cinder-volume[83924]: DEBUG cinder.image.image_utils [None req-f7679847-e13b-4bd2-a13b-db13f8a843dd tempest-VolumesExtendTest-1115418900 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_eea3f98a-f64b-4ae5-950b-6d03ae89a234__ygj6os0devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83924) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 28 22:15:06 devstack cinder-volume[83924]: INFO cinder.image.image_utils [None req-f7679847-e13b-4bd2-a13b-db13f8a843dd tempest-VolumesExtendTest-1115418900 None] Image download 20.69 MB at 20.69 MB/s
Apr 28 22:15:06 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[326d1ddd-f3a0-46e2-a6f7-b004677f4286]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:15:06 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f7679847-e13b-4bd2-a13b-db13f8a843dd tempest-VolumesExtendTest-1115418900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eea3f98a-f64b-4ae5-950b-6d03ae89a234__ygj6os0devstack@QuobyteHD {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:06 devstack sudo[92010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eea3f98a-f64b-4ae5-950b-6d03ae89a234__ygj6os0devstack@QuobyteHD
Apr 28 22:15:06 devstack sudo[92010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:07 devstack cinder-volume[83924]: DEBUG dbcounter [-] [83924] Writing DB stats cinder:DELETE=14,cinder:UPDATE=128,cinder:SELECT=100,cinder:INSERT=38 {{(pid=83924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 28 22:15:07 devstack cinder-volume[83924]: DEBUG dbcounter [-] [83924] Writing DB stats cinder:UPDATE=149,cinder:SELECT=126,cinder:INSERT=34,cinder:DELETE=8 {{(pid=83924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 28 22:15:07 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-a27e7881-9e68-4a73-843d-01449b6b079c tempest-VolumeDependencyTests-1470240070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:15:07 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a27e7881-9e68-4a73-843d-01449b6b079c tempest-VolumeDependencyTests-1470240070 None] Flow 'volume_create_manager' (7194d728-40df-4e99-8b84-87e9db5caa07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:15:07 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a27e7881-9e68-4a73-843d-01449b6b079c tempest-VolumeDependencyTests-1470240070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83f00569-275a-4c86-97f9-1db0ceb1df04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:15:07 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a27e7881-9e68-4a73-843d-01449b6b079c tempest-VolumeDependencyTests-1470240070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83f00569-275a-4c86-97f9-1db0ceb1df04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:15:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-766041792',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6bf547a-89da-4c5d-82fe-0e9e119f2595,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab3233b47a1540f797d02def6f1af93f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:15:07Z,use_quota=True,user_id='8408db8ca5c0456ca818e9f43244133e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:15:07 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a27e7881-9e68-4a73-843d-01449b6b079c tempest-VolumeDependencyTests-1470240070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (513aa2a6-fc1e-47f8-a388-eaf0e1e5562f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:15:07 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a27e7881-9e68-4a73-843d-01449b6b079c tempest-VolumeDependencyTests-1470240070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (513aa2a6-fc1e-47f8-a388-eaf0e1e5562f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:15:07 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a27e7881-9e68-4a73-843d-01449b6b079c tempest-VolumeDependencyTests-1470240070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5750a1a5-30af-4c57-b95e-4ad8a161a084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:15:07 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a27e7881-9e68-4a73-843d-01449b6b079c tempest-VolumeDependencyTests-1470240070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5750a1a5-30af-4c57-b95e-4ad8a161a084) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6bf547a-89da-4c5d-82fe-0e9e119f2595', 'volume_name': 'volume-a6bf547a-89da-4c5d-82fe-0e9e119f2595', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:15:07 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a27e7881-9e68-4a73-843d-01449b6b079c tempest-VolumeDependencyTests-1470240070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fad7db81-5444-41df-baff-ff96136117d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:15:07 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a27e7881-9e68-4a73-843d-01449b6b079c tempest-VolumeDependencyTests-1470240070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fad7db81-5444-41df-baff-ff96136117d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:15:07 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a27e7881-9e68-4a73-843d-01449b6b079c tempest-VolumeDependencyTests-1470240070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1faed3e-0c47-4c1e-b309-8a5dd822e955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:15:07 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-a27e7881-9e68-4a73-843d-01449b6b079c tempest-VolumeDependencyTests-1470240070 None] Volume a6bf547a-89da-4c5d-82fe-0e9e119f2595: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6bf547a-89da-4c5d-82fe-0e9e119f2595', 'volume_size': 1}
Apr 28 22:15:07 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-a27e7881-9e68-4a73-843d-01449b6b079c tempest-VolumeDependencyTests-1470240070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:15:07 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-a27e7881-9e68-4a73-843d-01449b6b079c tempest-VolumeDependencyTests-1470240070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:15:07 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-a27e7881-9e68-4a73-843d-01449b6b079c tempest-VolumeDependencyTests-1470240070 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:15:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-766041792',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6bf547a-89da-4c5d-82fe-0e9e119f2595,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab3233b47a1540f797d02def6f1af93f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:15:07Z,use_quota=True,user_id='8408db8ca5c0456ca818e9f43244133e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:15:07 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-a27e7881-9e68-4a73-843d-01449b6b079c tempest-VolumeDependencyTests-1470240070 None] Creating volume a6bf547a-89da-4c5d-82fe-0e9e119f2595 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:15:07 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-a27e7881-9e68-4a73-843d-01449b6b079c tempest-VolumeDependencyTests-1470240070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:15:07 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-a27e7881-9e68-4a73-843d-01449b6b079c tempest-VolumeDependencyTests-1470240070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:15:07 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-a27e7881-9e68-4a73-843d-01449b6b079c tempest-VolumeDependencyTests-1470240070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:15:07 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-a27e7881-9e68-4a73-843d-01449b6b079c tempest-VolumeDependencyTests-1470240070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:15:07 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-a27e7881-9e68-4a73-843d-01449b6b079c tempest-VolumeDependencyTests-1470240070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:15:07 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-a27e7881-9e68-4a73-843d-01449b6b079c tempest-VolumeDependencyTests-1470240070 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:15:07 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-a27e7881-9e68-4a73-843d-01449b6b079c tempest-VolumeDependencyTests-1470240070 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:15:07 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a27e7881-9e68-4a73-843d-01449b6b079c tempest-VolumeDependencyTests-1470240070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a6bf547a-89da-4c5d-82fe-0e9e119f2595 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:07 devstack sudo[92012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a6bf547a-89da-4c5d-82fe-0e9e119f2595 1073741824
Apr 28 22:15:07 devstack sudo[92012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:07 devstack sudo[92010]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:07 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f7679847-e13b-4bd2-a13b-db13f8a843dd tempest-VolumesExtendTest-1115418900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eea3f98a-f64b-4ae5-950b-6d03ae89a234__ygj6os0devstack@QuobyteHD" returned: 0 in 0.683s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:07 devstack cinder-volume[83924]: DEBUG cinder.image.image_utils [None req-f7679847-e13b-4bd2-a13b-db13f8a843dd tempest-VolumesExtendTest-1115418900 None] Temporary image eea3f98a-f64b-4ae5-950b-6d03ae89a234 is fetched for user 561e0cccae55410c995caa773f6f6c54. {{(pid=83924) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 28 22:15:07 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f66047-4c2c-4901-a355-79095856f6de]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:15:07 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f7679847-e13b-4bd2-a13b-db13f8a843dd tempest-VolumesExtendTest-1115418900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eea3f98a-f64b-4ae5-950b-6d03ae89a234__ygj6os0devstack@QuobyteHD {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:07 devstack sudo[92017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eea3f98a-f64b-4ae5-950b-6d03ae89a234__ygj6os0devstack@QuobyteHD
Apr 28 22:15:07 devstack sudo[92017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:07 devstack sudo[92012]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:07 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a27e7881-9e68-4a73-843d-01449b6b079c tempest-VolumeDependencyTests-1470240070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a6bf547a-89da-4c5d-82fe-0e9e119f2595 1073741824" returned: 0 in 0.790s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:07 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a27e7881-9e68-4a73-843d-01449b6b079c tempest-VolumeDependencyTests-1470240070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a6bf547a-89da-4c5d-82fe-0e9e119f2595 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:07 devstack sudo[92025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a6bf547a-89da-4c5d-82fe-0e9e119f2595
Apr 28 22:15:07 devstack sudo[92025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:07 devstack sudo[92017]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:07 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f7679847-e13b-4bd2-a13b-db13f8a843dd tempest-VolumesExtendTest-1115418900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eea3f98a-f64b-4ae5-950b-6d03ae89a234__ygj6os0devstack@QuobyteHD" returned: 0 in 0.676s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:07 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f7679847-e13b-4bd2-a13b-db13f8a843dd tempest-VolumesExtendTest-1115418900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:15:08 devstack sudo[92025]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:08 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a27e7881-9e68-4a73-843d-01449b6b079c tempest-VolumeDependencyTests-1470240070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a6bf547a-89da-4c5d-82fe-0e9e119f2595" returned: 0 in 0.592s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:08 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-a27e7881-9e68-4a73-843d-01449b6b079c tempest-VolumeDependencyTests-1470240070 None] <== create_volume: return (1425ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:15:08 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-a27e7881-9e68-4a73-843d-01449b6b079c tempest-VolumeDependencyTests-1470240070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.428s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:15:08 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f7679847-e13b-4bd2-a13b-db13f8a843dd tempest-VolumesExtendTest-1115418900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.561s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:15:08 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-f7679847-e13b-4bd2-a13b-db13f8a843dd tempest-VolumesExtendTest-1115418900 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:15:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-419230504',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bf6ca01-96ff-4763-8cc9-0e5c2e79bd9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c15cfee07f994cf1a2cd5c02fb8cdd3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:15:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:15:06Z,use_quota=True,user_id='561e0cccae55410c995caa773f6f6c54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:15:08 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-f7679847-e13b-4bd2-a13b-db13f8a843dd tempest-VolumesExtendTest-1115418900 None] Creating volume 3bf6ca01-96ff-4763-8cc9-0e5c2e79bd9a {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:15:08 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f7679847-e13b-4bd2-a13b-db13f8a843dd tempest-VolumesExtendTest-1115418900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:15:08 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f7679847-e13b-4bd2-a13b-db13f8a843dd tempest-VolumesExtendTest-1115418900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:15:08 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-f7679847-e13b-4bd2-a13b-db13f8a843dd tempest-VolumesExtendTest-1115418900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:15:08 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-f7679847-e13b-4bd2-a13b-db13f8a843dd tempest-VolumesExtendTest-1115418900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:15:08 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f7679847-e13b-4bd2-a13b-db13f8a843dd tempest-VolumesExtendTest-1115418900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:15:08 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-f7679847-e13b-4bd2-a13b-db13f8a843dd tempest-VolumesExtendTest-1115418900 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:15:08 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-f7679847-e13b-4bd2-a13b-db13f8a843dd tempest-VolumesExtendTest-1115418900 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:15:08 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f7679847-e13b-4bd2-a13b-db13f8a843dd tempest-VolumesExtendTest-1115418900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3bf6ca01-96ff-4763-8cc9-0e5c2e79bd9a 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:08 devstack sudo[92028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3bf6ca01-96ff-4763-8cc9-0e5c2e79bd9a 1073741824
Apr 28 22:15:08 devstack sudo[92028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:08 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a27e7881-9e68-4a73-843d-01449b6b079c tempest-VolumeDependencyTests-1470240070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1faed3e-0c47-4c1e-b309-8a5dd822e955) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6bf547a-89da-4c5d-82fe-0e9e119f2595', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:15:08 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a27e7881-9e68-4a73-843d-01449b6b079c tempest-VolumeDependencyTests-1470240070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (267ccbcf-14cd-45c3-8cbd-f96b50ddd551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:15:08 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-a27e7881-9e68-4a73-843d-01449b6b079c tempest-VolumeDependencyTests-1470240070 None] Volume volume-a6bf547a-89da-4c5d-82fe-0e9e119f2595 (a6bf547a-89da-4c5d-82fe-0e9e119f2595): created successfully
Apr 28 22:15:08 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a27e7881-9e68-4a73-843d-01449b6b079c tempest-VolumeDependencyTests-1470240070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (267ccbcf-14cd-45c3-8cbd-f96b50ddd551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:15:08 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a27e7881-9e68-4a73-843d-01449b6b079c tempest-VolumeDependencyTests-1470240070 None] Flow 'volume_create_manager' (7194d728-40df-4e99-8b84-87e9db5caa07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:15:08 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-a27e7881-9e68-4a73-843d-01449b6b079c tempest-VolumeDependencyTests-1470240070 None] Created volume successfully.
Apr 28 22:15:09 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-5cd6d9d0-0d9d-4664-a325-0a7a5a16dafe tempest-VolumeDependencyTests-1470240070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:15:09 devstack sudo[92028]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:09 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f7679847-e13b-4bd2-a13b-db13f8a843dd tempest-VolumesExtendTest-1115418900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3bf6ca01-96ff-4763-8cc9-0e5c2e79bd9a 1073741824" returned: 0 in 0.872s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:09 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f7679847-e13b-4bd2-a13b-db13f8a843dd tempest-VolumesExtendTest-1115418900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3bf6ca01-96ff-4763-8cc9-0e5c2e79bd9a {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:09 devstack sudo[92034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3bf6ca01-96ff-4763-8cc9-0e5c2e79bd9a
Apr 28 22:15:09 devstack sudo[92034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:10 devstack sudo[92034]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:10 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f7679847-e13b-4bd2-a13b-db13f8a843dd tempest-VolumesExtendTest-1115418900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3bf6ca01-96ff-4763-8cc9-0e5c2e79bd9a" returned: 0 in 0.589s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:10 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-f7679847-e13b-4bd2-a13b-db13f8a843dd tempest-VolumesExtendTest-1115418900 None] <== create_volume: return (1499ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:15:10 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f7679847-e13b-4bd2-a13b-db13f8a843dd tempest-VolumesExtendTest-1115418900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.503s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:15:10 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-5cd6d9d0-0d9d-4664-a325-0a7a5a16dafe tempest-VolumeDependencyTests-1470240070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.742s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:15:10 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-5cd6d9d0-0d9d-4664-a325-0a7a5a16dafe tempest-VolumeDependencyTests-1470240070 None] Creating offline snapshot 1f1eabe6-8325-4f55-8386-fa1014e87524 of volume a6bf547a-89da-4c5d-82fe-0e9e119f2595 {{(pid=83924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 22:15:10 devstack cinder-volume[83924]: DEBUG cinder.volume.volume_utils [None req-f7679847-e13b-4bd2-a13b-db13f8a843dd tempest-VolumesExtendTest-1115418900 None] Attempting download of eea3f98a-f64b-4ae5-950b-6d03ae89a234 ((None, [{'url': 'file:///opt/stack/data/glance/images/eea3f98a-f64b-4ae5-950b-6d03ae89a234', 'metadata': {}}])) to volume 3bf6ca01-96ff-4763-8cc9-0e5c2e79bd9a. {{(pid=83924) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 28 22:15:10 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e400add-db98-4ef2-9134-eaebc209a539]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:15:10 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5cd6d9d0-0d9d-4664-a325-0a7a5a16dafe tempest-VolumeDependencyTests-1470240070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a6bf547a-89da-4c5d-82fe-0e9e119f2595 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:10 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9b15de-2582-4d42-83b0-c2daf570399c]: (4, 'raw') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:15:10 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f7679847-e13b-4bd2-a13b-db13f8a843dd tempest-VolumesExtendTest-1115418900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eea3f98a-f64b-4ae5-950b-6d03ae89a234_r5obxhqn {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:10 devstack sudo[92037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a6bf547a-89da-4c5d-82fe-0e9e119f2595
Apr 28 22:15:10 devstack sudo[92037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:10 devstack sudo[92038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eea3f98a-f64b-4ae5-950b-6d03ae89a234_r5obxhqn
Apr 28 22:15:10 devstack sudo[92038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:10 devstack sudo[92037]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:10 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5cd6d9d0-0d9d-4664-a325-0a7a5a16dafe tempest-VolumeDependencyTests-1470240070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a6bf547a-89da-4c5d-82fe-0e9e119f2595" returned: 0 in 0.691s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:10 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5cd6d9d0-0d9d-4664-a325-0a7a5a16dafe tempest-VolumeDependencyTests-1470240070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a6bf547a-89da-4c5d-82fe-0e9e119f2595,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a6bf547a-89da-4c5d-82fe-0e9e119f2595.1f1eabe6-8325-4f55-8386-fa1014e87524 1G {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:10 devstack sudo[92046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a6bf547a-89da-4c5d-82fe-0e9e119f2595,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a6bf547a-89da-4c5d-82fe-0e9e119f2595.1f1eabe6-8325-4f55-8386-fa1014e87524 1G
Apr 28 22:15:10 devstack sudo[92046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:10 devstack sudo[92038]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:10 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f7679847-e13b-4bd2-a13b-db13f8a843dd tempest-VolumesExtendTest-1115418900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eea3f98a-f64b-4ae5-950b-6d03ae89a234_r5obxhqn" returned: 0 in 0.704s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:10 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f7679847-e13b-4bd2-a13b-db13f8a843dd tempest-VolumesExtendTest-1115418900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eea3f98a-f64b-4ae5-950b-6d03ae89a234_r5obxhqn {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:10 devstack sudo[92048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eea3f98a-f64b-4ae5-950b-6d03ae89a234_r5obxhqn
Apr 28 22:15:10 devstack sudo[92048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:11 devstack sudo[92046]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:11 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5cd6d9d0-0d9d-4664-a325-0a7a5a16dafe tempest-VolumeDependencyTests-1470240070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a6bf547a-89da-4c5d-82fe-0e9e119f2595,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a6bf547a-89da-4c5d-82fe-0e9e119f2595.1f1eabe6-8325-4f55-8386-fa1014e87524 1G" returned: 0 in 0.736s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:11 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5cd6d9d0-0d9d-4664-a325-0a7a5a16dafe tempest-VolumeDependencyTests-1470240070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6bf547a-89da-4c5d-82fe-0e9e119f2595 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a6bf547a-89da-4c5d-82fe-0e9e119f2595.1f1eabe6-8325-4f55-8386-fa1014e87524 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:11 devstack sudo[92055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6bf547a-89da-4c5d-82fe-0e9e119f2595 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a6bf547a-89da-4c5d-82fe-0e9e119f2595.1f1eabe6-8325-4f55-8386-fa1014e87524
Apr 28 22:15:11 devstack sudo[92048]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:11 devstack sudo[92055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:11 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f7679847-e13b-4bd2-a13b-db13f8a843dd tempest-VolumesExtendTest-1115418900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eea3f98a-f64b-4ae5-950b-6d03ae89a234_r5obxhqn" returned: 1 in 0.703s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:11 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f7679847-e13b-4bd2-a13b-db13f8a843dd tempest-VolumesExtendTest-1115418900 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eea3f98a-f64b-4ae5-950b-6d03ae89a234_r5obxhqn' failed. Not Retrying. {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 28 22:15:11 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9efe4af2-fa47-4d08-9ced-e9dcc773e141]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:15:11 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f7679847-e13b-4bd2-a13b-db13f8a843dd tempest-VolumesExtendTest-1115418900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eea3f98a-f64b-4ae5-950b-6d03ae89a234__ygj6os0devstack@QuobyteHD {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:11 devstack sudo[92057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eea3f98a-f64b-4ae5-950b-6d03ae89a234__ygj6os0devstack@QuobyteHD
Apr 28 22:15:11 devstack sudo[92057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:12 devstack sudo[92055]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:12 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5cd6d9d0-0d9d-4664-a325-0a7a5a16dafe tempest-VolumeDependencyTests-1470240070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6bf547a-89da-4c5d-82fe-0e9e119f2595 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a6bf547a-89da-4c5d-82fe-0e9e119f2595.1f1eabe6-8325-4f55-8386-fa1014e87524" returned: 0 in 0.675s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:12 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-5cd6d9d0-0d9d-4664-a325-0a7a5a16dafe tempest-VolumeDependencyTests-1470240070 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a6bf547a-89da-4c5d-82fe-0e9e119f2595.1f1eabe6-8325-4f55-8386-fa1014e87524 is being set with open permissions: ugo+rw
Apr 28 22:15:12 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5cd6d9d0-0d9d-4664-a325-0a7a5a16dafe tempest-VolumeDependencyTests-1470240070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a6bf547a-89da-4c5d-82fe-0e9e119f2595.1f1eabe6-8325-4f55-8386-fa1014e87524 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:12 devstack sudo[92065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a6bf547a-89da-4c5d-82fe-0e9e119f2595.1f1eabe6-8325-4f55-8386-fa1014e87524
Apr 28 22:15:12 devstack sudo[92065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:12 devstack sudo[92057]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:12 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f7679847-e13b-4bd2-a13b-db13f8a843dd tempest-VolumesExtendTest-1115418900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eea3f98a-f64b-4ae5-950b-6d03ae89a234__ygj6os0devstack@QuobyteHD" returned: 0 in 0.715s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:12 devstack cinder-volume[83924]: DEBUG cinder.image.image_utils [None req-f7679847-e13b-4bd2-a13b-db13f8a843dd tempest-VolumesExtendTest-1115418900 None] eea3f98a-f64b-4ae5-950b-6d03ae89a234 was qcow2, converting to raw {{(pid=83924) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 28 22:15:12 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f7679847-e13b-4bd2-a13b-db13f8a843dd tempest-VolumesExtendTest-1115418900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eea3f98a-f64b-4ae5-950b-6d03ae89a234__ygj6os0devstack@QuobyteHD /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3bf6ca01-96ff-4763-8cc9-0e5c2e79bd9a {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:12 devstack sudo[92067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eea3f98a-f64b-4ae5-950b-6d03ae89a234__ygj6os0devstack@QuobyteHD /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3bf6ca01-96ff-4763-8cc9-0e5c2e79bd9a
Apr 28 22:15:12 devstack sudo[92067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:12 devstack sudo[92065]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:12 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5cd6d9d0-0d9d-4664-a325-0a7a5a16dafe tempest-VolumeDependencyTests-1470240070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a6bf547a-89da-4c5d-82fe-0e9e119f2595.1f1eabe6-8325-4f55-8386-fa1014e87524" returned: 0 in 0.556s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:12 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5cd6d9d0-0d9d-4664-a325-0a7a5a16dafe tempest-VolumeDependencyTests-1470240070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a6bf547a-89da-4c5d-82fe-0e9e119f2595.info {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:12 devstack sudo[92071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a6bf547a-89da-4c5d-82fe-0e9e119f2595.info
Apr 28 22:15:12 devstack sudo[92071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:13 devstack sudo[92071]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:13 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5cd6d9d0-0d9d-4664-a325-0a7a5a16dafe tempest-VolumeDependencyTests-1470240070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a6bf547a-89da-4c5d-82fe-0e9e119f2595.info" returned: 0 in 0.697s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:13 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-5cd6d9d0-0d9d-4664-a325-0a7a5a16dafe tempest-VolumeDependencyTests-1470240070 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a6bf547a-89da-4c5d-82fe-0e9e119f2595.info is being set with open permissions: ugo+rw
Apr 28 22:15:13 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5cd6d9d0-0d9d-4664-a325-0a7a5a16dafe tempest-VolumeDependencyTests-1470240070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a6bf547a-89da-4c5d-82fe-0e9e119f2595.info {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:13 devstack sudo[92085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a6bf547a-89da-4c5d-82fe-0e9e119f2595.info
Apr 28 22:15:13 devstack sudo[92085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:14 devstack sudo[92067]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:14 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f7679847-e13b-4bd2-a13b-db13f8a843dd tempest-VolumesExtendTest-1115418900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eea3f98a-f64b-4ae5-950b-6d03ae89a234__ygj6os0devstack@QuobyteHD /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3bf6ca01-96ff-4763-8cc9-0e5c2e79bd9a" returned: 0 in 1.826s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:14 devstack cinder-volume[83924]: DEBUG cinder.image.image_utils [None req-f7679847-e13b-4bd2-a13b-db13f8a843dd tempest-VolumesExtendTest-1115418900 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_eea3f98a-f64b-4ae5-950b-6d03ae89a234__ygj6os0devstack@QuobyteHD, size 112.00 MB, duration 1.83 sec, destination /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3bf6ca01-96ff-4763-8cc9-0e5c2e79bd9a {{(pid=83924) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 28 22:15:14 devstack cinder-volume[83924]: INFO cinder.image.image_utils [None req-f7679847-e13b-4bd2-a13b-db13f8a843dd tempest-VolumesExtendTest-1115418900 None] Converted 112.00 MB image at 61.24 MB/s
Apr 28 22:15:14 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f7679847-e13b-4bd2-a13b-db13f8a843dd tempest-VolumesExtendTest-1115418900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3bf6ca01-96ff-4763-8cc9-0e5c2e79bd9a 1G {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:14 devstack sudo[92088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3bf6ca01-96ff-4763-8cc9-0e5c2e79bd9a 1G
Apr 28 22:15:14 devstack sudo[92088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:14 devstack sudo[92085]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:14 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5cd6d9d0-0d9d-4664-a325-0a7a5a16dafe tempest-VolumeDependencyTests-1470240070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a6bf547a-89da-4c5d-82fe-0e9e119f2595.info" returned: 0 in 0.675s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:14 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-5cd6d9d0-0d9d-4664-a325-0a7a5a16dafe tempest-VolumeDependencyTests-1470240070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.135s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:15:14 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-5cd6d9d0-0d9d-4664-a325-0a7a5a16dafe tempest-VolumeDependencyTests-1470240070 None] Create snapshot completed successfully
Apr 28 22:15:14 devstack sudo[92088]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:14 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f7679847-e13b-4bd2-a13b-db13f8a843dd tempest-VolumesExtendTest-1115418900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3bf6ca01-96ff-4763-8cc9-0e5c2e79bd9a 1G" returned: 0 in 0.645s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:14 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ff633f-8c15-4b15-9e9e-0cd9d8352a73]: (4, 'raw') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:15:14 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f7679847-e13b-4bd2-a13b-db13f8a843dd tempest-VolumesExtendTest-1115418900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3bf6ca01-96ff-4763-8cc9-0e5c2e79bd9a {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:14 devstack sudo[92093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3bf6ca01-96ff-4763-8cc9-0e5c2e79bd9a
Apr 28 22:15:14 devstack sudo[92093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:14 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-1056aa54-6946-4256-a6bd-507c02d307df tempest-VolumeDependencyTests-1470240070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:15:15 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-1056aa54-6946-4256-a6bd-507c02d307df tempest-VolumeDependencyTests-1470240070 None] Flow 'volume_create_manager' (62706981-8b6a-4593-849c-776a06aca0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:15:15 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-1056aa54-6946-4256-a6bd-507c02d307df tempest-VolumeDependencyTests-1470240070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (941b92ec-b90f-4b88-aab4-983fdc6d05fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:15:15 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-1056aa54-6946-4256-a6bd-507c02d307df tempest-VolumeDependencyTests-1470240070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (941b92ec-b90f-4b88-aab4-983fdc6d05fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:15:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-792131269',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0283d46-f96c-4cbe-a860-ead7969d4e7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab3233b47a1540f797d02def6f1af93f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:15:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1f1eabe6-8325-4f55-8386-fa1014e87524,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:15:15Z,use_quota=True,user_id='8408db8ca5c0456ca818e9f43244133e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:15:15 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-1056aa54-6946-4256-a6bd-507c02d307df tempest-VolumeDependencyTests-1470240070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccc96ced-86a5-4a6d-a6d2-677ac42fe008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:15:15 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-1056aa54-6946-4256-a6bd-507c02d307df tempest-VolumeDependencyTests-1470240070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccc96ced-86a5-4a6d-a6d2-677ac42fe008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:15:15 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-1056aa54-6946-4256-a6bd-507c02d307df tempest-VolumeDependencyTests-1470240070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d3d2cd4-7ead-4988-8cd4-a29819ec008c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:15:15 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-1056aa54-6946-4256-a6bd-507c02d307df tempest-VolumeDependencyTests-1470240070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d3d2cd4-7ead-4988-8cd4-a29819ec008c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e0283d46-f96c-4cbe-a860-ead7969d4e7b', 'volume_name': 'volume-e0283d46-f96c-4cbe-a860-ead7969d4e7b', 'volume_size': 1, 'snapshot_id': '1f1eabe6-8325-4f55-8386-fa1014e87524'}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:15:15 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-1056aa54-6946-4256-a6bd-507c02d307df tempest-VolumeDependencyTests-1470240070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2febbc36-fae9-4a20-99d2-64ea79b49caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:15:15 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-1056aa54-6946-4256-a6bd-507c02d307df tempest-VolumeDependencyTests-1470240070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2febbc36-fae9-4a20-99d2-64ea79b49caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:15:15 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-1056aa54-6946-4256-a6bd-507c02d307df tempest-VolumeDependencyTests-1470240070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f735957c-be82-4316-94a5-1cc594132f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:15:15 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-1056aa54-6946-4256-a6bd-507c02d307df tempest-VolumeDependencyTests-1470240070 None] Volume e0283d46-f96c-4cbe-a860-ead7969d4e7b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e0283d46-f96c-4cbe-a860-ead7969d4e7b', 'volume_size': 1, 'snapshot_id': '1f1eabe6-8325-4f55-8386-fa1014e87524'}
Apr 28 22:15:15 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-1056aa54-6946-4256-a6bd-507c02d307df tempest-VolumeDependencyTests-1470240070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:15:15 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-1056aa54-6946-4256-a6bd-507c02d307df tempest-VolumeDependencyTests-1470240070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:15:15 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-1056aa54-6946-4256-a6bd-507c02d307df tempest-VolumeDependencyTests-1470240070 None] Acquiring lock "cinder-quobyte-1f1eabe6-8325-4f55-8386-fa1014e87524-e0283d46-f96c-4cbe-a860-ead7969d4e7b" by "_create_volume_from_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:15:15 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-1056aa54-6946-4256-a6bd-507c02d307df tempest-VolumeDependencyTests-1470240070 None] Lock "cinder-quobyte-1f1eabe6-8325-4f55-8386-fa1014e87524-e0283d46-f96c-4cbe-a860-ead7969d4e7b" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:15:15 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-1056aa54-6946-4256-a6bd-507c02d307df tempest-VolumeDependencyTests-1470240070 None] Creating volume e0283d46-f96c-4cbe-a860-ead7969d4e7b from snapshot 1f1eabe6-8325-4f55-8386-fa1014e87524 {{(pid=83924) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 28 22:15:15 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-1056aa54-6946-4256-a6bd-507c02d307df tempest-VolumeDependencyTests-1470240070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:15:15 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-1056aa54-6946-4256-a6bd-507c02d307df tempest-VolumeDependencyTests-1470240070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:15:15 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-1056aa54-6946-4256-a6bd-507c02d307df tempest-VolumeDependencyTests-1470240070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:15:15 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-1056aa54-6946-4256-a6bd-507c02d307df tempest-VolumeDependencyTests-1470240070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:15:15 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-1056aa54-6946-4256-a6bd-507c02d307df tempest-VolumeDependencyTests-1470240070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:15:15 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-1056aa54-6946-4256-a6bd-507c02d307df tempest-VolumeDependencyTests-1470240070 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:15:15 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-1056aa54-6946-4256-a6bd-507c02d307df tempest-VolumeDependencyTests-1470240070 None] Acquiring lock "cinder-quobyte-e0283d46-f96c-4cbe-a860-ead7969d4e7b" by "_copy_volume_from_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:15:15 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-1056aa54-6946-4256-a6bd-507c02d307df tempest-VolumeDependencyTests-1470240070 None] Lock "cinder-quobyte-e0283d46-f96c-4cbe-a860-ead7969d4e7b" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:15:15 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-1056aa54-6946-4256-a6bd-507c02d307df tempest-VolumeDependencyTests-1470240070 None] snapshot: 1f1eabe6-8325-4f55-8386-fa1014e87524, volume: e0283d46-f96c-4cbe-a860-ead7969d4e7b,  {{(pid=83924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 28 22:15:15 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-1056aa54-6946-4256-a6bd-507c02d307df tempest-VolumeDependencyTests-1470240070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:15:15 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-1056aa54-6946-4256-a6bd-507c02d307df tempest-VolumeDependencyTests-1470240070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:15:15 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-1056aa54-6946-4256-a6bd-507c02d307df tempest-VolumeDependencyTests-1470240070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:15:15 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-1056aa54-6946-4256-a6bd-507c02d307df tempest-VolumeDependencyTests-1470240070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:15:15 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-1056aa54-6946-4256-a6bd-507c02d307df tempest-VolumeDependencyTests-1470240070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:15:15 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[136cf227-e9f5-4b88-ae7f-289ab90a1d5e]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:15:15 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-1056aa54-6946-4256-a6bd-507c02d307df tempest-VolumeDependencyTests-1470240070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a6bf547a-89da-4c5d-82fe-0e9e119f2595.1f1eabe6-8325-4f55-8386-fa1014e87524 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:15 devstack sudo[92095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a6bf547a-89da-4c5d-82fe-0e9e119f2595.1f1eabe6-8325-4f55-8386-fa1014e87524
Apr 28 22:15:15 devstack sudo[92095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:15 devstack sudo[92093]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:15 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f7679847-e13b-4bd2-a13b-db13f8a843dd tempest-VolumesExtendTest-1115418900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3bf6ca01-96ff-4763-8cc9-0e5c2e79bd9a" returned: 0 in 0.735s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:15 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f7679847-e13b-4bd2-a13b-db13f8a843dd tempest-VolumesExtendTest-1115418900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3bf6ca01-96ff-4763-8cc9-0e5c2e79bd9a {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:15 devstack sudo[92099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3bf6ca01-96ff-4763-8cc9-0e5c2e79bd9a
Apr 28 22:15:15 devstack sudo[92099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:15 devstack sudo[92095]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:15 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-1056aa54-6946-4256-a6bd-507c02d307df tempest-VolumeDependencyTests-1470240070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a6bf547a-89da-4c5d-82fe-0e9e119f2595.1f1eabe6-8325-4f55-8386-fa1014e87524" returned: 0 in 0.746s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:15 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-1056aa54-6946-4256-a6bd-507c02d307df tempest-VolumeDependencyTests-1470240070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6bf547a-89da-4c5d-82fe-0e9e119f2595(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 22:15:15 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-1056aa54-6946-4256-a6bd-507c02d307df tempest-VolumeDependencyTests-1470240070 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a6bf547a-89da-4c5d-82fe-0e9e119f2595 {{(pid=83924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 28 22:15:15 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-1056aa54-6946-4256-a6bd-507c02d307df tempest-VolumeDependencyTests-1470240070 None] Creating direct copy from snapshot {{(pid=83924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 28 22:15:15 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7487f0f-72ab-44c0-af0e-f90f9dfee5f1]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:15:15 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-1056aa54-6946-4256-a6bd-507c02d307df tempest-VolumeDependencyTests-1470240070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a6bf547a-89da-4c5d-82fe-0e9e119f2595 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:16 devstack sudo[92104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a6bf547a-89da-4c5d-82fe-0e9e119f2595
Apr 28 22:15:16 devstack sudo[92104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:16 devstack sudo[92099]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:16 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f7679847-e13b-4bd2-a13b-db13f8a843dd tempest-VolumesExtendTest-1115418900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3bf6ca01-96ff-4763-8cc9-0e5c2e79bd9a" returned: 1 in 0.683s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:16 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f7679847-e13b-4bd2-a13b-db13f8a843dd tempest-VolumesExtendTest-1115418900 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3bf6ca01-96ff-4763-8cc9-0e5c2e79bd9a' failed. Not Retrying. {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 28 22:15:16 devstack cinder-volume[83924]: DEBUG cinder.volume.volume_utils [None req-f7679847-e13b-4bd2-a13b-db13f8a843dd tempest-VolumesExtendTest-1115418900 None] Downloaded image eea3f98a-f64b-4ae5-950b-6d03ae89a234 ((None, [{'url': 'file:///opt/stack/data/glance/images/eea3f98a-f64b-4ae5-950b-6d03ae89a234', 'metadata': {}}])) to volume 3bf6ca01-96ff-4763-8cc9-0e5c2e79bd9a successfully. {{(pid=83924) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 28 22:15:16 devstack cinder-volume[83924]: DEBUG cinder.image.image_utils [None req-f7679847-e13b-4bd2-a13b-db13f8a843dd tempest-VolumesExtendTest-1115418900 None] Temporary image eea3f98a-f64b-4ae5-950b-6d03ae89a234 for user 561e0cccae55410c995caa773f6f6c54 is deleted. {{(pid=83924) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 28 22:15:16 devstack cinder-volume[83924]: DEBUG cinder.volume.volume_utils [None req-f7679847-e13b-4bd2-a13b-db13f8a843dd tempest-VolumesExtendTest-1115418900 None] Marking volume 3bf6ca01-96ff-4763-8cc9-0e5c2e79bd9a as bootable. {{(pid=83924) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 28 22:15:16 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7679847-e13b-4bd2-a13b-db13f8a843dd tempest-VolumesExtendTest-1115418900 None] Copying metadata from image eea3f98a-f64b-4ae5-950b-6d03ae89a234 to 3bf6ca01-96ff-4763-8cc9-0e5c2e79bd9a. {{(pid=83924) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 28 22:15:16 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7679847-e13b-4bd2-a13b-db13f8a843dd tempest-VolumesExtendTest-1115418900 None] Creating volume glance metadata for volume 3bf6ca01-96ff-4763-8cc9-0e5c2e79bd9a backed by image eea3f98a-f64b-4ae5-950b-6d03ae89a234 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'eea3f98a-f64b-4ae5-950b-6d03ae89a234', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83924) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 28 22:15:16 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f7679847-e13b-4bd2-a13b-db13f8a843dd tempest-VolumesExtendTest-1115418900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93ace879-f42e-43fe-a7cb-1f71a55bc0d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bf6ca01-96ff-4763-8cc9-0e5c2e79bd9a', 'volume_size': 1, 'image_id': 'eea3f98a-f64b-4ae5-950b-6d03ae89a234', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eea3f98a-f64b-4ae5-950b-6d03ae89a234', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c4919824590f4575ada7761aea13c85e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eea3f98a-f64b-4ae5-950b-6d03ae89a234', 'created_at': datetime.datetime(2026, 4, 28, 19, 59, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 19, 59, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eea3f98a-f64b-4ae5-950b-6d03ae89a234/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7844d599c7a0>}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:15:16 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f7679847-e13b-4bd2-a13b-db13f8a843dd tempest-VolumesExtendTest-1115418900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44404a8c-e66e-423e-961b-95cb600c9d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:15:16 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-f7679847-e13b-4bd2-a13b-db13f8a843dd tempest-VolumesExtendTest-1115418900 None] Volume volume-3bf6ca01-96ff-4763-8cc9-0e5c2e79bd9a (3bf6ca01-96ff-4763-8cc9-0e5c2e79bd9a): created successfully
Apr 28 22:15:16 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f7679847-e13b-4bd2-a13b-db13f8a843dd tempest-VolumesExtendTest-1115418900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44404a8c-e66e-423e-961b-95cb600c9d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:15:16 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f7679847-e13b-4bd2-a13b-db13f8a843dd tempest-VolumesExtendTest-1115418900 None] Flow 'volume_create_manager' (5d7e9c08-335c-45f9-baa0-d2fbc3600014) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:15:16 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-f7679847-e13b-4bd2-a13b-db13f8a843dd tempest-VolumesExtendTest-1115418900 None] Created volume successfully.
Apr 28 22:15:16 devstack sudo[92104]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:16 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-1056aa54-6946-4256-a6bd-507c02d307df tempest-VolumeDependencyTests-1470240070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a6bf547a-89da-4c5d-82fe-0e9e119f2595" returned: 0 in 0.705s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:16 devstack cinder-volume[83924]: DEBUG cinder.utils [None req-1056aa54-6946-4256-a6bd-507c02d307df tempest-VolumeDependencyTests-1470240070 None] Path /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-e0283d46-f96c-4cbe-a860-ead7969d4e7b not found in is_blk_device check {{(pid=83924) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 28 22:15:16 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-1056aa54-6946-4256-a6bd-507c02d307df tempest-VolumeDependencyTests-1470240070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a6bf547a-89da-4c5d-82fe-0e9e119f2595 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-e0283d46-f96c-4cbe-a860-ead7969d4e7b {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:16 devstack sudo[92112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a6bf547a-89da-4c5d-82fe-0e9e119f2595 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-e0283d46-f96c-4cbe-a860-ead7969d4e7b
Apr 28 22:15:16 devstack sudo[92112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:17 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b854d04d-7706-426a-af96-46489cb8d3f2 tempest-VolumesExtendTest-1115418900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:15:20 devstack sudo[92112]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-1056aa54-6946-4256-a6bd-507c02d307df tempest-VolumeDependencyTests-1470240070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a6bf547a-89da-4c5d-82fe-0e9e119f2595 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-e0283d46-f96c-4cbe-a860-ead7969d4e7b" returned: 0 in 4.263s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:20 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de38420-1bbe-42a7-8521-5ed92fb6aade]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:15:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-1056aa54-6946-4256-a6bd-507c02d307df tempest-VolumeDependencyTests-1470240070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a6bf547a-89da-4c5d-82fe-0e9e119f2595 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:21 devstack sudo[92124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a6bf547a-89da-4c5d-82fe-0e9e119f2595
Apr 28 22:15:21 devstack sudo[92124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:21 devstack sudo[92124]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:21 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-1056aa54-6946-4256-a6bd-507c02d307df tempest-VolumeDependencyTests-1470240070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a6bf547a-89da-4c5d-82fe-0e9e119f2595" returned: 0 in 0.848s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:21 devstack cinder-volume[83924]: DEBUG cinder.image.image_utils [None req-1056aa54-6946-4256-a6bd-507c02d307df tempest-VolumeDependencyTests-1470240070 None] Image conversion details: src /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a6bf547a-89da-4c5d-82fe-0e9e119f2595, size 1024.00 MB, duration 4.26 sec, destination /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-e0283d46-f96c-4cbe-a860-ead7969d4e7b {{(pid=83924) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 28 22:15:21 devstack cinder-volume[83924]: INFO cinder.image.image_utils [None req-1056aa54-6946-4256-a6bd-507c02d307df tempest-VolumeDependencyTests-1470240070 None] Converted 1024.00 MB image at 240.17 MB/s
Apr 28 22:15:21 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-1056aa54-6946-4256-a6bd-507c02d307df tempest-VolumeDependencyTests-1470240070 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-e0283d46-f96c-4cbe-a860-ead7969d4e7b is being set with open permissions: ugo+rw
Apr 28 22:15:21 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-1056aa54-6946-4256-a6bd-507c02d307df tempest-VolumeDependencyTests-1470240070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-e0283d46-f96c-4cbe-a860-ead7969d4e7b {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:21 devstack sudo[92165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-e0283d46-f96c-4cbe-a860-ead7969d4e7b
Apr 28 22:15:21 devstack sudo[92165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:22 devstack sudo[92165]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:22 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-1056aa54-6946-4256-a6bd-507c02d307df tempest-VolumeDependencyTests-1470240070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-e0283d46-f96c-4cbe-a860-ead7969d4e7b" returned: 0 in 0.560s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:22 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-1056aa54-6946-4256-a6bd-507c02d307df tempest-VolumeDependencyTests-1470240070 None] Lock "cinder-quobyte-e0283d46-f96c-4cbe-a860-ead7969d4e7b" released by "_copy_volume_from_snapshot" :: held 7.214s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:15:22 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-1056aa54-6946-4256-a6bd-507c02d307df tempest-VolumeDependencyTests-1470240070 None] Lock "cinder-quobyte-1f1eabe6-8325-4f55-8386-fa1014e87524-e0283d46-f96c-4cbe-a860-ead7969d4e7b" released by "_create_volume_from_snapshot" :: held 7.245s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:15:22 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-1056aa54-6946-4256-a6bd-507c02d307df tempest-VolumeDependencyTests-1470240070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.261s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:15:22 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b854d04d-7706-426a-af96-46489cb8d3f2 tempest-VolumesExtendTest-1115418900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 4.459s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:15:22 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-1056aa54-6946-4256-a6bd-507c02d307df tempest-VolumeDependencyTests-1470240070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f735957c-be82-4316-94a5-1cc594132f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0283d46-f96c-4cbe-a860-ead7969d4e7b', 'volume_size': 1, 'snapshot_id': '1f1eabe6-8325-4f55-8386-fa1014e87524'}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:15:22 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-1056aa54-6946-4256-a6bd-507c02d307df tempest-VolumeDependencyTests-1470240070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c5b498f-2cbf-4bdb-bc67-804bed9c70c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:15:22 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd39a13-77ae-484e-9ca5-91fd28b97497]: (4, 'raw') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:15:22 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b854d04d-7706-426a-af96-46489cb8d3f2 tempest-VolumesExtendTest-1115418900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3bf6ca01-96ff-4763-8cc9-0e5c2e79bd9a {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:22 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-1056aa54-6946-4256-a6bd-507c02d307df tempest-VolumeDependencyTests-1470240070 None] Volume volume-e0283d46-f96c-4cbe-a860-ead7969d4e7b (e0283d46-f96c-4cbe-a860-ead7969d4e7b): created successfully
Apr 28 22:15:22 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-1056aa54-6946-4256-a6bd-507c02d307df tempest-VolumeDependencyTests-1470240070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c5b498f-2cbf-4bdb-bc67-804bed9c70c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:15:22 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-1056aa54-6946-4256-a6bd-507c02d307df tempest-VolumeDependencyTests-1470240070 None] Flow 'volume_create_manager' (62706981-8b6a-4593-849c-776a06aca0f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:15:22 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-1056aa54-6946-4256-a6bd-507c02d307df tempest-VolumeDependencyTests-1470240070 None] Created volume successfully.
Apr 28 22:15:22 devstack sudo[92168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3bf6ca01-96ff-4763-8cc9-0e5c2e79bd9a
Apr 28 22:15:22 devstack sudo[92168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:22 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-6a0f250c-fd29-4c4f-85c4-768b2d246298 tempest-VolumeDependencyTests-1470240070 None] Acquiring lock "cinder-1f1eabe6-8325-4f55-8386-fa1014e87524-delete_snapshot" by "delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:15:22 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-6a0f250c-fd29-4c4f-85c4-768b2d246298 tempest-VolumeDependencyTests-1470240070 None] Lock "cinder-1f1eabe6-8325-4f55-8386-fa1014e87524-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:15:22 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-6a0f250c-fd29-4c4f-85c4-768b2d246298 tempest-VolumeDependencyTests-1470240070 None] Acquiring lock "cinder-quobyte-a6bf547a-89da-4c5d-82fe-0e9e119f2595" by "delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:15:22 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-6a0f250c-fd29-4c4f-85c4-768b2d246298 tempest-VolumeDependencyTests-1470240070 None] Lock "cinder-quobyte-a6bf547a-89da-4c5d-82fe-0e9e119f2595" acquired by "delete_snapshot" :: waited 0.016s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:15:22 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-6a0f250c-fd29-4c4f-85c4-768b2d246298 tempest-VolumeDependencyTests-1470240070 None] Acquiring lock "cinder-quobyte-1f1eabe6-8325-4f55-8386-fa1014e87524" by "_delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:15:22 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-6a0f250c-fd29-4c4f-85c4-768b2d246298 tempest-VolumeDependencyTests-1470240070 None] Lock "cinder-quobyte-1f1eabe6-8325-4f55-8386-fa1014e87524" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:15:22 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-6a0f250c-fd29-4c4f-85c4-768b2d246298 tempest-VolumeDependencyTests-1470240070 None] Deleting offline snapshot 1f1eabe6-8325-4f55-8386-fa1014e87524 of volume a6bf547a-89da-4c5d-82fe-0e9e119f2595 {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 22:15:22 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-6a0f250c-fd29-4c4f-85c4-768b2d246298 tempest-VolumeDependencyTests-1470240070 None] snapshot_file for this snap is: volume-a6bf547a-89da-4c5d-82fe-0e9e119f2595.1f1eabe6-8325-4f55-8386-fa1014e87524 {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 22:15:22 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[382ba5b8-5ac1-4fd8-9da6-97df72f2e95b]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:15:22 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-6a0f250c-fd29-4c4f-85c4-768b2d246298 tempest-VolumeDependencyTests-1470240070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a6bf547a-89da-4c5d-82fe-0e9e119f2595.1f1eabe6-8325-4f55-8386-fa1014e87524 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:22 devstack sudo[92170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a6bf547a-89da-4c5d-82fe-0e9e119f2595.1f1eabe6-8325-4f55-8386-fa1014e87524
Apr 28 22:15:22 devstack sudo[92170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:23 devstack sudo[92168]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:23 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b854d04d-7706-426a-af96-46489cb8d3f2 tempest-VolumesExtendTest-1115418900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3bf6ca01-96ff-4763-8cc9-0e5c2e79bd9a" returned: 0 in 0.683s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:23 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b854d04d-7706-426a-af96-46489cb8d3f2 tempest-VolumesExtendTest-1115418900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3bf6ca01-96ff-4763-8cc9-0e5c2e79bd9a {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:23 devstack sudo[92175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3bf6ca01-96ff-4763-8cc9-0e5c2e79bd9a
Apr 28 22:15:23 devstack sudo[92175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:23 devstack sudo[92170]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:23 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-6a0f250c-fd29-4c4f-85c4-768b2d246298 tempest-VolumeDependencyTests-1470240070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a6bf547a-89da-4c5d-82fe-0e9e119f2595.1f1eabe6-8325-4f55-8386-fa1014e87524" returned: 0 in 0.700s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:23 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-6a0f250c-fd29-4c4f-85c4-768b2d246298 tempest-VolumeDependencyTests-1470240070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6bf547a-89da-4c5d-82fe-0e9e119f2595(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 22:15:23 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe340534-1fa3-45b1-a2af-23100441d13f]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:15:23 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-6a0f250c-fd29-4c4f-85c4-768b2d246298 tempest-VolumeDependencyTests-1470240070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a6bf547a-89da-4c5d-82fe-0e9e119f2595 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:23 devstack sudo[92180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a6bf547a-89da-4c5d-82fe-0e9e119f2595
Apr 28 22:15:23 devstack sudo[92180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:23 devstack sudo[92175]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:23 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b854d04d-7706-426a-af96-46489cb8d3f2 tempest-VolumesExtendTest-1115418900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3bf6ca01-96ff-4763-8cc9-0e5c2e79bd9a" returned: 1 in 0.670s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:23 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b854d04d-7706-426a-af96-46489cb8d3f2 tempest-VolumesExtendTest-1115418900 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3bf6ca01-96ff-4763-8cc9-0e5c2e79bd9a' failed. Not Retrying. {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 28 22:15:23 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b854d04d-7706-426a-af96-46489cb8d3f2 tempest-VolumesExtendTest-1115418900 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3bf6ca01-96ff-4763-8cc9-0e5c2e79bd9a 2G {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:23 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b854d04d-7706-426a-af96-46489cb8d3f2 tempest-VolumesExtendTest-1115418900 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3bf6ca01-96ff-4763-8cc9-0e5c2e79bd9a 2G" returned: 0 in 0.058s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:23 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b854d04d-7706-426a-af96-46489cb8d3f2 tempest-VolumesExtendTest-1115418900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.459s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:15:23 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-b854d04d-7706-426a-af96-46489cb8d3f2 tempest-VolumesExtendTest-1115418900 None] Extend volume completed successfully.
Apr 28 22:15:24 devstack sudo[92180]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:24 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-6a0f250c-fd29-4c4f-85c4-768b2d246298 tempest-VolumeDependencyTests-1470240070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a6bf547a-89da-4c5d-82fe-0e9e119f2595" returned: 0 in 0.701s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:24 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-6a0f250c-fd29-4c4f-85c4-768b2d246298 tempest-VolumeDependencyTests-1470240070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a6bf547a-89da-4c5d-82fe-0e9e119f2595.1f1eabe6-8325-4f55-8386-fa1014e87524 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:24 devstack sudo[92191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a6bf547a-89da-4c5d-82fe-0e9e119f2595.1f1eabe6-8325-4f55-8386-fa1014e87524
Apr 28 22:15:24 devstack sudo[92191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:24 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-45e4abe9-1f3c-4d7a-a50c-452174703f87 tempest-VolumesExtendTest-1115418900 None] Acquiring lock "cinder-3bf6ca01-96ff-4763-8cc9-0e5c2e79bd9a-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:15:24 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-45e4abe9-1f3c-4d7a-a50c-452174703f87 tempest-VolumesExtendTest-1115418900 None] Lock "cinder-3bf6ca01-96ff-4763-8cc9-0e5c2e79bd9a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:15:24 devstack sudo[92191]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:24 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-45e4abe9-1f3c-4d7a-a50c-452174703f87 tempest-VolumesExtendTest-1115418900 None] Acquiring lock "cinder-quobyte-3bf6ca01-96ff-4763-8cc9-0e5c2e79bd9a" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:15:24 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-6a0f250c-fd29-4c4f-85c4-768b2d246298 tempest-VolumeDependencyTests-1470240070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a6bf547a-89da-4c5d-82fe-0e9e119f2595.1f1eabe6-8325-4f55-8386-fa1014e87524" returned: 0 in 0.686s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:24 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-6a0f250c-fd29-4c4f-85c4-768b2d246298 tempest-VolumeDependencyTests-1470240070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a6bf547a-89da-4c5d-82fe-0e9e119f2595.1f1eabe6-8325-4f55-8386-fa1014e87524 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:24 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-45e4abe9-1f3c-4d7a-a50c-452174703f87 tempest-VolumesExtendTest-1115418900 None] Lock "cinder-quobyte-3bf6ca01-96ff-4763-8cc9-0e5c2e79bd9a" acquired by "delete_volume" :: waited 0.031s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:15:24 devstack sudo[92196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a6bf547a-89da-4c5d-82fe-0e9e119f2595.1f1eabe6-8325-4f55-8386-fa1014e87524
Apr 28 22:15:24 devstack sudo[92196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:24 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[976e861c-e681-4f7c-ae23-7ff947ad4f48]: (4, 'raw') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:15:24 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-45e4abe9-1f3c-4d7a-a50c-452174703f87 tempest-VolumesExtendTest-1115418900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3bf6ca01-96ff-4763-8cc9-0e5c2e79bd9a {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:25 devstack sudo[92198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3bf6ca01-96ff-4763-8cc9-0e5c2e79bd9a
Apr 28 22:15:25 devstack sudo[92198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:25 devstack sudo[92196]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:25 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-6a0f250c-fd29-4c4f-85c4-768b2d246298 tempest-VolumeDependencyTests-1470240070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a6bf547a-89da-4c5d-82fe-0e9e119f2595.1f1eabe6-8325-4f55-8386-fa1014e87524" returned: 0 in 0.638s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:25 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-6a0f250c-fd29-4c4f-85c4-768b2d246298 tempest-VolumeDependencyTests-1470240070 None] Lock "cinder-quobyte-1f1eabe6-8325-4f55-8386-fa1014e87524" released by "_delete_snapshot" :: held 2.825s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:15:25 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-6a0f250c-fd29-4c4f-85c4-768b2d246298 tempest-VolumeDependencyTests-1470240070 None] Lock "cinder-quobyte-a6bf547a-89da-4c5d-82fe-0e9e119f2595" released by "delete_snapshot" :: held 2.849s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:15:25 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-6a0f250c-fd29-4c4f-85c4-768b2d246298 tempest-VolumeDependencyTests-1470240070 None] Created reservations ['71b744af-1059-45ba-8b46-fda50e3c9724', 'b554dfcc-74fb-4068-8985-d3feb3173cb6', '1b3ae1ae-ac47-49e0-b59a-2a27b944b7d5', 'c82c9c96-8380-42ea-9f00-342be1a31134'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:15:25 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-6a0f250c-fd29-4c4f-85c4-768b2d246298 tempest-VolumeDependencyTests-1470240070 None] Delete snapshot completed successfully.
Apr 28 22:15:25 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-6a0f250c-fd29-4c4f-85c4-768b2d246298 tempest-VolumeDependencyTests-1470240070 None] Lock "cinder-1f1eabe6-8325-4f55-8386-fa1014e87524-delete_snapshot" released by "delete_snapshot" :: held 2.981s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:15:25 devstack sudo[92198]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:25 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-45e4abe9-1f3c-4d7a-a50c-452174703f87 tempest-VolumesExtendTest-1115418900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3bf6ca01-96ff-4763-8cc9-0e5c2e79bd9a" returned: 0 in 0.721s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:25 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-45e4abe9-1f3c-4d7a-a50c-452174703f87 tempest-VolumesExtendTest-1115418900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3bf6ca01-96ff-4763-8cc9-0e5c2e79bd9a {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:25 devstack sudo[92210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3bf6ca01-96ff-4763-8cc9-0e5c2e79bd9a
Apr 28 22:15:25 devstack sudo[92210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:25 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-9a09a035-a1c3-4a25-8b04-c3946d6a58f5 tempest-VolumeDependencyTests-1470240070 None] Acquiring lock "cinder-a6bf547a-89da-4c5d-82fe-0e9e119f2595-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:15:25 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-9a09a035-a1c3-4a25-8b04-c3946d6a58f5 tempest-VolumeDependencyTests-1470240070 None] Lock "cinder-a6bf547a-89da-4c5d-82fe-0e9e119f2595-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:15:25 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-9a09a035-a1c3-4a25-8b04-c3946d6a58f5 tempest-VolumeDependencyTests-1470240070 None] Acquiring lock "cinder-quobyte-a6bf547a-89da-4c5d-82fe-0e9e119f2595" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:15:25 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-9a09a035-a1c3-4a25-8b04-c3946d6a58f5 tempest-VolumeDependencyTests-1470240070 None] Lock "cinder-quobyte-a6bf547a-89da-4c5d-82fe-0e9e119f2595" acquired by "delete_volume" :: waited 0.020s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:15:25 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e3301a-7b83-4606-bf15-17a727950055]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:15:25 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-9a09a035-a1c3-4a25-8b04-c3946d6a58f5 tempest-VolumeDependencyTests-1470240070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a6bf547a-89da-4c5d-82fe-0e9e119f2595 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:26 devstack sudo[92212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a6bf547a-89da-4c5d-82fe-0e9e119f2595
Apr 28 22:15:26 devstack sudo[92212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:26 devstack sudo[92210]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:26 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-45e4abe9-1f3c-4d7a-a50c-452174703f87 tempest-VolumesExtendTest-1115418900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3bf6ca01-96ff-4763-8cc9-0e5c2e79bd9a" returned: 1 in 0.708s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:26 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-45e4abe9-1f3c-4d7a-a50c-452174703f87 tempest-VolumesExtendTest-1115418900 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3bf6ca01-96ff-4763-8cc9-0e5c2e79bd9a' failed. Not Retrying. {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 28 22:15:26 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-45e4abe9-1f3c-4d7a-a50c-452174703f87 tempest-VolumesExtendTest-1115418900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3bf6ca01-96ff-4763-8cc9-0e5c2e79bd9a {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:26 devstack sudo[92217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3bf6ca01-96ff-4763-8cc9-0e5c2e79bd9a
Apr 28 22:15:26 devstack sudo[92217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:26 devstack sudo[92212]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:26 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-9a09a035-a1c3-4a25-8b04-c3946d6a58f5 tempest-VolumeDependencyTests-1470240070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a6bf547a-89da-4c5d-82fe-0e9e119f2595" returned: 0 in 0.706s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:26 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-9a09a035-a1c3-4a25-8b04-c3946d6a58f5 tempest-VolumeDependencyTests-1470240070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a6bf547a-89da-4c5d-82fe-0e9e119f2595 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:26 devstack sudo[92222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a6bf547a-89da-4c5d-82fe-0e9e119f2595
Apr 28 22:15:26 devstack sudo[92222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:26 devstack sudo[92217]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:26 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-45e4abe9-1f3c-4d7a-a50c-452174703f87 tempest-VolumesExtendTest-1115418900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3bf6ca01-96ff-4763-8cc9-0e5c2e79bd9a" returned: 0 in 0.606s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:26 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-45e4abe9-1f3c-4d7a-a50c-452174703f87 tempest-VolumesExtendTest-1115418900 None] Lock "cinder-quobyte-3bf6ca01-96ff-4763-8cc9-0e5c2e79bd9a" released by "delete_volume" :: held 2.112s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:15:27 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-45e4abe9-1f3c-4d7a-a50c-452174703f87 tempest-VolumesExtendTest-1115418900 None] Created reservations ['db1ae570-159f-44fa-955f-d2893c9b29cd', 'd4a2c48d-e9c8-45d2-941e-c22eaa4a5fb3', '71a83c52-62af-4156-91ef-7af8d0ddfd50', '6b419418-61a3-4f45-b439-066c518b29aa'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:15:27 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-45e4abe9-1f3c-4d7a-a50c-452174703f87 tempest-VolumesExtendTest-1115418900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:15:27 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-45e4abe9-1f3c-4d7a-a50c-452174703f87 tempest-VolumesExtendTest-1115418900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:15:27 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-45e4abe9-1f3c-4d7a-a50c-452174703f87 tempest-VolumesExtendTest-1115418900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:15:27 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-45e4abe9-1f3c-4d7a-a50c-452174703f87 tempest-VolumesExtendTest-1115418900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:15:27 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-45e4abe9-1f3c-4d7a-a50c-452174703f87 tempest-VolumesExtendTest-1115418900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:15:27 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-45e4abe9-1f3c-4d7a-a50c-452174703f87 tempest-VolumesExtendTest-1115418900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:27 devstack sudo[92225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:15:27 devstack sudo[92225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:27 devstack sudo[92222]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:27 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-9a09a035-a1c3-4a25-8b04-c3946d6a58f5 tempest-VolumeDependencyTests-1470240070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-a6bf547a-89da-4c5d-82fe-0e9e119f2595" returned: 0 in 0.591s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:27 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-9a09a035-a1c3-4a25-8b04-c3946d6a58f5 tempest-VolumeDependencyTests-1470240070 None] Lock "cinder-quobyte-a6bf547a-89da-4c5d-82fe-0e9e119f2595" released by "delete_volume" :: held 1.371s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:15:27 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-9a09a035-a1c3-4a25-8b04-c3946d6a58f5 tempest-VolumeDependencyTests-1470240070 None] Created reservations ['ba932189-0d1d-4838-bf30-3b43edcdbde3', '2e5ddd56-95be-4448-8b1f-40eb83dd646c', '110e80e7-ff1c-4a0d-9f2e-17074cc355ad', '6fe70ee3-6fb4-43a3-b340-c68d4795c225'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:15:27 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-9a09a035-a1c3-4a25-8b04-c3946d6a58f5 tempest-VolumeDependencyTests-1470240070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:15:27 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-9a09a035-a1c3-4a25-8b04-c3946d6a58f5 tempest-VolumeDependencyTests-1470240070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:15:27 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-9a09a035-a1c3-4a25-8b04-c3946d6a58f5 tempest-VolumeDependencyTests-1470240070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:15:27 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-9a09a035-a1c3-4a25-8b04-c3946d6a58f5 tempest-VolumeDependencyTests-1470240070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:15:27 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-9a09a035-a1c3-4a25-8b04-c3946d6a58f5 tempest-VolumeDependencyTests-1470240070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:15:27 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-9a09a035-a1c3-4a25-8b04-c3946d6a58f5 tempest-VolumeDependencyTests-1470240070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:27 devstack sudo[92228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:15:27 devstack sudo[92228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:27 devstack sudo[92225]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:27 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-45e4abe9-1f3c-4d7a-a50c-452174703f87 tempest-VolumesExtendTest-1115418900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.585s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:27 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-45e4abe9-1f3c-4d7a-a50c-452174703f87 tempest-VolumesExtendTest-1115418900 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:15:27 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-45e4abe9-1f3c-4d7a-a50c-452174703f87 tempest-VolumesExtendTest-1115418900 None] Deleted volume successfully.
Apr 28 22:15:27 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-45e4abe9-1f3c-4d7a-a50c-452174703f87 tempest-VolumesExtendTest-1115418900 None] Lock "cinder-3bf6ca01-96ff-4763-8cc9-0e5c2e79bd9a-delete_volume" released by "delete_volume" :: held 2.938s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:15:28 devstack sudo[92228]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:28 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-9a09a035-a1c3-4a25-8b04-c3946d6a58f5 tempest-VolumeDependencyTests-1470240070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.621s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:28 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-9a09a035-a1c3-4a25-8b04-c3946d6a58f5 tempest-VolumeDependencyTests-1470240070 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:15:28 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-9a09a035-a1c3-4a25-8b04-c3946d6a58f5 tempest-VolumeDependencyTests-1470240070 None] Deleted volume successfully.
Apr 28 22:15:28 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-9a09a035-a1c3-4a25-8b04-c3946d6a58f5 tempest-VolumeDependencyTests-1470240070 None] Lock "cinder-a6bf547a-89da-4c5d-82fe-0e9e119f2595-delete_volume" released by "delete_volume" :: held 2.203s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:15:28 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-43a3cf61-fb3b-49ab-8019-edc978e24ecc tempest-VolumeDependencyTests-1470240070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:15:28 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-43a3cf61-fb3b-49ab-8019-edc978e24ecc tempest-VolumeDependencyTests-1470240070 None] Flow 'volume_create_manager' (b482d224-41fc-4a2d-9ebf-27f7afd09b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:15:28 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-43a3cf61-fb3b-49ab-8019-edc978e24ecc tempest-VolumeDependencyTests-1470240070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ddc9656-0bec-41e7-87af-ba326082fac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:15:28 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-43a3cf61-fb3b-49ab-8019-edc978e24ecc tempest-VolumeDependencyTests-1470240070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ddc9656-0bec-41e7-87af-ba326082fac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:15:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1706280755',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d9f7941-e2b3-43bb-aa15-0529182dc6b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab3233b47a1540f797d02def6f1af93f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:15:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:15:28Z,use_quota=True,user_id='8408db8ca5c0456ca818e9f43244133e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:15:28 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-43a3cf61-fb3b-49ab-8019-edc978e24ecc tempest-VolumeDependencyTests-1470240070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (191b58ce-3030-4872-8c84-705c4e34a7d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:15:28 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-43a3cf61-fb3b-49ab-8019-edc978e24ecc tempest-VolumeDependencyTests-1470240070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (191b58ce-3030-4872-8c84-705c4e34a7d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:15:28 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-43a3cf61-fb3b-49ab-8019-edc978e24ecc tempest-VolumeDependencyTests-1470240070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0c61029-ff95-4ed6-990c-d210f78a6147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:15:28 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-43a3cf61-fb3b-49ab-8019-edc978e24ecc tempest-VolumeDependencyTests-1470240070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0c61029-ff95-4ed6-990c-d210f78a6147) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d9f7941-e2b3-43bb-aa15-0529182dc6b0', 'volume_name': 'volume-2d9f7941-e2b3-43bb-aa15-0529182dc6b0', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:15:28 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-43a3cf61-fb3b-49ab-8019-edc978e24ecc tempest-VolumeDependencyTests-1470240070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48a94b68-daf9-414e-8364-80168a470ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:15:28 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-43a3cf61-fb3b-49ab-8019-edc978e24ecc tempest-VolumeDependencyTests-1470240070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48a94b68-daf9-414e-8364-80168a470ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:15:28 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-43a3cf61-fb3b-49ab-8019-edc978e24ecc tempest-VolumeDependencyTests-1470240070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33034c7e-40f7-4bf3-ae22-08c3a0aecca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:15:28 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-43a3cf61-fb3b-49ab-8019-edc978e24ecc tempest-VolumeDependencyTests-1470240070 None] Volume 2d9f7941-e2b3-43bb-aa15-0529182dc6b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d9f7941-e2b3-43bb-aa15-0529182dc6b0', 'volume_size': 1}
Apr 28 22:15:28 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-43a3cf61-fb3b-49ab-8019-edc978e24ecc tempest-VolumeDependencyTests-1470240070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:15:28 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-43a3cf61-fb3b-49ab-8019-edc978e24ecc tempest-VolumeDependencyTests-1470240070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:15:28 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-43a3cf61-fb3b-49ab-8019-edc978e24ecc tempest-VolumeDependencyTests-1470240070 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:15:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1706280755',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d9f7941-e2b3-43bb-aa15-0529182dc6b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab3233b47a1540f797d02def6f1af93f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:15:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:15:28Z,use_quota=True,user_id='8408db8ca5c0456ca818e9f43244133e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:15:28 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-43a3cf61-fb3b-49ab-8019-edc978e24ecc tempest-VolumeDependencyTests-1470240070 None] Creating volume 2d9f7941-e2b3-43bb-aa15-0529182dc6b0 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:15:28 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-43a3cf61-fb3b-49ab-8019-edc978e24ecc tempest-VolumeDependencyTests-1470240070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:15:28 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-43a3cf61-fb3b-49ab-8019-edc978e24ecc tempest-VolumeDependencyTests-1470240070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:15:28 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-43a3cf61-fb3b-49ab-8019-edc978e24ecc tempest-VolumeDependencyTests-1470240070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:15:28 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-43a3cf61-fb3b-49ab-8019-edc978e24ecc tempest-VolumeDependencyTests-1470240070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:15:28 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-43a3cf61-fb3b-49ab-8019-edc978e24ecc tempest-VolumeDependencyTests-1470240070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:15:28 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-43a3cf61-fb3b-49ab-8019-edc978e24ecc tempest-VolumeDependencyTests-1470240070 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:15:28 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-43a3cf61-fb3b-49ab-8019-edc978e24ecc tempest-VolumeDependencyTests-1470240070 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:15:28 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-43a3cf61-fb3b-49ab-8019-edc978e24ecc tempest-VolumeDependencyTests-1470240070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2d9f7941-e2b3-43bb-aa15-0529182dc6b0 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:28 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ef67e60-b333-4d16-9094-b2e16a5ef1fd tempest-VolumesExtendTest-1115418900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:15:28 devstack sudo[92234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2d9f7941-e2b3-43bb-aa15-0529182dc6b0 1073741824
Apr 28 22:15:28 devstack sudo[92234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:28 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-2ef67e60-b333-4d16-9094-b2e16a5ef1fd tempest-VolumesExtendTest-1115418900 None] Flow 'volume_create_manager' (31c411c9-2242-4f38-b6d6-dc9f81ea7a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:15:28 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-2ef67e60-b333-4d16-9094-b2e16a5ef1fd tempest-VolumesExtendTest-1115418900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e424d44-80ef-42d1-959d-ac97ac27d2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:15:28 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-2ef67e60-b333-4d16-9094-b2e16a5ef1fd tempest-VolumesExtendTest-1115418900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e424d44-80ef-42d1-959d-ac97ac27d2d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:15:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2051567084',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c15cfee07f994cf1a2cd5c02fb8cdd3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:15:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:15:28Z,use_quota=True,user_id='561e0cccae55410c995caa773f6f6c54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:15:28 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-2ef67e60-b333-4d16-9094-b2e16a5ef1fd tempest-VolumesExtendTest-1115418900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd25e929-4cab-43e2-870d-5c45785ab23c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:15:28 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-2ef67e60-b333-4d16-9094-b2e16a5ef1fd tempest-VolumesExtendTest-1115418900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd25e929-4cab-43e2-870d-5c45785ab23c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:15:28 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-2ef67e60-b333-4d16-9094-b2e16a5ef1fd tempest-VolumesExtendTest-1115418900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2dd51ef-b7bc-49bc-9af6-ecbaa9677bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:15:28 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-2ef67e60-b333-4d16-9094-b2e16a5ef1fd tempest-VolumesExtendTest-1115418900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2dd51ef-b7bc-49bc-9af6-ecbaa9677bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b', 'volume_name': 'volume-ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:15:28 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-2ef67e60-b333-4d16-9094-b2e16a5ef1fd tempest-VolumesExtendTest-1115418900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6151a79a-e27d-4984-9ae0-669d6311df51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:15:28 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-2ef67e60-b333-4d16-9094-b2e16a5ef1fd tempest-VolumesExtendTest-1115418900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6151a79a-e27d-4984-9ae0-669d6311df51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:15:28 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-2ef67e60-b333-4d16-9094-b2e16a5ef1fd tempest-VolumesExtendTest-1115418900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12a835fa-442f-4edf-a882-e71978436616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:15:28 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-2ef67e60-b333-4d16-9094-b2e16a5ef1fd tempest-VolumesExtendTest-1115418900 None] Volume ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b', 'volume_size': 1}
Apr 28 22:15:28 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-2ef67e60-b333-4d16-9094-b2e16a5ef1fd tempest-VolumesExtendTest-1115418900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:15:29 devstack sudo[92234]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-43a3cf61-fb3b-49ab-8019-edc978e24ecc tempest-VolumeDependencyTests-1470240070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2d9f7941-e2b3-43bb-aa15-0529182dc6b0 1073741824" returned: 0 in 0.736s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-43a3cf61-fb3b-49ab-8019-edc978e24ecc tempest-VolumeDependencyTests-1470240070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2d9f7941-e2b3-43bb-aa15-0529182dc6b0 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:29 devstack sudo[92239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2d9f7941-e2b3-43bb-aa15-0529182dc6b0
Apr 28 22:15:29 devstack sudo[92239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:29 devstack sudo[92239]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-43a3cf61-fb3b-49ab-8019-edc978e24ecc tempest-VolumeDependencyTests-1470240070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2d9f7941-e2b3-43bb-aa15-0529182dc6b0" returned: 0 in 0.601s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:29 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-43a3cf61-fb3b-49ab-8019-edc978e24ecc tempest-VolumeDependencyTests-1470240070 None] <== create_volume: return (1376ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:15:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-43a3cf61-fb3b-49ab-8019-edc978e24ecc tempest-VolumeDependencyTests-1470240070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.378s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:15:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-2ef67e60-b333-4d16-9094-b2e16a5ef1fd tempest-VolumesExtendTest-1115418900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.282s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:15:29 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-2ef67e60-b333-4d16-9094-b2e16a5ef1fd tempest-VolumesExtendTest-1115418900 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:15:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2051567084',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c15cfee07f994cf1a2cd5c02fb8cdd3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:15:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:15:28Z,use_quota=True,user_id='561e0cccae55410c995caa773f6f6c54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:15:29 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-2ef67e60-b333-4d16-9094-b2e16a5ef1fd tempest-VolumesExtendTest-1115418900 None] Creating volume ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:15:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-2ef67e60-b333-4d16-9094-b2e16a5ef1fd tempest-VolumesExtendTest-1115418900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:15:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-2ef67e60-b333-4d16-9094-b2e16a5ef1fd tempest-VolumesExtendTest-1115418900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:15:29 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-2ef67e60-b333-4d16-9094-b2e16a5ef1fd tempest-VolumesExtendTest-1115418900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:15:29 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-2ef67e60-b333-4d16-9094-b2e16a5ef1fd tempest-VolumesExtendTest-1115418900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:15:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-2ef67e60-b333-4d16-9094-b2e16a5ef1fd tempest-VolumesExtendTest-1115418900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:15:29 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-2ef67e60-b333-4d16-9094-b2e16a5ef1fd tempest-VolumesExtendTest-1115418900 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:15:29 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-2ef67e60-b333-4d16-9094-b2e16a5ef1fd tempest-VolumesExtendTest-1115418900 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:15:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-2ef67e60-b333-4d16-9094-b2e16a5ef1fd tempest-VolumesExtendTest-1115418900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:30 devstack sudo[92242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b 1073741824
Apr 28 22:15:30 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-43a3cf61-fb3b-49ab-8019-edc978e24ecc tempest-VolumeDependencyTests-1470240070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33034c7e-40f7-4bf3-ae22-08c3a0aecca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d9f7941-e2b3-43bb-aa15-0529182dc6b0', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:15:30 devstack sudo[92242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:30 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-43a3cf61-fb3b-49ab-8019-edc978e24ecc tempest-VolumeDependencyTests-1470240070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a210facc-b3df-4ba2-959a-40997411f592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:15:30 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-43a3cf61-fb3b-49ab-8019-edc978e24ecc tempest-VolumeDependencyTests-1470240070 None] Volume volume-2d9f7941-e2b3-43bb-aa15-0529182dc6b0 (2d9f7941-e2b3-43bb-aa15-0529182dc6b0): created successfully
Apr 28 22:15:30 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-43a3cf61-fb3b-49ab-8019-edc978e24ecc tempest-VolumeDependencyTests-1470240070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a210facc-b3df-4ba2-959a-40997411f592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:15:30 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-43a3cf61-fb3b-49ab-8019-edc978e24ecc tempest-VolumeDependencyTests-1470240070 None] Flow 'volume_create_manager' (b482d224-41fc-4a2d-9ebf-27f7afd09b7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:15:30 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-43a3cf61-fb3b-49ab-8019-edc978e24ecc tempest-VolumeDependencyTests-1470240070 None] Created volume successfully.
Apr 28 22:15:30 devstack sudo[92242]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:30 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-2ef67e60-b333-4d16-9094-b2e16a5ef1fd tempest-VolumesExtendTest-1115418900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b 1073741824" returned: 0 in 0.780s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:30 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-2ef67e60-b333-4d16-9094-b2e16a5ef1fd tempest-VolumesExtendTest-1115418900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:30 devstack sudo[92248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b
Apr 28 22:15:30 devstack sudo[92248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:31 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:15:31 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] Flow 'volume_create_manager' (1aebc7c6-b499-42c6-9aa2-41a757c4d400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:15:31 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b2c7512-5833-4c84-84d0-077c7088ec89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:15:31 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b2c7512-5833-4c84-84d0-077c7088ec89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:15:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-87314098',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cafbfb8-72f5-4945-9e37-c88d53853683,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab3233b47a1540f797d02def6f1af93f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:15:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=2d9f7941-e2b3-43bb-aa15-0529182dc6b0,status='creating',terminated_at=None,updated_at=2026-04-28T20:15:31Z,use_quota=True,user_id='8408db8ca5c0456ca818e9f43244133e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:15:31 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe2665df-45b2-4fa1-b74f-90ded4ed4259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:15:31 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe2665df-45b2-4fa1-b74f-90ded4ed4259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:15:31 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e14caa3-d324-4f6b-88b3-da930fddc756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:15:31 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e14caa3-d324-4f6b-88b3-da930fddc756) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '6cafbfb8-72f5-4945-9e37-c88d53853683', 'volume_name': 'volume-6cafbfb8-72f5-4945-9e37-c88d53853683', 'volume_size': 1, 'source_volid': '2d9f7941-e2b3-43bb-aa15-0529182dc6b0', 'source_volstatus': 'available'}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:15:31 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7b4c2c5-824a-4de2-8e41-900a9c0b0b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:15:31 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7b4c2c5-824a-4de2-8e41-900a9c0b0b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:15:31 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7188efcb-101c-4a86-abff-7e40d82e234c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:15:31 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] Volume 6cafbfb8-72f5-4945-9e37-c88d53853683: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-6cafbfb8-72f5-4945-9e37-c88d53853683', 'volume_size': 1, 'source_volid': '2d9f7941-e2b3-43bb-aa15-0529182dc6b0', 'source_volstatus': 'available'}
Apr 28 22:15:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:15:31 devstack sudo[92248]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-2ef67e60-b333-4d16-9094-b2e16a5ef1fd tempest-VolumesExtendTest-1115418900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b" returned: 0 in 0.591s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:31 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-2ef67e60-b333-4d16-9094-b2e16a5ef1fd tempest-VolumesExtendTest-1115418900 None] <== create_volume: return (1407ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:15:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-2ef67e60-b333-4d16-9094-b2e16a5ef1fd tempest-VolumesExtendTest-1115418900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.410s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:15:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.251s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:15:31 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] Cloning volume 2d9f7941-e2b3-43bb-aa15-0529182dc6b0 to volume 6cafbfb8-72f5-4945-9e37-c88d53853683
Apr 28 22:15:31 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-2ef67e60-b333-4d16-9094-b2e16a5ef1fd tempest-VolumesExtendTest-1115418900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12a835fa-442f-4edf-a882-e71978436616) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:15:31 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-2ef67e60-b333-4d16-9094-b2e16a5ef1fd tempest-VolumesExtendTest-1115418900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a061ac14-944b-4aa7-ab9a-778f052d24f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:15:31 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-2ef67e60-b333-4d16-9094-b2e16a5ef1fd tempest-VolumesExtendTest-1115418900 None] Volume volume-ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b (ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b): created successfully
Apr 28 22:15:31 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-2ef67e60-b333-4d16-9094-b2e16a5ef1fd tempest-VolumesExtendTest-1115418900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a061ac14-944b-4aa7-ab9a-778f052d24f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:15:31 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-2ef67e60-b333-4d16-9094-b2e16a5ef1fd tempest-VolumesExtendTest-1115418900 None] Flow 'volume_create_manager' (31c411c9-2242-4f38-b6d6-dc9f81ea7a64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:15:31 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] Creating offline snapshot f907d6e4-7033-4284-81d3-450b697fb981 of volume 2d9f7941-e2b3-43bb-aa15-0529182dc6b0 {{(pid=83924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 22:15:31 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-2ef67e60-b333-4d16-9094-b2e16a5ef1fd tempest-VolumesExtendTest-1115418900 None] Created volume successfully.
Apr 28 22:15:31 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52293e0-e67f-44db-ad8e-b5cdcd7260cc]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:15:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2d9f7941-e2b3-43bb-aa15-0529182dc6b0 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:31 devstack sudo[92251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2d9f7941-e2b3-43bb-aa15-0529182dc6b0
Apr 28 22:15:31 devstack sudo[92251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-52c9ecff-3bba-4182-8bd8-8917d204f2cf tempest-VolumesExtendTest-1115418900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:15:32 devstack sudo[92251]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:32 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2d9f7941-e2b3-43bb-aa15-0529182dc6b0" returned: 0 in 0.693s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:32 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2d9f7941-e2b3-43bb-aa15-0529182dc6b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2d9f7941-e2b3-43bb-aa15-0529182dc6b0.f907d6e4-7033-4284-81d3-450b697fb981 1G {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:32 devstack sudo[92256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2d9f7941-e2b3-43bb-aa15-0529182dc6b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2d9f7941-e2b3-43bb-aa15-0529182dc6b0.f907d6e4-7033-4284-81d3-450b697fb981 1G
Apr 28 22:15:32 devstack sudo[92256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:32 devstack sudo[92256]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:32 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2d9f7941-e2b3-43bb-aa15-0529182dc6b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2d9f7941-e2b3-43bb-aa15-0529182dc6b0.f907d6e4-7033-4284-81d3-450b697fb981 1G" returned: 0 in 0.701s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:32 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d9f7941-e2b3-43bb-aa15-0529182dc6b0 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2d9f7941-e2b3-43bb-aa15-0529182dc6b0.f907d6e4-7033-4284-81d3-450b697fb981 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:32 devstack sudo[92262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d9f7941-e2b3-43bb-aa15-0529182dc6b0 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2d9f7941-e2b3-43bb-aa15-0529182dc6b0.f907d6e4-7033-4284-81d3-450b697fb981
Apr 28 22:15:32 devstack sudo[92262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:33 devstack sudo[92262]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:33 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d9f7941-e2b3-43bb-aa15-0529182dc6b0 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2d9f7941-e2b3-43bb-aa15-0529182dc6b0.f907d6e4-7033-4284-81d3-450b697fb981" returned: 0 in 0.604s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:33 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2d9f7941-e2b3-43bb-aa15-0529182dc6b0.f907d6e4-7033-4284-81d3-450b697fb981 is being set with open permissions: ugo+rw
Apr 28 22:15:33 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2d9f7941-e2b3-43bb-aa15-0529182dc6b0.f907d6e4-7033-4284-81d3-450b697fb981 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:33 devstack sudo[92268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2d9f7941-e2b3-43bb-aa15-0529182dc6b0.f907d6e4-7033-4284-81d3-450b697fb981
Apr 28 22:15:33 devstack sudo[92268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:34 devstack sudo[92268]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:34 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2d9f7941-e2b3-43bb-aa15-0529182dc6b0.f907d6e4-7033-4284-81d3-450b697fb981" returned: 0 in 0.555s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:34 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2d9f7941-e2b3-43bb-aa15-0529182dc6b0.info {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:34 devstack sudo[92271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2d9f7941-e2b3-43bb-aa15-0529182dc6b0.info
Apr 28 22:15:34 devstack sudo[92271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:34 devstack sudo[92271]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:34 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2d9f7941-e2b3-43bb-aa15-0529182dc6b0.info" returned: 0 in 0.585s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:34 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2d9f7941-e2b3-43bb-aa15-0529182dc6b0.info is being set with open permissions: ugo+rw
Apr 28 22:15:34 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2d9f7941-e2b3-43bb-aa15-0529182dc6b0.info {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:34 devstack sudo[92274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2d9f7941-e2b3-43bb-aa15-0529182dc6b0.info
Apr 28 22:15:34 devstack sudo[92274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:35 devstack sudo[92274]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:35 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2d9f7941-e2b3-43bb-aa15-0529182dc6b0.info" returned: 0 in 0.577s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:35 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] Acquiring lock "cinder-quobyte-6cafbfb8-72f5-4945-9e37-c88d53853683" by "_copy_volume_from_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:15:35 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] Lock "cinder-quobyte-6cafbfb8-72f5-4945-9e37-c88d53853683" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:15:35 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] snapshot: f907d6e4-7033-4284-81d3-450b697fb981, volume: 6cafbfb8-72f5-4945-9e37-c88d53853683,  {{(pid=83924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 28 22:15:35 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:15:35 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:15:35 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:15:35 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:15:35 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:15:35 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a75cfa3-730c-4ab0-b1d6-fac1eac5e675]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:15:35 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2d9f7941-e2b3-43bb-aa15-0529182dc6b0.f907d6e4-7033-4284-81d3-450b697fb981 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:35 devstack sudo[92279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2d9f7941-e2b3-43bb-aa15-0529182dc6b0.f907d6e4-7033-4284-81d3-450b697fb981
Apr 28 22:15:35 devstack sudo[92279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:35 devstack sudo[92279]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:35 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2d9f7941-e2b3-43bb-aa15-0529182dc6b0.f907d6e4-7033-4284-81d3-450b697fb981" returned: 0 in 0.667s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:35 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d9f7941-e2b3-43bb-aa15-0529182dc6b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 22:15:35 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2d9f7941-e2b3-43bb-aa15-0529182dc6b0 {{(pid=83924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 28 22:15:35 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] Creating direct copy from snapshot {{(pid=83924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 28 22:15:35 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc57094-06e6-4c7f-b340-21c2395ed222]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:15:35 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2d9f7941-e2b3-43bb-aa15-0529182dc6b0 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:36 devstack sudo[92284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2d9f7941-e2b3-43bb-aa15-0529182dc6b0
Apr 28 22:15:36 devstack sudo[92284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:36 devstack sudo[92284]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:36 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2d9f7941-e2b3-43bb-aa15-0529182dc6b0" returned: 0 in 0.693s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:36 devstack cinder-volume[83924]: DEBUG cinder.utils [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] Path /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6cafbfb8-72f5-4945-9e37-c88d53853683 not found in is_blk_device check {{(pid=83924) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 28 22:15:36 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2d9f7941-e2b3-43bb-aa15-0529182dc6b0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6cafbfb8-72f5-4945-9e37-c88d53853683 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:36 devstack sudo[92289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2d9f7941-e2b3-43bb-aa15-0529182dc6b0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6cafbfb8-72f5-4945-9e37-c88d53853683
Apr 28 22:15:36 devstack sudo[92289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:39 devstack cinder-volume[83924]: DEBUG oslo_service.periodic_task [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83924) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 28 22:15:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:15:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:15:39 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:15:39 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:15:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:15:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:39 devstack sudo[92303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:15:39 devstack sudo[92303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:40 devstack sudo[92303]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:40 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 1.291s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:40 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:15:41 devstack sudo[92289]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:41 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2d9f7941-e2b3-43bb-aa15-0529182dc6b0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6cafbfb8-72f5-4945-9e37-c88d53853683" returned: 0 in 4.465s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:41 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9504c1-6434-4f7d-a11c-17dbfad3b7d9]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:15:41 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2d9f7941-e2b3-43bb-aa15-0529182dc6b0 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:41 devstack sudo[92307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2d9f7941-e2b3-43bb-aa15-0529182dc6b0
Apr 28 22:15:41 devstack sudo[92307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:41 devstack sudo[92307]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:41 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2d9f7941-e2b3-43bb-aa15-0529182dc6b0" returned: 0 in 0.844s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:41 devstack cinder-volume[83924]: DEBUG cinder.image.image_utils [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] Image conversion details: src /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2d9f7941-e2b3-43bb-aa15-0529182dc6b0, size 1024.00 MB, duration 4.47 sec, destination /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6cafbfb8-72f5-4945-9e37-c88d53853683 {{(pid=83924) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 28 22:15:41 devstack cinder-volume[83924]: INFO cinder.image.image_utils [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] Converted 1024.00 MB image at 229.31 MB/s
Apr 28 22:15:41 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6cafbfb8-72f5-4945-9e37-c88d53853683 is being set with open permissions: ugo+rw
Apr 28 22:15:41 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6cafbfb8-72f5-4945-9e37-c88d53853683 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:41 devstack sudo[92312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6cafbfb8-72f5-4945-9e37-c88d53853683
Apr 28 22:15:41 devstack sudo[92312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:42 devstack sudo[92312]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:42 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6cafbfb8-72f5-4945-9e37-c88d53853683" returned: 0 in 0.545s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:42 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] Lock "cinder-quobyte-6cafbfb8-72f5-4945-9e37-c88d53853683" released by "_copy_volume_from_snapshot" :: held 7.288s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:15:42 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] Acquiring lock "cinder-quobyte-f907d6e4-7033-4284-81d3-450b697fb981" by "_delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:15:42 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] Lock "cinder-quobyte-f907d6e4-7033-4284-81d3-450b697fb981" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:15:42 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] Deleting offline snapshot f907d6e4-7033-4284-81d3-450b697fb981 of volume 2d9f7941-e2b3-43bb-aa15-0529182dc6b0 {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 22:15:42 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] snapshot_file for this snap is: volume-2d9f7941-e2b3-43bb-aa15-0529182dc6b0.f907d6e4-7033-4284-81d3-450b697fb981 {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 22:15:42 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd186b1a-9fad-47a6-b23d-553ca8ea9ebd]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:15:42 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2d9f7941-e2b3-43bb-aa15-0529182dc6b0.f907d6e4-7033-4284-81d3-450b697fb981 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:42 devstack sudo[92315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2d9f7941-e2b3-43bb-aa15-0529182dc6b0.f907d6e4-7033-4284-81d3-450b697fb981
Apr 28 22:15:42 devstack sudo[92315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:43 devstack sudo[92315]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:43 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2d9f7941-e2b3-43bb-aa15-0529182dc6b0.f907d6e4-7033-4284-81d3-450b697fb981" returned: 0 in 0.711s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:43 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d9f7941-e2b3-43bb-aa15-0529182dc6b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 22:15:43 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61dd734-bd94-4658-8a8e-f78324cf1a4a]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:15:43 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2d9f7941-e2b3-43bb-aa15-0529182dc6b0 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:43 devstack sudo[92321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2d9f7941-e2b3-43bb-aa15-0529182dc6b0
Apr 28 22:15:43 devstack sudo[92321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:44 devstack cinder-volume[83924]: DEBUG dbcounter [-] [83924] Writing DB stats cinder:SELECT=45,cinder:UPDATE=39,cinder:INSERT=17,cinder:DELETE=4 {{(pid=83924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 28 22:15:44 devstack sudo[92321]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:44 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2d9f7941-e2b3-43bb-aa15-0529182dc6b0" returned: 0 in 0.720s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:44 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2d9f7941-e2b3-43bb-aa15-0529182dc6b0.f907d6e4-7033-4284-81d3-450b697fb981 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:44 devstack sudo[92326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2d9f7941-e2b3-43bb-aa15-0529182dc6b0.f907d6e4-7033-4284-81d3-450b697fb981
Apr 28 22:15:44 devstack sudo[92326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:44 devstack sudo[92326]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:44 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2d9f7941-e2b3-43bb-aa15-0529182dc6b0.f907d6e4-7033-4284-81d3-450b697fb981" returned: 0 in 0.649s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:44 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2d9f7941-e2b3-43bb-aa15-0529182dc6b0.f907d6e4-7033-4284-81d3-450b697fb981 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:44 devstack sudo[92331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2d9f7941-e2b3-43bb-aa15-0529182dc6b0.f907d6e4-7033-4284-81d3-450b697fb981
Apr 28 22:15:44 devstack sudo[92331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:45 devstack sudo[92331]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:45 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2d9f7941-e2b3-43bb-aa15-0529182dc6b0.f907d6e4-7033-4284-81d3-450b697fb981" returned: 0 in 0.573s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:45 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] Lock "cinder-quobyte-f907d6e4-7033-4284-81d3-450b697fb981" released by "_delete_snapshot" :: held 2.743s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:15:45 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.941s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:15:45 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-52c9ecff-3bba-4182-8bd8-8917d204f2cf tempest-VolumesExtendTest-1115418900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 13.511s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:15:45 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7188efcb-101c-4a86-abff-7e40d82e234c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cafbfb8-72f5-4945-9e37-c88d53853683', 'volume_size': 1, 'source_volid': '2d9f7941-e2b3-43bb-aa15-0529182dc6b0', 'source_volstatus': 'available'}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:15:45 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ef18672-91a1-4993-967a-fb1cb5f6f40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:15:45 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-52c9ecff-3bba-4182-8bd8-8917d204f2cf tempest-VolumesExtendTest-1115418900 None] Creating offline snapshot 2ef3ab7b-2d63-4911-8c29-050f3967d702 of volume ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b {{(pid=83924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 22:15:45 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] Volume volume-6cafbfb8-72f5-4945-9e37-c88d53853683 (6cafbfb8-72f5-4945-9e37-c88d53853683): created successfully
Apr 28 22:15:45 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ef18672-91a1-4993-967a-fb1cb5f6f40f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:15:45 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] Flow 'volume_create_manager' (1aebc7c6-b499-42c6-9aa2-41a757c4d400) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:15:45 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bfa67ba-e5f2-454d-90cd-0dc7a8863718]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:15:45 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-52c9ecff-3bba-4182-8bd8-8917d204f2cf tempest-VolumesExtendTest-1115418900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:45 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-b496e0ef-1653-41cb-af3a-c86af0b2add4 tempest-VolumeDependencyTests-1470240070 None] Created volume successfully.
Apr 28 22:15:45 devstack sudo[92334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b
Apr 28 22:15:45 devstack sudo[92334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:46 devstack sudo[92334]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-52c9ecff-3bba-4182-8bd8-8917d204f2cf tempest-VolumesExtendTest-1115418900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b" returned: 0 in 0.728s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-52c9ecff-3bba-4182-8bd8-8917d204f2cf tempest-VolumesExtendTest-1115418900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b.2ef3ab7b-2d63-4911-8c29-050f3967d702 1G {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:46 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-41f4d832-89b7-4f7f-9d81-d1e6aa32c7e9 tempest-VolumeDependencyTests-1470240070 None] Acquiring lock "cinder-2d9f7941-e2b3-43bb-aa15-0529182dc6b0-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:15:46 devstack sudo[92339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b.2ef3ab7b-2d63-4911-8c29-050f3967d702 1G
Apr 28 22:15:46 devstack sudo[92339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:46 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-41f4d832-89b7-4f7f-9d81-d1e6aa32c7e9 tempest-VolumeDependencyTests-1470240070 None] Lock "cinder-2d9f7941-e2b3-43bb-aa15-0529182dc6b0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:15:46 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-41f4d832-89b7-4f7f-9d81-d1e6aa32c7e9 tempest-VolumeDependencyTests-1470240070 None] Acquiring lock "cinder-quobyte-2d9f7941-e2b3-43bb-aa15-0529182dc6b0" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:15:46 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-41f4d832-89b7-4f7f-9d81-d1e6aa32c7e9 tempest-VolumeDependencyTests-1470240070 None] Lock "cinder-quobyte-2d9f7941-e2b3-43bb-aa15-0529182dc6b0" acquired by "delete_volume" :: waited 0.015s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:15:46 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[901c3c7c-b1a1-4cc5-a691-ce36a008fcf9]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:15:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-41f4d832-89b7-4f7f-9d81-d1e6aa32c7e9 tempest-VolumeDependencyTests-1470240070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2d9f7941-e2b3-43bb-aa15-0529182dc6b0 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:46 devstack sudo[92341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2d9f7941-e2b3-43bb-aa15-0529182dc6b0
Apr 28 22:15:46 devstack sudo[92341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:46 devstack sudo[92339]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-52c9ecff-3bba-4182-8bd8-8917d204f2cf tempest-VolumesExtendTest-1115418900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b.2ef3ab7b-2d63-4911-8c29-050f3967d702 1G" returned: 0 in 0.770s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-52c9ecff-3bba-4182-8bd8-8917d204f2cf tempest-VolumesExtendTest-1115418900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b.2ef3ab7b-2d63-4911-8c29-050f3967d702 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:46 devstack sudo[92349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b.2ef3ab7b-2d63-4911-8c29-050f3967d702
Apr 28 22:15:46 devstack sudo[92349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:46 devstack sudo[92341]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-41f4d832-89b7-4f7f-9d81-d1e6aa32c7e9 tempest-VolumeDependencyTests-1470240070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2d9f7941-e2b3-43bb-aa15-0529182dc6b0" returned: 0 in 0.731s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-41f4d832-89b7-4f7f-9d81-d1e6aa32c7e9 tempest-VolumeDependencyTests-1470240070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2d9f7941-e2b3-43bb-aa15-0529182dc6b0 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:47 devstack sudo[92351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2d9f7941-e2b3-43bb-aa15-0529182dc6b0
Apr 28 22:15:47 devstack sudo[92351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:47 devstack sudo[92349]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:47 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-52c9ecff-3bba-4182-8bd8-8917d204f2cf tempest-VolumesExtendTest-1115418900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b.2ef3ab7b-2d63-4911-8c29-050f3967d702" returned: 0 in 0.679s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:47 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-52c9ecff-3bba-4182-8bd8-8917d204f2cf tempest-VolumesExtendTest-1115418900 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b.2ef3ab7b-2d63-4911-8c29-050f3967d702 is being set with open permissions: ugo+rw
Apr 28 22:15:47 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-52c9ecff-3bba-4182-8bd8-8917d204f2cf tempest-VolumesExtendTest-1115418900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b.2ef3ab7b-2d63-4911-8c29-050f3967d702 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:47 devstack sudo[92351]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:47 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-41f4d832-89b7-4f7f-9d81-d1e6aa32c7e9 tempest-VolumeDependencyTests-1470240070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-2d9f7941-e2b3-43bb-aa15-0529182dc6b0" returned: 0 in 0.603s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:47 devstack sudo[92357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b.2ef3ab7b-2d63-4911-8c29-050f3967d702
Apr 28 22:15:47 devstack sudo[92357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:47 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-41f4d832-89b7-4f7f-9d81-d1e6aa32c7e9 tempest-VolumeDependencyTests-1470240070 None] Lock "cinder-quobyte-2d9f7941-e2b3-43bb-aa15-0529182dc6b0" released by "delete_volume" :: held 1.407s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:15:47 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-41f4d832-89b7-4f7f-9d81-d1e6aa32c7e9 tempest-VolumeDependencyTests-1470240070 None] Created reservations ['9db74224-03a7-4272-a995-97129a264bc4', '2c75ca27-dab0-4fdf-8305-e160479b68b5', '0598e360-35b1-4a0c-a879-df1df1c2dd69', '4dfa1b97-9bc7-4c35-98b4-5ade969c2a96'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:15:47 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-41f4d832-89b7-4f7f-9d81-d1e6aa32c7e9 tempest-VolumeDependencyTests-1470240070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:15:47 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-41f4d832-89b7-4f7f-9d81-d1e6aa32c7e9 tempest-VolumeDependencyTests-1470240070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:15:47 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-41f4d832-89b7-4f7f-9d81-d1e6aa32c7e9 tempest-VolumeDependencyTests-1470240070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:15:47 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-41f4d832-89b7-4f7f-9d81-d1e6aa32c7e9 tempest-VolumeDependencyTests-1470240070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:15:47 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-41f4d832-89b7-4f7f-9d81-d1e6aa32c7e9 tempest-VolumeDependencyTests-1470240070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:15:47 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-41f4d832-89b7-4f7f-9d81-d1e6aa32c7e9 tempest-VolumeDependencyTests-1470240070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:47 devstack sudo[92359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:15:47 devstack sudo[92359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:48 devstack sudo[92357]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:48 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-52c9ecff-3bba-4182-8bd8-8917d204f2cf tempest-VolumesExtendTest-1115418900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b.2ef3ab7b-2d63-4911-8c29-050f3967d702" returned: 0 in 0.618s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:48 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-52c9ecff-3bba-4182-8bd8-8917d204f2cf tempest-VolumesExtendTest-1115418900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b.info {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:48 devstack sudo[92362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b.info
Apr 28 22:15:48 devstack sudo[92362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:48 devstack sudo[92359]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:48 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-0f482bf1-f909-4eec-9434-a195bfbf7729 tempest-VolumeDependencyTests-1470240070 None] Acquiring lock "cinder-6cafbfb8-72f5-4945-9e37-c88d53853683-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:15:48 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-41f4d832-89b7-4f7f-9d81-d1e6aa32c7e9 tempest-VolumeDependencyTests-1470240070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.638s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:48 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-41f4d832-89b7-4f7f-9d81-d1e6aa32c7e9 tempest-VolumeDependencyTests-1470240070 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:15:48 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-0f482bf1-f909-4eec-9434-a195bfbf7729 tempest-VolumeDependencyTests-1470240070 None] Lock "cinder-6cafbfb8-72f5-4945-9e37-c88d53853683-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:15:48 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-41f4d832-89b7-4f7f-9d81-d1e6aa32c7e9 tempest-VolumeDependencyTests-1470240070 None] Deleted volume successfully.
Apr 28 22:15:48 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-41f4d832-89b7-4f7f-9d81-d1e6aa32c7e9 tempest-VolumeDependencyTests-1470240070 None] Lock "cinder-2d9f7941-e2b3-43bb-aa15-0529182dc6b0-delete_volume" released by "delete_volume" :: held 2.274s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:15:48 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-0f482bf1-f909-4eec-9434-a195bfbf7729 tempest-VolumeDependencyTests-1470240070 None] Acquiring lock "cinder-quobyte-6cafbfb8-72f5-4945-9e37-c88d53853683" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:15:48 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-0f482bf1-f909-4eec-9434-a195bfbf7729 tempest-VolumeDependencyTests-1470240070 None] Lock "cinder-quobyte-6cafbfb8-72f5-4945-9e37-c88d53853683" acquired by "delete_volume" :: waited 0.015s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:15:48 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a51a00c-7625-4013-a8a8-0ca8922e76b1]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:15:48 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-0f482bf1-f909-4eec-9434-a195bfbf7729 tempest-VolumeDependencyTests-1470240070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6cafbfb8-72f5-4945-9e37-c88d53853683 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:48 devstack sudo[92365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6cafbfb8-72f5-4945-9e37-c88d53853683
Apr 28 22:15:48 devstack sudo[92365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:48 devstack sudo[92362]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:48 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-52c9ecff-3bba-4182-8bd8-8917d204f2cf tempest-VolumesExtendTest-1115418900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b.info" returned: 0 in 0.647s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:48 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-52c9ecff-3bba-4182-8bd8-8917d204f2cf tempest-VolumesExtendTest-1115418900 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b.info is being set with open permissions: ugo+rw
Apr 28 22:15:48 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-52c9ecff-3bba-4182-8bd8-8917d204f2cf tempest-VolumesExtendTest-1115418900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b.info {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:48 devstack sudo[92368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b.info
Apr 28 22:15:48 devstack sudo[92368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:49 devstack sudo[92365]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:49 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-0f482bf1-f909-4eec-9434-a195bfbf7729 tempest-VolumeDependencyTests-1470240070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6cafbfb8-72f5-4945-9e37-c88d53853683" returned: 0 in 0.726s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:49 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-0f482bf1-f909-4eec-9434-a195bfbf7729 tempest-VolumeDependencyTests-1470240070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6cafbfb8-72f5-4945-9e37-c88d53853683 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:49 devstack sudo[92373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6cafbfb8-72f5-4945-9e37-c88d53853683
Apr 28 22:15:49 devstack sudo[92373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:49 devstack sudo[92368]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:49 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-52c9ecff-3bba-4182-8bd8-8917d204f2cf tempest-VolumesExtendTest-1115418900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b.info" returned: 0 in 0.579s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:49 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-52c9ecff-3bba-4182-8bd8-8917d204f2cf tempest-VolumesExtendTest-1115418900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.146s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:15:49 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-52c9ecff-3bba-4182-8bd8-8917d204f2cf tempest-VolumesExtendTest-1115418900 None] Create snapshot completed successfully
Apr 28 22:15:49 devstack sudo[92373]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:49 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-0f482bf1-f909-4eec-9434-a195bfbf7729 tempest-VolumeDependencyTests-1470240070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6cafbfb8-72f5-4945-9e37-c88d53853683" returned: 0 in 0.577s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:49 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-0f482bf1-f909-4eec-9434-a195bfbf7729 tempest-VolumeDependencyTests-1470240070 None] Lock "cinder-quobyte-6cafbfb8-72f5-4945-9e37-c88d53853683" released by "delete_volume" :: held 1.341s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:15:49 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-0f482bf1-f909-4eec-9434-a195bfbf7729 tempest-VolumeDependencyTests-1470240070 None] Created reservations ['64892692-0b1f-4348-9fb8-d54845ec0453', '3ddc756c-806b-41ef-9a06-4e8f7b101a92', '6267d737-cdb1-4711-8549-bdc74dd1e5ff', 'b4a39b42-1b7f-49e2-9e23-d24d7aaef709'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:15:49 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-0f482bf1-f909-4eec-9434-a195bfbf7729 tempest-VolumeDependencyTests-1470240070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:15:49 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-0f482bf1-f909-4eec-9434-a195bfbf7729 tempest-VolumeDependencyTests-1470240070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:15:49 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-0f482bf1-f909-4eec-9434-a195bfbf7729 tempest-VolumeDependencyTests-1470240070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:15:49 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-0f482bf1-f909-4eec-9434-a195bfbf7729 tempest-VolumeDependencyTests-1470240070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:15:49 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-0f482bf1-f909-4eec-9434-a195bfbf7729 tempest-VolumeDependencyTests-1470240070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:15:49 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-0f482bf1-f909-4eec-9434-a195bfbf7729 tempest-VolumeDependencyTests-1470240070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:49 devstack sudo[92377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:15:49 devstack sudo[92377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:50 devstack sudo[92377]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:50 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-0f482bf1-f909-4eec-9434-a195bfbf7729 tempest-VolumeDependencyTests-1470240070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.575s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:50 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-0f482bf1-f909-4eec-9434-a195bfbf7729 tempest-VolumeDependencyTests-1470240070 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:15:50 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-0f482bf1-f909-4eec-9434-a195bfbf7729 tempest-VolumeDependencyTests-1470240070 None] Deleted volume successfully.
Apr 28 22:15:50 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-0f482bf1-f909-4eec-9434-a195bfbf7729 tempest-VolumeDependencyTests-1470240070 None] Lock "cinder-6cafbfb8-72f5-4945-9e37-c88d53853683-delete_volume" released by "delete_volume" :: held 2.119s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:15:50 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-1dde8e05-7f25-4905-a418-7f47710b365a tempest-VolumeDependencyTests-1470240070 None] Acquiring lock "cinder-e0283d46-f96c-4cbe-a860-ead7969d4e7b-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:15:50 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-1aa3f4f7-cbc5-43f0-b9b3-636b5dec8463 tempest-VolumesExtendTest-1115418900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:15:50 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-1aa3f4f7-cbc5-43f0-b9b3-636b5dec8463 tempest-VolumesExtendTest-1115418900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:15:50 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-1dde8e05-7f25-4905-a418-7f47710b365a tempest-VolumeDependencyTests-1470240070 None] Lock "cinder-e0283d46-f96c-4cbe-a860-ead7969d4e7b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:15:50 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93e3e9e-eea4-4d89-bc1b-6bb26354abc5]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:15:50 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-1aa3f4f7-cbc5-43f0-b9b3-636b5dec8463 tempest-VolumesExtendTest-1115418900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:50 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-1dde8e05-7f25-4905-a418-7f47710b365a tempest-VolumeDependencyTests-1470240070 None] Acquiring lock "cinder-quobyte-e0283d46-f96c-4cbe-a860-ead7969d4e7b" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:15:50 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-1dde8e05-7f25-4905-a418-7f47710b365a tempest-VolumeDependencyTests-1470240070 None] Lock "cinder-quobyte-e0283d46-f96c-4cbe-a860-ead7969d4e7b" acquired by "delete_volume" :: waited 0.016s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:15:50 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f093ade7-0f58-4fad-a355-b420482bff50]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:15:50 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-1dde8e05-7f25-4905-a418-7f47710b365a tempest-VolumeDependencyTests-1470240070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-e0283d46-f96c-4cbe-a860-ead7969d4e7b {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:50 devstack sudo[92380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b
Apr 28 22:15:50 devstack sudo[92380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:50 devstack sudo[92381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-e0283d46-f96c-4cbe-a860-ead7969d4e7b
Apr 28 22:15:50 devstack sudo[92381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:51 devstack sudo[92380]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-1aa3f4f7-cbc5-43f0-b9b3-636b5dec8463 tempest-VolumesExtendTest-1115418900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b" returned: 0 in 0.708s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-1aa3f4f7-cbc5-43f0-b9b3-636b5dec8463 tempest-VolumesExtendTest-1115418900 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b.2ef3ab7b-2d63-4911-8c29-050f3967d702 2G {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:51 devstack sudo[92381]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-1dde8e05-7f25-4905-a418-7f47710b365a tempest-VolumeDependencyTests-1470240070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-e0283d46-f96c-4cbe-a860-ead7969d4e7b" returned: 0 in 0.731s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-1dde8e05-7f25-4905-a418-7f47710b365a tempest-VolumeDependencyTests-1470240070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-e0283d46-f96c-4cbe-a860-ead7969d4e7b {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:51 devstack sudo[92393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-e0283d46-f96c-4cbe-a860-ead7969d4e7b
Apr 28 22:15:51 devstack sudo[92393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-1aa3f4f7-cbc5-43f0-b9b3-636b5dec8463 tempest-VolumesExtendTest-1115418900 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b.2ef3ab7b-2d63-4911-8c29-050f3967d702 2G" returned: 0 in 0.132s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-1aa3f4f7-cbc5-43f0-b9b3-636b5dec8463 tempest-VolumesExtendTest-1115418900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.882s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:15:51 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-1aa3f4f7-cbc5-43f0-b9b3-636b5dec8463 tempest-VolumesExtendTest-1115418900 None] Extend volume completed successfully.
Apr 28 22:15:51 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-7c505121-482f-4a6d-a34e-aa0163531259 tempest-VolumesExtendTest-1115418900 None] Acquiring lock "cinder-2ef3ab7b-2d63-4911-8c29-050f3967d702-delete_snapshot" by "delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:15:51 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-7c505121-482f-4a6d-a34e-aa0163531259 tempest-VolumesExtendTest-1115418900 None] Lock "cinder-2ef3ab7b-2d63-4911-8c29-050f3967d702-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:15:51 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-7c505121-482f-4a6d-a34e-aa0163531259 tempest-VolumesExtendTest-1115418900 None] Acquiring lock "cinder-quobyte-ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b" by "delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:15:51 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-7c505121-482f-4a6d-a34e-aa0163531259 tempest-VolumesExtendTest-1115418900 None] Lock "cinder-quobyte-ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b" acquired by "delete_snapshot" :: waited 0.016s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:15:51 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-7c505121-482f-4a6d-a34e-aa0163531259 tempest-VolumesExtendTest-1115418900 None] Acquiring lock "cinder-quobyte-2ef3ab7b-2d63-4911-8c29-050f3967d702" by "_delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:15:51 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-7c505121-482f-4a6d-a34e-aa0163531259 tempest-VolumesExtendTest-1115418900 None] Lock "cinder-quobyte-2ef3ab7b-2d63-4911-8c29-050f3967d702" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:15:51 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-7c505121-482f-4a6d-a34e-aa0163531259 tempest-VolumesExtendTest-1115418900 None] Deleting offline snapshot 2ef3ab7b-2d63-4911-8c29-050f3967d702 of volume ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 22:15:51 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-7c505121-482f-4a6d-a34e-aa0163531259 tempest-VolumesExtendTest-1115418900 None] snapshot_file for this snap is: volume-ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b.2ef3ab7b-2d63-4911-8c29-050f3967d702 {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 22:15:52 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d2daaf-7e45-4013-b29a-b92100756012]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:15:52 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7c505121-482f-4a6d-a34e-aa0163531259 tempest-VolumesExtendTest-1115418900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b.2ef3ab7b-2d63-4911-8c29-050f3967d702 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:52 devstack sudo[92395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b.2ef3ab7b-2d63-4911-8c29-050f3967d702
Apr 28 22:15:52 devstack sudo[92395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:52 devstack sudo[92393]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:52 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-1dde8e05-7f25-4905-a418-7f47710b365a tempest-VolumeDependencyTests-1470240070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-e0283d46-f96c-4cbe-a860-ead7969d4e7b" returned: 0 in 0.638s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:52 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-1dde8e05-7f25-4905-a418-7f47710b365a tempest-VolumeDependencyTests-1470240070 None] Lock "cinder-quobyte-e0283d46-f96c-4cbe-a860-ead7969d4e7b" released by "delete_volume" :: held 1.411s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:15:52 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-1dde8e05-7f25-4905-a418-7f47710b365a tempest-VolumeDependencyTests-1470240070 None] Created reservations ['e7c1a0ea-5208-4733-b3b8-ec8d5bf2b221', '6661b3a1-35c6-4be6-86e6-7183779d00ac', '847f3223-6ee1-433a-bd29-3d506f694df4', 'fc9168c2-6c8a-40b4-9911-f4941adf6b32'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:15:52 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-1dde8e05-7f25-4905-a418-7f47710b365a tempest-VolumeDependencyTests-1470240070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:15:52 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-1dde8e05-7f25-4905-a418-7f47710b365a tempest-VolumeDependencyTests-1470240070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:15:52 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-1dde8e05-7f25-4905-a418-7f47710b365a tempest-VolumeDependencyTests-1470240070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:15:52 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-1dde8e05-7f25-4905-a418-7f47710b365a tempest-VolumeDependencyTests-1470240070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:15:52 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-1dde8e05-7f25-4905-a418-7f47710b365a tempest-VolumeDependencyTests-1470240070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:15:52 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-1dde8e05-7f25-4905-a418-7f47710b365a tempest-VolumeDependencyTests-1470240070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:52 devstack sudo[92398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:15:52 devstack sudo[92398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:52 devstack sudo[92395]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:52 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7c505121-482f-4a6d-a34e-aa0163531259 tempest-VolumesExtendTest-1115418900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b.2ef3ab7b-2d63-4911-8c29-050f3967d702" returned: 0 in 0.747s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:52 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-7c505121-482f-4a6d-a34e-aa0163531259 tempest-VolumesExtendTest-1115418900 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 22:15:52 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c15a6c-2574-4c32-901c-74eb2b6d7d25]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:15:52 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7c505121-482f-4a6d-a34e-aa0163531259 tempest-VolumesExtendTest-1115418900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:52 devstack sudo[92403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b
Apr 28 22:15:52 devstack sudo[92403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:52 devstack sudo[92398]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:52 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-1dde8e05-7f25-4905-a418-7f47710b365a tempest-VolumeDependencyTests-1470240070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.683s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:52 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-1dde8e05-7f25-4905-a418-7f47710b365a tempest-VolumeDependencyTests-1470240070 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:15:52 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-1dde8e05-7f25-4905-a418-7f47710b365a tempest-VolumeDependencyTests-1470240070 None] Deleted volume successfully.
Apr 28 22:15:53 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-1dde8e05-7f25-4905-a418-7f47710b365a tempest-VolumeDependencyTests-1470240070 None] Lock "cinder-e0283d46-f96c-4cbe-a860-ead7969d4e7b-delete_volume" released by "delete_volume" :: held 2.341s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:15:53 devstack sudo[92403]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:53 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7c505121-482f-4a6d-a34e-aa0163531259 tempest-VolumesExtendTest-1115418900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b" returned: 0 in 0.777s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:53 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7c505121-482f-4a6d-a34e-aa0163531259 tempest-VolumesExtendTest-1115418900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b.2ef3ab7b-2d63-4911-8c29-050f3967d702 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:53 devstack sudo[92410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b.2ef3ab7b-2d63-4911-8c29-050f3967d702
Apr 28 22:15:53 devstack sudo[92410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:54 devstack sudo[92410]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:54 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7c505121-482f-4a6d-a34e-aa0163531259 tempest-VolumesExtendTest-1115418900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b.2ef3ab7b-2d63-4911-8c29-050f3967d702" returned: 0 in 0.783s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:54 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7c505121-482f-4a6d-a34e-aa0163531259 tempest-VolumesExtendTest-1115418900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b.2ef3ab7b-2d63-4911-8c29-050f3967d702 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:54 devstack sudo[92416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b.2ef3ab7b-2d63-4911-8c29-050f3967d702
Apr 28 22:15:54 devstack sudo[92416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:54 devstack sudo[92416]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:54 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7c505121-482f-4a6d-a34e-aa0163531259 tempest-VolumesExtendTest-1115418900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b.2ef3ab7b-2d63-4911-8c29-050f3967d702" returned: 0 in 0.600s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:54 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-7c505121-482f-4a6d-a34e-aa0163531259 tempest-VolumesExtendTest-1115418900 None] Lock "cinder-quobyte-2ef3ab7b-2d63-4911-8c29-050f3967d702" released by "_delete_snapshot" :: held 3.016s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:15:54 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-7c505121-482f-4a6d-a34e-aa0163531259 tempest-VolumesExtendTest-1115418900 None] Lock "cinder-quobyte-ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b" released by "delete_snapshot" :: held 3.044s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:15:55 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-7c505121-482f-4a6d-a34e-aa0163531259 tempest-VolumesExtendTest-1115418900 None] Created reservations ['40eb5a07-76e9-4faf-8e84-b58cb8975476', '23dc6a27-1a54-4daa-a6bc-849890940441', 'ddf30ef6-4cc9-4ac8-adc0-c4e20af4e624', 'f1703347-ccac-4026-b5b7-576db4a510af'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:15:55 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-7c505121-482f-4a6d-a34e-aa0163531259 tempest-VolumesExtendTest-1115418900 None] Delete snapshot completed successfully.
Apr 28 22:15:55 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-7c505121-482f-4a6d-a34e-aa0163531259 tempest-VolumesExtendTest-1115418900 None] Lock "cinder-2ef3ab7b-2d63-4911-8c29-050f3967d702-delete_snapshot" released by "delete_snapshot" :: held 3.190s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:15:56 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-7d886f13-dd57-470e-a79a-9f63d2ca3c09 tempest-VolumesExtendTest-1115418900 None] Acquiring lock "cinder-ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:15:56 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-7d886f13-dd57-470e-a79a-9f63d2ca3c09 tempest-VolumesExtendTest-1115418900 None] Lock "cinder-ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:15:56 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-7d886f13-dd57-470e-a79a-9f63d2ca3c09 tempest-VolumesExtendTest-1115418900 None] Acquiring lock "cinder-quobyte-ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:15:56 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-7d886f13-dd57-470e-a79a-9f63d2ca3c09 tempest-VolumesExtendTest-1115418900 None] Lock "cinder-quobyte-ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b" acquired by "delete_volume" :: waited 0.013s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:15:56 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7bd17c-71b0-42ef-833b-8327c6080131]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:15:56 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7d886f13-dd57-470e-a79a-9f63d2ca3c09 tempest-VolumesExtendTest-1115418900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:56 devstack sudo[92419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b
Apr 28 22:15:56 devstack sudo[92419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:57 devstack sudo[92419]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:57 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7d886f13-dd57-470e-a79a-9f63d2ca3c09 tempest-VolumesExtendTest-1115418900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b" returned: 0 in 0.749s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:57 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7d886f13-dd57-470e-a79a-9f63d2ca3c09 tempest-VolumesExtendTest-1115418900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:57 devstack sudo[92424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b
Apr 28 22:15:57 devstack sudo[92424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:57 devstack sudo[92424]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:57 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7d886f13-dd57-470e-a79a-9f63d2ca3c09 tempest-VolumesExtendTest-1115418900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b" returned: 0 in 0.567s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:57 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-7d886f13-dd57-470e-a79a-9f63d2ca3c09 tempest-VolumesExtendTest-1115418900 None] Lock "cinder-quobyte-ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b" released by "delete_volume" :: held 1.371s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:15:57 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-7d886f13-dd57-470e-a79a-9f63d2ca3c09 tempest-VolumesExtendTest-1115418900 None] Created reservations ['343c06fa-b3d6-46b8-8bb1-400729534db5', 'b7a1909b-3ec3-4596-80c9-fa839161d8b4', 'bc4e6749-8239-46ca-b9bc-a93337add6ac', '4ceea526-56fe-4b57-ac81-aaa43c15235c'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:15:57 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-7d886f13-dd57-470e-a79a-9f63d2ca3c09 tempest-VolumesExtendTest-1115418900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:15:57 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-7d886f13-dd57-470e-a79a-9f63d2ca3c09 tempest-VolumesExtendTest-1115418900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:15:57 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-7d886f13-dd57-470e-a79a-9f63d2ca3c09 tempest-VolumesExtendTest-1115418900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:15:57 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-7d886f13-dd57-470e-a79a-9f63d2ca3c09 tempest-VolumesExtendTest-1115418900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:15:57 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-7d886f13-dd57-470e-a79a-9f63d2ca3c09 tempest-VolumesExtendTest-1115418900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:15:57 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7d886f13-dd57-470e-a79a-9f63d2ca3c09 tempest-VolumesExtendTest-1115418900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:15:57 devstack sudo[92427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:15:57 devstack sudo[92427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:15:58 devstack sudo[92427]: pam_unix(sudo:session): session closed for user root
Apr 28 22:15:58 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7d886f13-dd57-470e-a79a-9f63d2ca3c09 tempest-VolumesExtendTest-1115418900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.609s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:15:58 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-7d886f13-dd57-470e-a79a-9f63d2ca3c09 tempest-VolumesExtendTest-1115418900 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:15:58 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-7d886f13-dd57-470e-a79a-9f63d2ca3c09 tempest-VolumesExtendTest-1115418900 None] Deleted volume successfully.
Apr 28 22:15:58 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-7d886f13-dd57-470e-a79a-9f63d2ca3c09 tempest-VolumesExtendTest-1115418900 None] Lock "cinder-ed485fa1-26d1-40b7-ad1b-b93cb96dbe4b-delete_volume" released by "delete_volume" :: held 2.170s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:16:00 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9c6f9f1-c25d-45da-97eb-817885d25f6c tempest-VolumesGetTest-2004936499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:16:00 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b9c6f9f1-c25d-45da-97eb-817885d25f6c tempest-VolumesGetTest-2004936499 None] Flow 'volume_create_manager' (3c4d4479-7f02-4c5c-b083-b8a9ee2acf85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:16:00 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b9c6f9f1-c25d-45da-97eb-817885d25f6c tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c83c3b0-736b-4ed1-9603-67cf6c8b727d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:16:00 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b9c6f9f1-c25d-45da-97eb-817885d25f6c tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c83c3b0-736b-4ed1-9603-67cf6c8b727d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:16:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1693046646',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9186e356-fecd-4aed-b40b-c3677c401d46,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='59efabb3c53c4ff18b30b6927da3a729',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:16:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:16:01Z,use_quota=True,user_id='8010fe4423504fbe919b8e6b005d29c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:16:00 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b9c6f9f1-c25d-45da-97eb-817885d25f6c tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5020ca92-6502-4e57-b97a-9a15c6e86135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:16:00 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b9c6f9f1-c25d-45da-97eb-817885d25f6c tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5020ca92-6502-4e57-b97a-9a15c6e86135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:16:00 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b9c6f9f1-c25d-45da-97eb-817885d25f6c tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ad071e9-b6f9-4865-b72d-6b1043608dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:16:00 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b9c6f9f1-c25d-45da-97eb-817885d25f6c tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ad071e9-b6f9-4865-b72d-6b1043608dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9186e356-fecd-4aed-b40b-c3677c401d46', 'volume_name': 'volume-9186e356-fecd-4aed-b40b-c3677c401d46', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:16:00 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b9c6f9f1-c25d-45da-97eb-817885d25f6c tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83a1ebe2-6027-45c6-9711-f0f902d8b974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:16:00 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b9c6f9f1-c25d-45da-97eb-817885d25f6c tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83a1ebe2-6027-45c6-9711-f0f902d8b974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:16:00 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b9c6f9f1-c25d-45da-97eb-817885d25f6c tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48bbdb40-5283-461d-86be-4e0e274acd15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:16:00 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-b9c6f9f1-c25d-45da-97eb-817885d25f6c tempest-VolumesGetTest-2004936499 None] Volume 9186e356-fecd-4aed-b40b-c3677c401d46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9186e356-fecd-4aed-b40b-c3677c401d46', 'volume_size': 1}
Apr 28 22:16:00 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b9c6f9f1-c25d-45da-97eb-817885d25f6c tempest-VolumesGetTest-2004936499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:16:00 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b9c6f9f1-c25d-45da-97eb-817885d25f6c tempest-VolumesGetTest-2004936499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:16:00 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-b9c6f9f1-c25d-45da-97eb-817885d25f6c tempest-VolumesGetTest-2004936499 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:16:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1693046646',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9186e356-fecd-4aed-b40b-c3677c401d46,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='59efabb3c53c4ff18b30b6927da3a729',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:16:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:16:01Z,use_quota=True,user_id='8010fe4423504fbe919b8e6b005d29c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:16:00 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-b9c6f9f1-c25d-45da-97eb-817885d25f6c tempest-VolumesGetTest-2004936499 None] Creating volume 9186e356-fecd-4aed-b40b-c3677c401d46 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:16:00 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b9c6f9f1-c25d-45da-97eb-817885d25f6c tempest-VolumesGetTest-2004936499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:16:00 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b9c6f9f1-c25d-45da-97eb-817885d25f6c tempest-VolumesGetTest-2004936499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:16:00 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-b9c6f9f1-c25d-45da-97eb-817885d25f6c tempest-VolumesGetTest-2004936499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:16:00 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-b9c6f9f1-c25d-45da-97eb-817885d25f6c tempest-VolumesGetTest-2004936499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:16:00 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b9c6f9f1-c25d-45da-97eb-817885d25f6c tempest-VolumesGetTest-2004936499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:16:00 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-b9c6f9f1-c25d-45da-97eb-817885d25f6c tempest-VolumesGetTest-2004936499 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:16:00 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-b9c6f9f1-c25d-45da-97eb-817885d25f6c tempest-VolumesGetTest-2004936499 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:16:00 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b9c6f9f1-c25d-45da-97eb-817885d25f6c tempest-VolumesGetTest-2004936499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9186e356-fecd-4aed-b40b-c3677c401d46 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:16:00 devstack sudo[92430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9186e356-fecd-4aed-b40b-c3677c401d46 1073741824
Apr 28 22:16:00 devstack sudo[92430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:16:01 devstack sudo[92430]: pam_unix(sudo:session): session closed for user root
Apr 28 22:16:01 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b9c6f9f1-c25d-45da-97eb-817885d25f6c tempest-VolumesGetTest-2004936499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9186e356-fecd-4aed-b40b-c3677c401d46 1073741824" returned: 0 in 0.753s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:16:01 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b9c6f9f1-c25d-45da-97eb-817885d25f6c tempest-VolumesGetTest-2004936499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9186e356-fecd-4aed-b40b-c3677c401d46 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:16:01 devstack sudo[92436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9186e356-fecd-4aed-b40b-c3677c401d46
Apr 28 22:16:01 devstack sudo[92436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:16:02 devstack sudo[92436]: pam_unix(sudo:session): session closed for user root
Apr 28 22:16:02 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b9c6f9f1-c25d-45da-97eb-817885d25f6c tempest-VolumesGetTest-2004936499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9186e356-fecd-4aed-b40b-c3677c401d46" returned: 0 in 0.587s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:16:02 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-b9c6f9f1-c25d-45da-97eb-817885d25f6c tempest-VolumesGetTest-2004936499 None] <== create_volume: return (1379ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:16:02 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b9c6f9f1-c25d-45da-97eb-817885d25f6c tempest-VolumesGetTest-2004936499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.382s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:16:02 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b9c6f9f1-c25d-45da-97eb-817885d25f6c tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48bbdb40-5283-461d-86be-4e0e274acd15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9186e356-fecd-4aed-b40b-c3677c401d46', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:16:02 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b9c6f9f1-c25d-45da-97eb-817885d25f6c tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d26e8b9e-e964-49c0-91ce-a23495eed7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:16:02 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-b9c6f9f1-c25d-45da-97eb-817885d25f6c tempest-VolumesGetTest-2004936499 None] Volume volume-9186e356-fecd-4aed-b40b-c3677c401d46 (9186e356-fecd-4aed-b40b-c3677c401d46): created successfully
Apr 28 22:16:02 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b9c6f9f1-c25d-45da-97eb-817885d25f6c tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d26e8b9e-e964-49c0-91ce-a23495eed7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:16:02 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b9c6f9f1-c25d-45da-97eb-817885d25f6c tempest-VolumesGetTest-2004936499 None] Flow 'volume_create_manager' (3c4d4479-7f02-4c5c-b083-b8a9ee2acf85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:16:02 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-b9c6f9f1-c25d-45da-97eb-817885d25f6c tempest-VolumesGetTest-2004936499 None] Created volume successfully.
Apr 28 22:16:03 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-22128228-b45d-4fd4-8faf-c95b4f4ecada tempest-VolumesGetTest-2004936499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:16:03 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-22128228-b45d-4fd4-8faf-c95b4f4ecada tempest-VolumesGetTest-2004936499 None] Flow 'volume_create_manager' (6efe12fd-c322-4a0f-aee8-b11ea3860aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:16:03 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-22128228-b45d-4fd4-8faf-c95b4f4ecada tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee644fe6-9921-4286-a1a1-dafba2ca7dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:16:03 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-22128228-b45d-4fd4-8faf-c95b4f4ecada tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee644fe6-9921-4286-a1a1-dafba2ca7dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:16:03Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1026825332',display_name='tempest-VolumesGetTest-Volume-1536947212',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65683456-01e2-4e0b-8860-f1b66ee8abcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59efabb3c53c4ff18b30b6927da3a729',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:16:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:16:04Z,use_quota=True,user_id='8010fe4423504fbe919b8e6b005d29c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:16:03 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-22128228-b45d-4fd4-8faf-c95b4f4ecada tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28be83a5-5ed2-476c-af5b-b53f7965c28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:16:03 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-22128228-b45d-4fd4-8faf-c95b4f4ecada tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28be83a5-5ed2-476c-af5b-b53f7965c28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:16:03 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-22128228-b45d-4fd4-8faf-c95b4f4ecada tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92f38137-2018-446a-822f-08e486120074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:16:03 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-22128228-b45d-4fd4-8faf-c95b4f4ecada tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92f38137-2018-446a-822f-08e486120074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65683456-01e2-4e0b-8860-f1b66ee8abcc', 'volume_name': 'volume-65683456-01e2-4e0b-8860-f1b66ee8abcc', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:16:03 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-22128228-b45d-4fd4-8faf-c95b4f4ecada tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92635e41-ac8e-4e40-a3cf-e853dd6de6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:16:03 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-22128228-b45d-4fd4-8faf-c95b4f4ecada tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92635e41-ac8e-4e40-a3cf-e853dd6de6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:16:03 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-22128228-b45d-4fd4-8faf-c95b4f4ecada tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3cf5e06-7323-4083-bf93-a2ea4fd32933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:16:03 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-22128228-b45d-4fd4-8faf-c95b4f4ecada tempest-VolumesGetTest-2004936499 None] Volume 65683456-01e2-4e0b-8860-f1b66ee8abcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65683456-01e2-4e0b-8860-f1b66ee8abcc', 'volume_size': 1}
Apr 28 22:16:03 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-22128228-b45d-4fd4-8faf-c95b4f4ecada tempest-VolumesGetTest-2004936499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:16:03 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-22128228-b45d-4fd4-8faf-c95b4f4ecada tempest-VolumesGetTest-2004936499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:16:03 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-22128228-b45d-4fd4-8faf-c95b4f4ecada tempest-VolumesGetTest-2004936499 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:16:03Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1026825332',display_name='tempest-VolumesGetTest-Volume-1536947212',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65683456-01e2-4e0b-8860-f1b66ee8abcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59efabb3c53c4ff18b30b6927da3a729',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:16:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:16:04Z,use_quota=True,user_id='8010fe4423504fbe919b8e6b005d29c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:16:03 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-22128228-b45d-4fd4-8faf-c95b4f4ecada tempest-VolumesGetTest-2004936499 None] Creating volume 65683456-01e2-4e0b-8860-f1b66ee8abcc {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:16:03 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-22128228-b45d-4fd4-8faf-c95b4f4ecada tempest-VolumesGetTest-2004936499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:16:03 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-22128228-b45d-4fd4-8faf-c95b4f4ecada tempest-VolumesGetTest-2004936499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:16:03 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-22128228-b45d-4fd4-8faf-c95b4f4ecada tempest-VolumesGetTest-2004936499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:16:03 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-22128228-b45d-4fd4-8faf-c95b4f4ecada tempest-VolumesGetTest-2004936499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:16:03 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-22128228-b45d-4fd4-8faf-c95b4f4ecada tempest-VolumesGetTest-2004936499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:16:03 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-22128228-b45d-4fd4-8faf-c95b4f4ecada tempest-VolumesGetTest-2004936499 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:16:03 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-22128228-b45d-4fd4-8faf-c95b4f4ecada tempest-VolumesGetTest-2004936499 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:16:03 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-22128228-b45d-4fd4-8faf-c95b4f4ecada tempest-VolumesGetTest-2004936499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-65683456-01e2-4e0b-8860-f1b66ee8abcc 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:16:03 devstack sudo[92440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-65683456-01e2-4e0b-8860-f1b66ee8abcc 1073741824
Apr 28 22:16:03 devstack sudo[92440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:16:04 devstack sudo[92440]: pam_unix(sudo:session): session closed for user root
Apr 28 22:16:04 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-22128228-b45d-4fd4-8faf-c95b4f4ecada tempest-VolumesGetTest-2004936499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-65683456-01e2-4e0b-8860-f1b66ee8abcc 1073741824" returned: 0 in 0.766s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:16:04 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-22128228-b45d-4fd4-8faf-c95b4f4ecada tempest-VolumesGetTest-2004936499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-65683456-01e2-4e0b-8860-f1b66ee8abcc {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:16:04 devstack sudo[92445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-65683456-01e2-4e0b-8860-f1b66ee8abcc
Apr 28 22:16:04 devstack sudo[92445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:16:05 devstack sudo[92445]: pam_unix(sudo:session): session closed for user root
Apr 28 22:16:05 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-22128228-b45d-4fd4-8faf-c95b4f4ecada tempest-VolumesGetTest-2004936499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-65683456-01e2-4e0b-8860-f1b66ee8abcc" returned: 0 in 0.629s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:16:05 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-22128228-b45d-4fd4-8faf-c95b4f4ecada tempest-VolumesGetTest-2004936499 None] <== create_volume: return (1435ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:16:05 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-22128228-b45d-4fd4-8faf-c95b4f4ecada tempest-VolumesGetTest-2004936499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.438s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:16:05 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-22128228-b45d-4fd4-8faf-c95b4f4ecada tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3cf5e06-7323-4083-bf93-a2ea4fd32933) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65683456-01e2-4e0b-8860-f1b66ee8abcc', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:16:05 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-22128228-b45d-4fd4-8faf-c95b4f4ecada tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d420d0bc-a9ca-4b55-b4ab-6a9f38bcc81b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:16:05 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-22128228-b45d-4fd4-8faf-c95b4f4ecada tempest-VolumesGetTest-2004936499 None] Volume volume-65683456-01e2-4e0b-8860-f1b66ee8abcc (65683456-01e2-4e0b-8860-f1b66ee8abcc): created successfully
Apr 28 22:16:05 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-22128228-b45d-4fd4-8faf-c95b4f4ecada tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d420d0bc-a9ca-4b55-b4ab-6a9f38bcc81b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:16:05 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-22128228-b45d-4fd4-8faf-c95b4f4ecada tempest-VolumesGetTest-2004936499 None] Flow 'volume_create_manager' (6efe12fd-c322-4a0f-aee8-b11ea3860aa9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:16:05 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-22128228-b45d-4fd4-8faf-c95b4f4ecada tempest-VolumesGetTest-2004936499 None] Created volume successfully.
Apr 28 22:16:05 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-f3e36237-e111-4bda-a7ac-759d9c48267a tempest-VolumesGetTest-2004936499 None] Acquiring lock "cinder-65683456-01e2-4e0b-8860-f1b66ee8abcc-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:16:05 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-f3e36237-e111-4bda-a7ac-759d9c48267a tempest-VolumesGetTest-2004936499 None] Lock "cinder-65683456-01e2-4e0b-8860-f1b66ee8abcc-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:16:05 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-f3e36237-e111-4bda-a7ac-759d9c48267a tempest-VolumesGetTest-2004936499 None] Acquiring lock "cinder-quobyte-65683456-01e2-4e0b-8860-f1b66ee8abcc" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:16:05 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-f3e36237-e111-4bda-a7ac-759d9c48267a tempest-VolumesGetTest-2004936499 None] Lock "cinder-quobyte-65683456-01e2-4e0b-8860-f1b66ee8abcc" acquired by "delete_volume" :: waited 0.016s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:16:05 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90ad045-b136-4da3-b8f4-9aa29b257ea3]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:16:05 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f3e36237-e111-4bda-a7ac-759d9c48267a tempest-VolumesGetTest-2004936499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-65683456-01e2-4e0b-8860-f1b66ee8abcc {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:16:06 devstack sudo[92448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-65683456-01e2-4e0b-8860-f1b66ee8abcc
Apr 28 22:16:06 devstack sudo[92448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:16:06 devstack sudo[92448]: pam_unix(sudo:session): session closed for user root
Apr 28 22:16:06 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f3e36237-e111-4bda-a7ac-759d9c48267a tempest-VolumesGetTest-2004936499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-65683456-01e2-4e0b-8860-f1b66ee8abcc" returned: 0 in 0.721s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:16:06 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f3e36237-e111-4bda-a7ac-759d9c48267a tempest-VolumesGetTest-2004936499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-65683456-01e2-4e0b-8860-f1b66ee8abcc {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:16:06 devstack sudo[92453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-65683456-01e2-4e0b-8860-f1b66ee8abcc
Apr 28 22:16:06 devstack sudo[92453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:16:07 devstack sudo[92453]: pam_unix(sudo:session): session closed for user root
Apr 28 22:16:07 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f3e36237-e111-4bda-a7ac-759d9c48267a tempest-VolumesGetTest-2004936499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-65683456-01e2-4e0b-8860-f1b66ee8abcc" returned: 0 in 0.601s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:16:07 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-f3e36237-e111-4bda-a7ac-759d9c48267a tempest-VolumesGetTest-2004936499 None] Lock "cinder-quobyte-65683456-01e2-4e0b-8860-f1b66ee8abcc" released by "delete_volume" :: held 1.372s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:16:07 devstack cinder-volume[83924]: DEBUG dbcounter [-] [83924] Writing DB stats cinder:SELECT=78,cinder:INSERT=31,cinder:UPDATE=91,cinder:DELETE=8 {{(pid=83924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 28 22:16:07 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-f3e36237-e111-4bda-a7ac-759d9c48267a tempest-VolumesGetTest-2004936499 None] Created reservations ['fecb4f4c-2146-42da-911e-37aaa911aa28', '7fcc9e79-949a-4c38-88ae-1ecc18d6e2c4', 'c8141cfe-0dc4-4d20-96ee-128b249b9d8d', '73fb5e2c-3652-4fae-9a7d-3a394b32f341'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:16:07 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f3e36237-e111-4bda-a7ac-759d9c48267a tempest-VolumesGetTest-2004936499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:16:07 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f3e36237-e111-4bda-a7ac-759d9c48267a tempest-VolumesGetTest-2004936499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:16:07 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-f3e36237-e111-4bda-a7ac-759d9c48267a tempest-VolumesGetTest-2004936499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:16:07 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-f3e36237-e111-4bda-a7ac-759d9c48267a tempest-VolumesGetTest-2004936499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:16:07 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f3e36237-e111-4bda-a7ac-759d9c48267a tempest-VolumesGetTest-2004936499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:16:07 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f3e36237-e111-4bda-a7ac-759d9c48267a tempest-VolumesGetTest-2004936499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:16:07 devstack sudo[92456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:16:07 devstack sudo[92456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:16:07 devstack sudo[92456]: pam_unix(sudo:session): session closed for user root
Apr 28 22:16:07 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f3e36237-e111-4bda-a7ac-759d9c48267a tempest-VolumesGetTest-2004936499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.592s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:16:07 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-f3e36237-e111-4bda-a7ac-759d9c48267a tempest-VolumesGetTest-2004936499 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:16:08 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-f3e36237-e111-4bda-a7ac-759d9c48267a tempest-VolumesGetTest-2004936499 None] Deleted volume successfully.
Apr 28 22:16:08 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-f3e36237-e111-4bda-a7ac-759d9c48267a tempest-VolumesGetTest-2004936499 None] Lock "cinder-65683456-01e2-4e0b-8860-f1b66ee8abcc-delete_volume" released by "delete_volume" :: held 2.153s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:16:08 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-f0e11465-e11c-49c7-9788-6bf08295d91d tempest-VolumesGetTest-2004936499 None] Acquiring lock "cinder-9186e356-fecd-4aed-b40b-c3677c401d46-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:16:08 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-f0e11465-e11c-49c7-9788-6bf08295d91d tempest-VolumesGetTest-2004936499 None] Lock "cinder-9186e356-fecd-4aed-b40b-c3677c401d46-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:16:08 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-f0e11465-e11c-49c7-9788-6bf08295d91d tempest-VolumesGetTest-2004936499 None] Acquiring lock "cinder-quobyte-9186e356-fecd-4aed-b40b-c3677c401d46" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:16:08 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-f0e11465-e11c-49c7-9788-6bf08295d91d tempest-VolumesGetTest-2004936499 None] Lock "cinder-quobyte-9186e356-fecd-4aed-b40b-c3677c401d46" acquired by "delete_volume" :: waited 0.017s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:16:08 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0695f29e-a061-4a75-bb90-ca153557ff20]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:16:08 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f0e11465-e11c-49c7-9788-6bf08295d91d tempest-VolumesGetTest-2004936499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9186e356-fecd-4aed-b40b-c3677c401d46 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:16:08 devstack sudo[92459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9186e356-fecd-4aed-b40b-c3677c401d46
Apr 28 22:16:08 devstack sudo[92459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:16:08 devstack sudo[92459]: pam_unix(sudo:session): session closed for user root
Apr 28 22:16:08 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f0e11465-e11c-49c7-9788-6bf08295d91d tempest-VolumesGetTest-2004936499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9186e356-fecd-4aed-b40b-c3677c401d46" returned: 0 in 0.681s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:16:08 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f0e11465-e11c-49c7-9788-6bf08295d91d tempest-VolumesGetTest-2004936499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9186e356-fecd-4aed-b40b-c3677c401d46 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:16:08 devstack sudo[92464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9186e356-fecd-4aed-b40b-c3677c401d46
Apr 28 22:16:08 devstack sudo[92464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:16:09 devstack sudo[92464]: pam_unix(sudo:session): session closed for user root
Apr 28 22:16:09 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f0e11465-e11c-49c7-9788-6bf08295d91d tempest-VolumesGetTest-2004936499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9186e356-fecd-4aed-b40b-c3677c401d46" returned: 0 in 0.568s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:16:09 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-f0e11465-e11c-49c7-9788-6bf08295d91d tempest-VolumesGetTest-2004936499 None] Lock "cinder-quobyte-9186e356-fecd-4aed-b40b-c3677c401d46" released by "delete_volume" :: held 1.287s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:16:09 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-f0e11465-e11c-49c7-9788-6bf08295d91d tempest-VolumesGetTest-2004936499 None] Created reservations ['3d14fdbf-cb8b-44af-a744-fbf71284eeb2', '17d84237-6fbd-4be4-9714-c6e9756bbaed', '53db5246-1115-4f3b-9389-1949037480f6', 'eb340fd1-e28a-4bd1-9621-7ff4551bd2b2'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:16:09 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f0e11465-e11c-49c7-9788-6bf08295d91d tempest-VolumesGetTest-2004936499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:16:09 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f0e11465-e11c-49c7-9788-6bf08295d91d tempest-VolumesGetTest-2004936499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:16:09 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-f0e11465-e11c-49c7-9788-6bf08295d91d tempest-VolumesGetTest-2004936499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:16:09 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-f0e11465-e11c-49c7-9788-6bf08295d91d tempest-VolumesGetTest-2004936499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:16:09 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f0e11465-e11c-49c7-9788-6bf08295d91d tempest-VolumesGetTest-2004936499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:16:09 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f0e11465-e11c-49c7-9788-6bf08295d91d tempest-VolumesGetTest-2004936499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:16:09 devstack sudo[92467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:16:09 devstack sudo[92467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:16:10 devstack sudo[92467]: pam_unix(sudo:session): session closed for user root
Apr 28 22:16:10 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f0e11465-e11c-49c7-9788-6bf08295d91d tempest-VolumesGetTest-2004936499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.544s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:16:10 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-f0e11465-e11c-49c7-9788-6bf08295d91d tempest-VolumesGetTest-2004936499 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:16:10 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-f0e11465-e11c-49c7-9788-6bf08295d91d tempest-VolumesGetTest-2004936499 None] Deleted volume successfully.
Apr 28 22:16:10 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-f0e11465-e11c-49c7-9788-6bf08295d91d tempest-VolumesGetTest-2004936499 None] Lock "cinder-9186e356-fecd-4aed-b40b-c3677c401d46-delete_volume" released by "delete_volume" :: held 2.005s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:16:10 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa2b4711-99ea-4519-92e0-fdcad35cadf9 tempest-VolumesGetTest-2004936499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:16:10 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-aa2b4711-99ea-4519-92e0-fdcad35cadf9 tempest-VolumesGetTest-2004936499 None] Flow 'volume_create_manager' (a5a14090-e1ea-4e9d-b253-1a0b405fcf6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:16:10 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-aa2b4711-99ea-4519-92e0-fdcad35cadf9 tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23907f15-4fe1-414d-a617-8c939cde7426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:16:10 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-aa2b4711-99ea-4519-92e0-fdcad35cadf9 tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23907f15-4fe1-414d-a617-8c939cde7426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:16:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-658127558',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce649c4a-0be0-40e9-ba6d-1e6bf0138277,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59efabb3c53c4ff18b30b6927da3a729',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:16:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:16:11Z,use_quota=True,user_id='8010fe4423504fbe919b8e6b005d29c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:16:10 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-aa2b4711-99ea-4519-92e0-fdcad35cadf9 tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bd57152-9055-4c30-8bce-0012e3ccd299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:16:10 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-aa2b4711-99ea-4519-92e0-fdcad35cadf9 tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bd57152-9055-4c30-8bce-0012e3ccd299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:16:10 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-aa2b4711-99ea-4519-92e0-fdcad35cadf9 tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (257673ec-a3d0-4b7a-ac8b-adcafe4a42e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:16:10 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-aa2b4711-99ea-4519-92e0-fdcad35cadf9 tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (257673ec-a3d0-4b7a-ac8b-adcafe4a42e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce649c4a-0be0-40e9-ba6d-1e6bf0138277', 'volume_name': 'volume-ce649c4a-0be0-40e9-ba6d-1e6bf0138277', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:16:10 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-aa2b4711-99ea-4519-92e0-fdcad35cadf9 tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b25a2966-1e8f-46ac-81ec-7b46a5c7b7e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:16:10 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-aa2b4711-99ea-4519-92e0-fdcad35cadf9 tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b25a2966-1e8f-46ac-81ec-7b46a5c7b7e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:16:10 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-aa2b4711-99ea-4519-92e0-fdcad35cadf9 tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b3456cc-0c58-4024-874b-97c8c98b80e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:16:10 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-aa2b4711-99ea-4519-92e0-fdcad35cadf9 tempest-VolumesGetTest-2004936499 None] Volume ce649c4a-0be0-40e9-ba6d-1e6bf0138277: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce649c4a-0be0-40e9-ba6d-1e6bf0138277', 'volume_size': 1}
Apr 28 22:16:10 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-aa2b4711-99ea-4519-92e0-fdcad35cadf9 tempest-VolumesGetTest-2004936499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:16:10 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-aa2b4711-99ea-4519-92e0-fdcad35cadf9 tempest-VolumesGetTest-2004936499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:16:10 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-aa2b4711-99ea-4519-92e0-fdcad35cadf9 tempest-VolumesGetTest-2004936499 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:16:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-658127558',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce649c4a-0be0-40e9-ba6d-1e6bf0138277,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59efabb3c53c4ff18b30b6927da3a729',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:16:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:16:11Z,use_quota=True,user_id='8010fe4423504fbe919b8e6b005d29c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:16:10 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-aa2b4711-99ea-4519-92e0-fdcad35cadf9 tempest-VolumesGetTest-2004936499 None] Creating volume ce649c4a-0be0-40e9-ba6d-1e6bf0138277 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:16:10 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-aa2b4711-99ea-4519-92e0-fdcad35cadf9 tempest-VolumesGetTest-2004936499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:16:10 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-aa2b4711-99ea-4519-92e0-fdcad35cadf9 tempest-VolumesGetTest-2004936499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:16:10 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-aa2b4711-99ea-4519-92e0-fdcad35cadf9 tempest-VolumesGetTest-2004936499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:16:10 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-aa2b4711-99ea-4519-92e0-fdcad35cadf9 tempest-VolumesGetTest-2004936499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:16:10 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-aa2b4711-99ea-4519-92e0-fdcad35cadf9 tempest-VolumesGetTest-2004936499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:16:10 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-aa2b4711-99ea-4519-92e0-fdcad35cadf9 tempest-VolumesGetTest-2004936499 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:16:10 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-aa2b4711-99ea-4519-92e0-fdcad35cadf9 tempest-VolumesGetTest-2004936499 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:16:10 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-aa2b4711-99ea-4519-92e0-fdcad35cadf9 tempest-VolumesGetTest-2004936499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ce649c4a-0be0-40e9-ba6d-1e6bf0138277 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:16:10 devstack sudo[92470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ce649c4a-0be0-40e9-ba6d-1e6bf0138277 1073741824
Apr 28 22:16:10 devstack sudo[92470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:16:11 devstack sudo[92470]: pam_unix(sudo:session): session closed for user root
Apr 28 22:16:11 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-aa2b4711-99ea-4519-92e0-fdcad35cadf9 tempest-VolumesGetTest-2004936499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ce649c4a-0be0-40e9-ba6d-1e6bf0138277 1073741824" returned: 0 in 0.733s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:16:11 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-aa2b4711-99ea-4519-92e0-fdcad35cadf9 tempest-VolumesGetTest-2004936499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ce649c4a-0be0-40e9-ba6d-1e6bf0138277 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:16:11 devstack sudo[92475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ce649c4a-0be0-40e9-ba6d-1e6bf0138277
Apr 28 22:16:11 devstack sudo[92475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:16:12 devstack sudo[92475]: pam_unix(sudo:session): session closed for user root
Apr 28 22:16:12 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-aa2b4711-99ea-4519-92e0-fdcad35cadf9 tempest-VolumesGetTest-2004936499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ce649c4a-0be0-40e9-ba6d-1e6bf0138277" returned: 0 in 0.560s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:16:12 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-aa2b4711-99ea-4519-92e0-fdcad35cadf9 tempest-VolumesGetTest-2004936499 None] <== create_volume: return (1332ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:16:12 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-aa2b4711-99ea-4519-92e0-fdcad35cadf9 tempest-VolumesGetTest-2004936499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.335s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:16:12 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-aa2b4711-99ea-4519-92e0-fdcad35cadf9 tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b3456cc-0c58-4024-874b-97c8c98b80e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce649c4a-0be0-40e9-ba6d-1e6bf0138277', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:16:12 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-aa2b4711-99ea-4519-92e0-fdcad35cadf9 tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6edba473-c5c0-429a-976c-ff82fe3ca65a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:16:12 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-aa2b4711-99ea-4519-92e0-fdcad35cadf9 tempest-VolumesGetTest-2004936499 None] Volume volume-ce649c4a-0be0-40e9-ba6d-1e6bf0138277 (ce649c4a-0be0-40e9-ba6d-1e6bf0138277): created successfully
Apr 28 22:16:12 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-aa2b4711-99ea-4519-92e0-fdcad35cadf9 tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6edba473-c5c0-429a-976c-ff82fe3ca65a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:16:12 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-aa2b4711-99ea-4519-92e0-fdcad35cadf9 tempest-VolumesGetTest-2004936499 None] Flow 'volume_create_manager' (a5a14090-e1ea-4e9d-b253-1a0b405fcf6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:16:12 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-aa2b4711-99ea-4519-92e0-fdcad35cadf9 tempest-VolumesGetTest-2004936499 None] Created volume successfully.
Apr 28 22:16:13 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:16:13 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] Flow 'volume_create_manager' (cb05af3f-597e-4f91-9c1c-2184c7b5e128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:16:13 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a2631be-4e16-4d99-b302-33564c9fc78b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:16:13 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a2631be-4e16-4d99-b302-33564c9fc78b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:16:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1367928213',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b3ef4f8-7deb-4aac-856c-118ec28874f2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='59efabb3c53c4ff18b30b6927da3a729',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:16:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=ce649c4a-0be0-40e9-ba6d-1e6bf0138277,status='creating',terminated_at=None,updated_at=2026-04-28T20:16:13Z,use_quota=True,user_id='8010fe4423504fbe919b8e6b005d29c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:16:13 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3b552f4-51f3-484b-818f-1ca9f972396c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:16:13 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3b552f4-51f3-484b-818f-1ca9f972396c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:16:13 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (059f92ed-f6f2-4f42-9a54-ab8516649245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:16:13 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (059f92ed-f6f2-4f42-9a54-ab8516649245) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '8b3ef4f8-7deb-4aac-856c-118ec28874f2', 'volume_name': 'volume-8b3ef4f8-7deb-4aac-856c-118ec28874f2', 'volume_size': 1, 'source_volid': 'ce649c4a-0be0-40e9-ba6d-1e6bf0138277', 'source_volstatus': 'available'}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:16:13 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d8b317a-471b-4352-8078-b5c91ff56487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:16:13 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d8b317a-471b-4352-8078-b5c91ff56487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:16:13 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95beb842-007b-4952-ae92-970a9b12b49b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:16:13 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] Volume 8b3ef4f8-7deb-4aac-856c-118ec28874f2: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-8b3ef4f8-7deb-4aac-856c-118ec28874f2', 'volume_size': 1, 'source_volid': 'ce649c4a-0be0-40e9-ba6d-1e6bf0138277', 'source_volstatus': 'available'}
Apr 28 22:16:13 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:16:13 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:16:13 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] Cloning volume ce649c4a-0be0-40e9-ba6d-1e6bf0138277 to volume 8b3ef4f8-7deb-4aac-856c-118ec28874f2
Apr 28 22:16:13 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] Creating offline snapshot cf8d2f34-583c-4c77-92e8-9b2882914827 of volume ce649c4a-0be0-40e9-ba6d-1e6bf0138277 {{(pid=83924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 22:16:13 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a0aafc-ba55-40ad-9f36-b01b68c0eb1b]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:16:13 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ce649c4a-0be0-40e9-ba6d-1e6bf0138277 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:16:13 devstack sudo[92479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ce649c4a-0be0-40e9-ba6d-1e6bf0138277
Apr 28 22:16:13 devstack sudo[92479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:16:13 devstack sudo[92479]: pam_unix(sudo:session): session closed for user root
Apr 28 22:16:13 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ce649c4a-0be0-40e9-ba6d-1e6bf0138277" returned: 0 in 0.664s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:16:13 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ce649c4a-0be0-40e9-ba6d-1e6bf0138277,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ce649c4a-0be0-40e9-ba6d-1e6bf0138277.cf8d2f34-583c-4c77-92e8-9b2882914827 1G {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:16:14 devstack sudo[92484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ce649c4a-0be0-40e9-ba6d-1e6bf0138277,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ce649c4a-0be0-40e9-ba6d-1e6bf0138277.cf8d2f34-583c-4c77-92e8-9b2882914827 1G
Apr 28 22:16:14 devstack sudo[92484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:16:14 devstack sudo[92484]: pam_unix(sudo:session): session closed for user root
Apr 28 22:16:14 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ce649c4a-0be0-40e9-ba6d-1e6bf0138277,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ce649c4a-0be0-40e9-ba6d-1e6bf0138277.cf8d2f34-583c-4c77-92e8-9b2882914827 1G" returned: 0 in 0.733s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:16:14 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce649c4a-0be0-40e9-ba6d-1e6bf0138277 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ce649c4a-0be0-40e9-ba6d-1e6bf0138277.cf8d2f34-583c-4c77-92e8-9b2882914827 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:16:14 devstack sudo[92489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce649c4a-0be0-40e9-ba6d-1e6bf0138277 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ce649c4a-0be0-40e9-ba6d-1e6bf0138277.cf8d2f34-583c-4c77-92e8-9b2882914827
Apr 28 22:16:14 devstack sudo[92489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:16:15 devstack sudo[92489]: pam_unix(sudo:session): session closed for user root
Apr 28 22:16:15 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce649c4a-0be0-40e9-ba6d-1e6bf0138277 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ce649c4a-0be0-40e9-ba6d-1e6bf0138277.cf8d2f34-583c-4c77-92e8-9b2882914827" returned: 0 in 0.623s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:16:15 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ce649c4a-0be0-40e9-ba6d-1e6bf0138277.cf8d2f34-583c-4c77-92e8-9b2882914827 is being set with open permissions: ugo+rw
Apr 28 22:16:15 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ce649c4a-0be0-40e9-ba6d-1e6bf0138277.cf8d2f34-583c-4c77-92e8-9b2882914827 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:16:15 devstack sudo[92494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ce649c4a-0be0-40e9-ba6d-1e6bf0138277.cf8d2f34-583c-4c77-92e8-9b2882914827
Apr 28 22:16:15 devstack sudo[92494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:16:15 devstack sudo[92494]: pam_unix(sudo:session): session closed for user root
Apr 28 22:16:15 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ce649c4a-0be0-40e9-ba6d-1e6bf0138277.cf8d2f34-583c-4c77-92e8-9b2882914827" returned: 0 in 0.582s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:16:15 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ce649c4a-0be0-40e9-ba6d-1e6bf0138277.info {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:16:15 devstack sudo[92497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ce649c4a-0be0-40e9-ba6d-1e6bf0138277.info
Apr 28 22:16:15 devstack sudo[92497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:16:16 devstack sudo[92497]: pam_unix(sudo:session): session closed for user root
Apr 28 22:16:16 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ce649c4a-0be0-40e9-ba6d-1e6bf0138277.info" returned: 0 in 0.581s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:16:16 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ce649c4a-0be0-40e9-ba6d-1e6bf0138277.info is being set with open permissions: ugo+rw
Apr 28 22:16:16 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ce649c4a-0be0-40e9-ba6d-1e6bf0138277.info {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:16:16 devstack sudo[92500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ce649c4a-0be0-40e9-ba6d-1e6bf0138277.info
Apr 28 22:16:16 devstack sudo[92500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:16:17 devstack sudo[92500]: pam_unix(sudo:session): session closed for user root
Apr 28 22:16:17 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ce649c4a-0be0-40e9-ba6d-1e6bf0138277.info" returned: 0 in 0.567s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:16:17 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] Acquiring lock "cinder-quobyte-8b3ef4f8-7deb-4aac-856c-118ec28874f2" by "_copy_volume_from_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:16:17 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] Lock "cinder-quobyte-8b3ef4f8-7deb-4aac-856c-118ec28874f2" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:16:17 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] snapshot: cf8d2f34-583c-4c77-92e8-9b2882914827, volume: 8b3ef4f8-7deb-4aac-856c-118ec28874f2,  {{(pid=83924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 28 22:16:17 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:16:17 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:16:17 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:16:17 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:16:17 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:16:17 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9d893c-0021-40af-b20e-9eab8a435c54]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:16:17 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ce649c4a-0be0-40e9-ba6d-1e6bf0138277.cf8d2f34-583c-4c77-92e8-9b2882914827 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:16:17 devstack sudo[92503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ce649c4a-0be0-40e9-ba6d-1e6bf0138277.cf8d2f34-583c-4c77-92e8-9b2882914827
Apr 28 22:16:17 devstack sudo[92503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:16:17 devstack sudo[92503]: pam_unix(sudo:session): session closed for user root
Apr 28 22:16:17 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ce649c4a-0be0-40e9-ba6d-1e6bf0138277.cf8d2f34-583c-4c77-92e8-9b2882914827" returned: 0 in 0.680s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:16:17 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce649c4a-0be0-40e9-ba6d-1e6bf0138277(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 22:16:17 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ce649c4a-0be0-40e9-ba6d-1e6bf0138277 {{(pid=83924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 28 22:16:17 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] Creating direct copy from snapshot {{(pid=83924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 28 22:16:17 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb2067a-01dc-42ce-9957-7f226fa1ee36]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:16:17 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ce649c4a-0be0-40e9-ba6d-1e6bf0138277 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:16:17 devstack sudo[92508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ce649c4a-0be0-40e9-ba6d-1e6bf0138277
Apr 28 22:16:17 devstack sudo[92508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:16:18 devstack sudo[92508]: pam_unix(sudo:session): session closed for user root
Apr 28 22:16:18 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ce649c4a-0be0-40e9-ba6d-1e6bf0138277" returned: 0 in 0.717s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:16:18 devstack cinder-volume[83924]: DEBUG cinder.utils [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] Path /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8b3ef4f8-7deb-4aac-856c-118ec28874f2 not found in is_blk_device check {{(pid=83924) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 28 22:16:18 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ce649c4a-0be0-40e9-ba6d-1e6bf0138277 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8b3ef4f8-7deb-4aac-856c-118ec28874f2 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:16:18 devstack sudo[92513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ce649c4a-0be0-40e9-ba6d-1e6bf0138277 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8b3ef4f8-7deb-4aac-856c-118ec28874f2
Apr 28 22:16:18 devstack sudo[92513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:16:22 devstack sudo[92513]: pam_unix(sudo:session): session closed for user root
Apr 28 22:16:22 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ce649c4a-0be0-40e9-ba6d-1e6bf0138277 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8b3ef4f8-7deb-4aac-856c-118ec28874f2" returned: 0 in 4.139s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:16:22 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44f6aa4-c571-4815-9704-540727d46078]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:16:22 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ce649c4a-0be0-40e9-ba6d-1e6bf0138277 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:16:22 devstack sudo[92562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ce649c4a-0be0-40e9-ba6d-1e6bf0138277
Apr 28 22:16:22 devstack sudo[92562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:16:23 devstack sudo[92562]: pam_unix(sudo:session): session closed for user root
Apr 28 22:16:23 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ce649c4a-0be0-40e9-ba6d-1e6bf0138277" returned: 0 in 0.823s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:16:23 devstack cinder-volume[83924]: DEBUG cinder.image.image_utils [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] Image conversion details: src /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ce649c4a-0be0-40e9-ba6d-1e6bf0138277, size 1024.00 MB, duration 4.14 sec, destination /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8b3ef4f8-7deb-4aac-856c-118ec28874f2 {{(pid=83924) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 28 22:16:23 devstack cinder-volume[83924]: INFO cinder.image.image_utils [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] Converted 1024.00 MB image at 247.35 MB/s
Apr 28 22:16:23 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8b3ef4f8-7deb-4aac-856c-118ec28874f2 is being set with open permissions: ugo+rw
Apr 28 22:16:23 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8b3ef4f8-7deb-4aac-856c-118ec28874f2 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:16:23 devstack sudo[92568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8b3ef4f8-7deb-4aac-856c-118ec28874f2
Apr 28 22:16:23 devstack sudo[92568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:16:24 devstack sudo[92568]: pam_unix(sudo:session): session closed for user root
Apr 28 22:16:24 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8b3ef4f8-7deb-4aac-856c-118ec28874f2" returned: 0 in 0.557s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:16:24 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] Lock "cinder-quobyte-8b3ef4f8-7deb-4aac-856c-118ec28874f2" released by "_copy_volume_from_snapshot" :: held 6.988s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:16:24 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] Acquiring lock "cinder-quobyte-cf8d2f34-583c-4c77-92e8-9b2882914827" by "_delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:16:24 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] Lock "cinder-quobyte-cf8d2f34-583c-4c77-92e8-9b2882914827" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:16:24 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] Deleting offline snapshot cf8d2f34-583c-4c77-92e8-9b2882914827 of volume ce649c4a-0be0-40e9-ba6d-1e6bf0138277 {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 22:16:24 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] snapshot_file for this snap is: volume-ce649c4a-0be0-40e9-ba6d-1e6bf0138277.cf8d2f34-583c-4c77-92e8-9b2882914827 {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 22:16:24 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[31583188-8593-469c-a208-85dea85f8644]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:16:24 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ce649c4a-0be0-40e9-ba6d-1e6bf0138277.cf8d2f34-583c-4c77-92e8-9b2882914827 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:16:24 devstack sudo[92571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ce649c4a-0be0-40e9-ba6d-1e6bf0138277.cf8d2f34-583c-4c77-92e8-9b2882914827
Apr 28 22:16:24 devstack sudo[92571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:16:24 devstack sudo[92571]: pam_unix(sudo:session): session closed for user root
Apr 28 22:16:24 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ce649c4a-0be0-40e9-ba6d-1e6bf0138277.cf8d2f34-583c-4c77-92e8-9b2882914827" returned: 0 in 0.679s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:16:24 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce649c4a-0be0-40e9-ba6d-1e6bf0138277(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 22:16:24 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5f307a-214e-4400-b014-6e2523e9ac17]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:16:24 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ce649c4a-0be0-40e9-ba6d-1e6bf0138277 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:16:24 devstack sudo[92576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ce649c4a-0be0-40e9-ba6d-1e6bf0138277
Apr 28 22:16:24 devstack sudo[92576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:16:25 devstack sudo[92576]: pam_unix(sudo:session): session closed for user root
Apr 28 22:16:25 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ce649c4a-0be0-40e9-ba6d-1e6bf0138277" returned: 0 in 0.709s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:16:25 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ce649c4a-0be0-40e9-ba6d-1e6bf0138277.cf8d2f34-583c-4c77-92e8-9b2882914827 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:16:25 devstack sudo[92588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ce649c4a-0be0-40e9-ba6d-1e6bf0138277.cf8d2f34-583c-4c77-92e8-9b2882914827
Apr 28 22:16:25 devstack sudo[92588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:16:26 devstack sudo[92588]: pam_unix(sudo:session): session closed for user root
Apr 28 22:16:26 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ce649c4a-0be0-40e9-ba6d-1e6bf0138277.cf8d2f34-583c-4c77-92e8-9b2882914827" returned: 0 in 0.629s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:16:26 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ce649c4a-0be0-40e9-ba6d-1e6bf0138277.cf8d2f34-583c-4c77-92e8-9b2882914827 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:16:26 devstack sudo[92593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ce649c4a-0be0-40e9-ba6d-1e6bf0138277.cf8d2f34-583c-4c77-92e8-9b2882914827
Apr 28 22:16:26 devstack sudo[92593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:16:26 devstack sudo[92593]: pam_unix(sudo:session): session closed for user root
Apr 28 22:16:26 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ce649c4a-0be0-40e9-ba6d-1e6bf0138277.cf8d2f34-583c-4c77-92e8-9b2882914827" returned: 0 in 0.558s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:16:26 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] Lock "cinder-quobyte-cf8d2f34-583c-4c77-92e8-9b2882914827" released by "_delete_snapshot" :: held 2.659s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:16:26 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.559s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:16:26 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95beb842-007b-4952-ae92-970a9b12b49b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b3ef4f8-7deb-4aac-856c-118ec28874f2', 'volume_size': 1, 'source_volid': 'ce649c4a-0be0-40e9-ba6d-1e6bf0138277', 'source_volstatus': 'available'}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:16:26 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef745f73-3b9b-47c7-b042-3249f25edf93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:16:26 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] Volume volume-8b3ef4f8-7deb-4aac-856c-118ec28874f2 (8b3ef4f8-7deb-4aac-856c-118ec28874f2): created successfully
Apr 28 22:16:26 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef745f73-3b9b-47c7-b042-3249f25edf93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:16:26 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] Flow 'volume_create_manager' (cb05af3f-597e-4f91-9c1c-2184c7b5e128) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:16:26 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-7e763218-4f4b-4df1-a081-457b58cfc398 tempest-VolumesGetTest-2004936499 None] Created volume successfully.
Apr 28 22:16:27 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-843a8d4c-6958-477a-b34e-fbe64b9487b7 tempest-VolumesGetTest-2004936499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:16:27 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-843a8d4c-6958-477a-b34e-fbe64b9487b7 tempest-VolumesGetTest-2004936499 None] Flow 'volume_create_manager' (55c01f95-73ca-490c-82e6-1dba063b044c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:16:27 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-843a8d4c-6958-477a-b34e-fbe64b9487b7 tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e9cf093-5339-41cf-8bec-3ef833d0850a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:16:27 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-843a8d4c-6958-477a-b34e-fbe64b9487b7 tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e9cf093-5339-41cf-8bec-3ef833d0850a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:16:27Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-737668656',display_name='tempest-VolumesGetTest-Volume-107435952',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbc5b43b-06b5-4376-8870-2f75e87da5c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59efabb3c53c4ff18b30b6927da3a729',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:16:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:16:28Z,use_quota=True,user_id='8010fe4423504fbe919b8e6b005d29c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:16:27 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-843a8d4c-6958-477a-b34e-fbe64b9487b7 tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03278082-961f-4ee1-a15b-d3c6433a96a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:16:27 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-843a8d4c-6958-477a-b34e-fbe64b9487b7 tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03278082-961f-4ee1-a15b-d3c6433a96a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:16:27 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-843a8d4c-6958-477a-b34e-fbe64b9487b7 tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9936d20a-8505-4808-98b3-62a27d5622e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:16:27 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-843a8d4c-6958-477a-b34e-fbe64b9487b7 tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9936d20a-8505-4808-98b3-62a27d5622e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbc5b43b-06b5-4376-8870-2f75e87da5c8', 'volume_name': 'volume-bbc5b43b-06b5-4376-8870-2f75e87da5c8', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:16:27 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-843a8d4c-6958-477a-b34e-fbe64b9487b7 tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4f63672-00f7-4890-ad14-49adb0505367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:16:27 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-843a8d4c-6958-477a-b34e-fbe64b9487b7 tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4f63672-00f7-4890-ad14-49adb0505367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:16:27 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-843a8d4c-6958-477a-b34e-fbe64b9487b7 tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce9f0e8a-2082-41c6-bec1-cc3fc6685813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:16:27 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-843a8d4c-6958-477a-b34e-fbe64b9487b7 tempest-VolumesGetTest-2004936499 None] Volume bbc5b43b-06b5-4376-8870-2f75e87da5c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbc5b43b-06b5-4376-8870-2f75e87da5c8', 'volume_size': 1}
Apr 28 22:16:27 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-843a8d4c-6958-477a-b34e-fbe64b9487b7 tempest-VolumesGetTest-2004936499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:16:27 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-843a8d4c-6958-477a-b34e-fbe64b9487b7 tempest-VolumesGetTest-2004936499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:16:27 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-843a8d4c-6958-477a-b34e-fbe64b9487b7 tempest-VolumesGetTest-2004936499 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:16:27Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-737668656',display_name='tempest-VolumesGetTest-Volume-107435952',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbc5b43b-06b5-4376-8870-2f75e87da5c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59efabb3c53c4ff18b30b6927da3a729',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:16:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:16:28Z,use_quota=True,user_id='8010fe4423504fbe919b8e6b005d29c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:16:27 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-843a8d4c-6958-477a-b34e-fbe64b9487b7 tempest-VolumesGetTest-2004936499 None] Creating volume bbc5b43b-06b5-4376-8870-2f75e87da5c8 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:16:27 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-843a8d4c-6958-477a-b34e-fbe64b9487b7 tempest-VolumesGetTest-2004936499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:16:27 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-843a8d4c-6958-477a-b34e-fbe64b9487b7 tempest-VolumesGetTest-2004936499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:16:27 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-843a8d4c-6958-477a-b34e-fbe64b9487b7 tempest-VolumesGetTest-2004936499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:16:27 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-843a8d4c-6958-477a-b34e-fbe64b9487b7 tempest-VolumesGetTest-2004936499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:16:27 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-843a8d4c-6958-477a-b34e-fbe64b9487b7 tempest-VolumesGetTest-2004936499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:16:27 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-843a8d4c-6958-477a-b34e-fbe64b9487b7 tempest-VolumesGetTest-2004936499 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:16:27 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-843a8d4c-6958-477a-b34e-fbe64b9487b7 tempest-VolumesGetTest-2004936499 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:16:27 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-843a8d4c-6958-477a-b34e-fbe64b9487b7 tempest-VolumesGetTest-2004936499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-bbc5b43b-06b5-4376-8870-2f75e87da5c8 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:16:27 devstack sudo[92596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-bbc5b43b-06b5-4376-8870-2f75e87da5c8 1073741824
Apr 28 22:16:27 devstack sudo[92596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:16:28 devstack sudo[92596]: pam_unix(sudo:session): session closed for user root
Apr 28 22:16:28 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-843a8d4c-6958-477a-b34e-fbe64b9487b7 tempest-VolumesGetTest-2004936499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-bbc5b43b-06b5-4376-8870-2f75e87da5c8 1073741824" returned: 0 in 0.751s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:16:28 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-843a8d4c-6958-477a-b34e-fbe64b9487b7 tempest-VolumesGetTest-2004936499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-bbc5b43b-06b5-4376-8870-2f75e87da5c8 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:16:28 devstack sudo[92601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-bbc5b43b-06b5-4376-8870-2f75e87da5c8
Apr 28 22:16:28 devstack sudo[92601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:16:29 devstack sudo[92601]: pam_unix(sudo:session): session closed for user root
Apr 28 22:16:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-843a8d4c-6958-477a-b34e-fbe64b9487b7 tempest-VolumesGetTest-2004936499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-bbc5b43b-06b5-4376-8870-2f75e87da5c8" returned: 0 in 0.593s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:16:29 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-843a8d4c-6958-477a-b34e-fbe64b9487b7 tempest-VolumesGetTest-2004936499 None] <== create_volume: return (1385ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:16:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-843a8d4c-6958-477a-b34e-fbe64b9487b7 tempest-VolumesGetTest-2004936499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.387s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:16:29 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-843a8d4c-6958-477a-b34e-fbe64b9487b7 tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce9f0e8a-2082-41c6-bec1-cc3fc6685813) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbc5b43b-06b5-4376-8870-2f75e87da5c8', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:16:29 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-843a8d4c-6958-477a-b34e-fbe64b9487b7 tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15599674-1f03-4ae8-9c41-a62a0dc98630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:16:29 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-843a8d4c-6958-477a-b34e-fbe64b9487b7 tempest-VolumesGetTest-2004936499 None] Volume volume-bbc5b43b-06b5-4376-8870-2f75e87da5c8 (bbc5b43b-06b5-4376-8870-2f75e87da5c8): created successfully
Apr 28 22:16:29 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-843a8d4c-6958-477a-b34e-fbe64b9487b7 tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15599674-1f03-4ae8-9c41-a62a0dc98630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:16:29 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-843a8d4c-6958-477a-b34e-fbe64b9487b7 tempest-VolumesGetTest-2004936499 None] Flow 'volume_create_manager' (55c01f95-73ca-490c-82e6-1dba063b044c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:16:29 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-843a8d4c-6958-477a-b34e-fbe64b9487b7 tempest-VolumesGetTest-2004936499 None] Created volume successfully.
Apr 28 22:16:29 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-15125180-7a53-4df3-8439-bdf3566ac900 tempest-VolumesGetTest-2004936499 None] Acquiring lock "cinder-bbc5b43b-06b5-4376-8870-2f75e87da5c8-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:16:29 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-15125180-7a53-4df3-8439-bdf3566ac900 tempest-VolumesGetTest-2004936499 None] Lock "cinder-bbc5b43b-06b5-4376-8870-2f75e87da5c8-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:16:30 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-15125180-7a53-4df3-8439-bdf3566ac900 tempest-VolumesGetTest-2004936499 None] Acquiring lock "cinder-quobyte-bbc5b43b-06b5-4376-8870-2f75e87da5c8" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:16:30 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-15125180-7a53-4df3-8439-bdf3566ac900 tempest-VolumesGetTest-2004936499 None] Lock "cinder-quobyte-bbc5b43b-06b5-4376-8870-2f75e87da5c8" acquired by "delete_volume" :: waited 0.015s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:16:30 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[59bd19d4-e4de-45d6-a3c3-c4af0d89b18d]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:16:30 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-15125180-7a53-4df3-8439-bdf3566ac900 tempest-VolumesGetTest-2004936499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-bbc5b43b-06b5-4376-8870-2f75e87da5c8 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:16:30 devstack sudo[92604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-bbc5b43b-06b5-4376-8870-2f75e87da5c8
Apr 28 22:16:30 devstack sudo[92604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:16:30 devstack sudo[92604]: pam_unix(sudo:session): session closed for user root
Apr 28 22:16:30 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-15125180-7a53-4df3-8439-bdf3566ac900 tempest-VolumesGetTest-2004936499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-bbc5b43b-06b5-4376-8870-2f75e87da5c8" returned: 0 in 0.675s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:16:30 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-15125180-7a53-4df3-8439-bdf3566ac900 tempest-VolumesGetTest-2004936499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-bbc5b43b-06b5-4376-8870-2f75e87da5c8 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:16:30 devstack sudo[92609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-bbc5b43b-06b5-4376-8870-2f75e87da5c8
Apr 28 22:16:30 devstack sudo[92609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:16:31 devstack sudo[92609]: pam_unix(sudo:session): session closed for user root
Apr 28 22:16:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-15125180-7a53-4df3-8439-bdf3566ac900 tempest-VolumesGetTest-2004936499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-bbc5b43b-06b5-4376-8870-2f75e87da5c8" returned: 0 in 0.562s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:16:31 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-15125180-7a53-4df3-8439-bdf3566ac900 tempest-VolumesGetTest-2004936499 None] Lock "cinder-quobyte-bbc5b43b-06b5-4376-8870-2f75e87da5c8" released by "delete_volume" :: held 1.273s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:16:31 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-15125180-7a53-4df3-8439-bdf3566ac900 tempest-VolumesGetTest-2004936499 None] Created reservations ['3123515b-e7ef-4b47-aa6e-f1497c9c0d6c', 'e9ad72e5-7832-4a93-bf55-16361c98d127', 'dd07f467-8ec3-4114-9403-c124111105d5', '16b5d137-027a-41ac-bc8b-be1e7a96d986'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:16:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-15125180-7a53-4df3-8439-bdf3566ac900 tempest-VolumesGetTest-2004936499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:16:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-15125180-7a53-4df3-8439-bdf3566ac900 tempest-VolumesGetTest-2004936499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:16:31 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-15125180-7a53-4df3-8439-bdf3566ac900 tempest-VolumesGetTest-2004936499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:16:31 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-15125180-7a53-4df3-8439-bdf3566ac900 tempest-VolumesGetTest-2004936499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:16:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-15125180-7a53-4df3-8439-bdf3566ac900 tempest-VolumesGetTest-2004936499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:16:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-15125180-7a53-4df3-8439-bdf3566ac900 tempest-VolumesGetTest-2004936499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:16:31 devstack sudo[92612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:16:31 devstack sudo[92612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:16:31 devstack sudo[92612]: pam_unix(sudo:session): session closed for user root
Apr 28 22:16:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-15125180-7a53-4df3-8439-bdf3566ac900 tempest-VolumesGetTest-2004936499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.573s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:16:31 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-15125180-7a53-4df3-8439-bdf3566ac900 tempest-VolumesGetTest-2004936499 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:16:31 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-15125180-7a53-4df3-8439-bdf3566ac900 tempest-VolumesGetTest-2004936499 None] Deleted volume successfully.
Apr 28 22:16:32 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-15125180-7a53-4df3-8439-bdf3566ac900 tempest-VolumesGetTest-2004936499 None] Lock "cinder-bbc5b43b-06b5-4376-8870-2f75e87da5c8-delete_volume" released by "delete_volume" :: held 2.030s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:16:32 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-cb15acad-fffb-4db9-a89c-0ecc0fc09526 tempest-VolumesGetTest-2004936499 None] Acquiring lock "cinder-8b3ef4f8-7deb-4aac-856c-118ec28874f2-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:16:32 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-cb15acad-fffb-4db9-a89c-0ecc0fc09526 tempest-VolumesGetTest-2004936499 None] Lock "cinder-8b3ef4f8-7deb-4aac-856c-118ec28874f2-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:16:32 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-cb15acad-fffb-4db9-a89c-0ecc0fc09526 tempest-VolumesGetTest-2004936499 None] Acquiring lock "cinder-quobyte-8b3ef4f8-7deb-4aac-856c-118ec28874f2" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:16:32 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-cb15acad-fffb-4db9-a89c-0ecc0fc09526 tempest-VolumesGetTest-2004936499 None] Lock "cinder-quobyte-8b3ef4f8-7deb-4aac-856c-118ec28874f2" acquired by "delete_volume" :: waited 0.016s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:16:32 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5601d3-ba8d-465a-a011-da5b27d58c6a]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:16:32 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-cb15acad-fffb-4db9-a89c-0ecc0fc09526 tempest-VolumesGetTest-2004936499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8b3ef4f8-7deb-4aac-856c-118ec28874f2 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:16:32 devstack sudo[92616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8b3ef4f8-7deb-4aac-856c-118ec28874f2
Apr 28 22:16:32 devstack sudo[92616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:16:33 devstack sudo[92616]: pam_unix(sudo:session): session closed for user root
Apr 28 22:16:33 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-cb15acad-fffb-4db9-a89c-0ecc0fc09526 tempest-VolumesGetTest-2004936499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8b3ef4f8-7deb-4aac-856c-118ec28874f2" returned: 0 in 0.694s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:16:33 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-cb15acad-fffb-4db9-a89c-0ecc0fc09526 tempest-VolumesGetTest-2004936499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8b3ef4f8-7deb-4aac-856c-118ec28874f2 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:16:33 devstack sudo[92621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8b3ef4f8-7deb-4aac-856c-118ec28874f2
Apr 28 22:16:33 devstack sudo[92621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:16:33 devstack sudo[92621]: pam_unix(sudo:session): session closed for user root
Apr 28 22:16:33 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-cb15acad-fffb-4db9-a89c-0ecc0fc09526 tempest-VolumesGetTest-2004936499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8b3ef4f8-7deb-4aac-856c-118ec28874f2" returned: 0 in 0.578s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:16:33 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-cb15acad-fffb-4db9-a89c-0ecc0fc09526 tempest-VolumesGetTest-2004936499 None] Lock "cinder-quobyte-8b3ef4f8-7deb-4aac-856c-118ec28874f2" released by "delete_volume" :: held 1.307s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:16:33 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-cb15acad-fffb-4db9-a89c-0ecc0fc09526 tempest-VolumesGetTest-2004936499 None] Created reservations ['139a7cfc-438e-41b2-b980-fedfa6e1ad27', '2d5c2bb4-caed-4ed6-b9fe-e6e5546c8116', 'cd77da49-d456-45a5-bb16-3a8db4952842', 'b3b92fb8-bb9f-4b1b-b837-8475d2821eb1'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:16:33 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-cb15acad-fffb-4db9-a89c-0ecc0fc09526 tempest-VolumesGetTest-2004936499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:16:33 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-cb15acad-fffb-4db9-a89c-0ecc0fc09526 tempest-VolumesGetTest-2004936499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:16:33 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-cb15acad-fffb-4db9-a89c-0ecc0fc09526 tempest-VolumesGetTest-2004936499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:16:33 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-cb15acad-fffb-4db9-a89c-0ecc0fc09526 tempest-VolumesGetTest-2004936499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:16:33 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-cb15acad-fffb-4db9-a89c-0ecc0fc09526 tempest-VolumesGetTest-2004936499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:16:33 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-cb15acad-fffb-4db9-a89c-0ecc0fc09526 tempest-VolumesGetTest-2004936499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:16:33 devstack sudo[92625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:16:33 devstack sudo[92625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:16:34 devstack sudo[92625]: pam_unix(sudo:session): session closed for user root
Apr 28 22:16:34 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-cb15acad-fffb-4db9-a89c-0ecc0fc09526 tempest-VolumesGetTest-2004936499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.582s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:16:34 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-cb15acad-fffb-4db9-a89c-0ecc0fc09526 tempest-VolumesGetTest-2004936499 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:16:34 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-cb15acad-fffb-4db9-a89c-0ecc0fc09526 tempest-VolumesGetTest-2004936499 None] Deleted volume successfully.
Apr 28 22:16:34 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-cb15acad-fffb-4db9-a89c-0ecc0fc09526 tempest-VolumesGetTest-2004936499 None] Lock "cinder-8b3ef4f8-7deb-4aac-856c-118ec28874f2-delete_volume" released by "delete_volume" :: held 2.067s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:16:34 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-c412ff34-8961-4bb1-9b30-f8997d99b6e2 tempest-VolumesGetTest-2004936499 None] Acquiring lock "cinder-ce649c4a-0be0-40e9-ba6d-1e6bf0138277-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:16:34 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-c412ff34-8961-4bb1-9b30-f8997d99b6e2 tempest-VolumesGetTest-2004936499 None] Lock "cinder-ce649c4a-0be0-40e9-ba6d-1e6bf0138277-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:16:34 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-c412ff34-8961-4bb1-9b30-f8997d99b6e2 tempest-VolumesGetTest-2004936499 None] Acquiring lock "cinder-quobyte-ce649c4a-0be0-40e9-ba6d-1e6bf0138277" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:16:34 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-c412ff34-8961-4bb1-9b30-f8997d99b6e2 tempest-VolumesGetTest-2004936499 None] Lock "cinder-quobyte-ce649c4a-0be0-40e9-ba6d-1e6bf0138277" acquired by "delete_volume" :: waited 0.014s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:16:34 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[78fc47ea-dd55-45b1-978d-67b29a9f281a]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:16:34 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c412ff34-8961-4bb1-9b30-f8997d99b6e2 tempest-VolumesGetTest-2004936499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ce649c4a-0be0-40e9-ba6d-1e6bf0138277 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:16:34 devstack sudo[92628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ce649c4a-0be0-40e9-ba6d-1e6bf0138277
Apr 28 22:16:34 devstack sudo[92628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:16:35 devstack sudo[92628]: pam_unix(sudo:session): session closed for user root
Apr 28 22:16:35 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c412ff34-8961-4bb1-9b30-f8997d99b6e2 tempest-VolumesGetTest-2004936499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ce649c4a-0be0-40e9-ba6d-1e6bf0138277" returned: 0 in 0.685s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:16:35 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c412ff34-8961-4bb1-9b30-f8997d99b6e2 tempest-VolumesGetTest-2004936499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ce649c4a-0be0-40e9-ba6d-1e6bf0138277 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:16:35 devstack sudo[92635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ce649c4a-0be0-40e9-ba6d-1e6bf0138277
Apr 28 22:16:35 devstack sudo[92635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:16:35 devstack sudo[92635]: pam_unix(sudo:session): session closed for user root
Apr 28 22:16:35 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c412ff34-8961-4bb1-9b30-f8997d99b6e2 tempest-VolumesGetTest-2004936499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-ce649c4a-0be0-40e9-ba6d-1e6bf0138277" returned: 0 in 0.564s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:16:35 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-c412ff34-8961-4bb1-9b30-f8997d99b6e2 tempest-VolumesGetTest-2004936499 None] Lock "cinder-quobyte-ce649c4a-0be0-40e9-ba6d-1e6bf0138277" released by "delete_volume" :: held 1.303s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:16:35 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-c412ff34-8961-4bb1-9b30-f8997d99b6e2 tempest-VolumesGetTest-2004936499 None] Created reservations ['29992d15-b7ed-4f20-adb3-8e0f02f23b72', 'b66fb0ae-82eb-490d-8860-db29db7fc7a8', 'd6fe9d0d-8d49-48eb-a1d8-a560ba2b4c34', '264e4153-f594-4aba-8d68-151a3db33efd'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:16:35 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-c412ff34-8961-4bb1-9b30-f8997d99b6e2 tempest-VolumesGetTest-2004936499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:16:35 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-c412ff34-8961-4bb1-9b30-f8997d99b6e2 tempest-VolumesGetTest-2004936499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:16:35 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-c412ff34-8961-4bb1-9b30-f8997d99b6e2 tempest-VolumesGetTest-2004936499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:16:35 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-c412ff34-8961-4bb1-9b30-f8997d99b6e2 tempest-VolumesGetTest-2004936499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:16:35 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-c412ff34-8961-4bb1-9b30-f8997d99b6e2 tempest-VolumesGetTest-2004936499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:16:35 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c412ff34-8961-4bb1-9b30-f8997d99b6e2 tempest-VolumesGetTest-2004936499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:16:36 devstack sudo[92638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:16:36 devstack sudo[92638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:16:36 devstack sudo[92638]: pam_unix(sudo:session): session closed for user root
Apr 28 22:16:36 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c412ff34-8961-4bb1-9b30-f8997d99b6e2 tempest-VolumesGetTest-2004936499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.569s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:16:36 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-c412ff34-8961-4bb1-9b30-f8997d99b6e2 tempest-VolumesGetTest-2004936499 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:16:36 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-c412ff34-8961-4bb1-9b30-f8997d99b6e2 tempest-VolumesGetTest-2004936499 None] Deleted volume successfully.
Apr 28 22:16:36 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-c412ff34-8961-4bb1-9b30-f8997d99b6e2 tempest-VolumesGetTest-2004936499 None] Lock "cinder-ce649c4a-0be0-40e9-ba6d-1e6bf0138277-delete_volume" released by "delete_volume" :: held 2.088s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:16:37 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b2b2d08-46ee-4171-b779-6234403ea050 tempest-VolumesGetTest-2004936499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:16:37 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-4b2b2d08-46ee-4171-b779-6234403ea050 tempest-VolumesGetTest-2004936499 None] Flow 'volume_create_manager' (65956374-31d9-473a-b770-d769e37c1d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:16:37 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-4b2b2d08-46ee-4171-b779-6234403ea050 tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fbcd016-233c-4b0c-9445-4d917d49a405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:16:37 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-4b2b2d08-46ee-4171-b779-6234403ea050 tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fbcd016-233c-4b0c-9445-4d917d49a405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:16:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-129435420',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a719b6d-7731-41c3-8ee2-640dc5a15f28,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='59efabb3c53c4ff18b30b6927da3a729',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:16:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:16:37Z,use_quota=True,user_id='8010fe4423504fbe919b8e6b005d29c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:16:37 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-4b2b2d08-46ee-4171-b779-6234403ea050 tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38b0233e-bbd2-41cf-a19b-5fda7b4c3e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:16:37 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-4b2b2d08-46ee-4171-b779-6234403ea050 tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38b0233e-bbd2-41cf-a19b-5fda7b4c3e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:16:37 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-4b2b2d08-46ee-4171-b779-6234403ea050 tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b410f2e2-8586-4db8-9741-e1b2af003c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:16:37 devstack cinder-volume[83924]: DEBUG cinder.image.glance [None req-4b2b2d08-46ee-4171-b779-6234403ea050 tempest-VolumesGetTest-2004936499 None] Creating Keystone auth plugin from conf {{(pid=83924) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 28 22:16:37 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-4b2b2d08-46ee-4171-b779-6234403ea050 tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b410f2e2-8586-4db8-9741-e1b2af003c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8a719b6d-7731-41c3-8ee2-640dc5a15f28', 'volume_name': 'volume-8a719b6d-7731-41c3-8ee2-640dc5a15f28', 'volume_size': 1, 'image_id': 'eea3f98a-f64b-4ae5-950b-6d03ae89a234', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eea3f98a-f64b-4ae5-950b-6d03ae89a234', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c4919824590f4575ada7761aea13c85e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eea3f98a-f64b-4ae5-950b-6d03ae89a234', 'created_at': datetime.datetime(2026, 4, 28, 19, 59, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 19, 59, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eea3f98a-f64b-4ae5-950b-6d03ae89a234/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7844d56d8260>}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:16:37 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-4b2b2d08-46ee-4171-b779-6234403ea050 tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bf11180-5305-4d3b-9935-85348bf9e5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:16:37 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-4b2b2d08-46ee-4171-b779-6234403ea050 tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bf11180-5305-4d3b-9935-85348bf9e5c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:16:37 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-4b2b2d08-46ee-4171-b779-6234403ea050 tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96e74fb9-98f1-410d-aebe-4df26698d1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:16:37 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-4b2b2d08-46ee-4171-b779-6234403ea050 tempest-VolumesGetTest-2004936499 None] Volume 8a719b6d-7731-41c3-8ee2-640dc5a15f28: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8a719b6d-7731-41c3-8ee2-640dc5a15f28', 'volume_size': 1, 'image_id': 'eea3f98a-f64b-4ae5-950b-6d03ae89a234', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eea3f98a-f64b-4ae5-950b-6d03ae89a234', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c4919824590f4575ada7761aea13c85e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eea3f98a-f64b-4ae5-950b-6d03ae89a234', 'created_at': datetime.datetime(2026, 4, 28, 19, 59, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 19, 59, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eea3f98a-f64b-4ae5-950b-6d03ae89a234/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7844d56d8260>}
Apr 28 22:16:37 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b2b2d08-46ee-4171-b779-6234403ea050 tempest-VolumesGetTest-2004936499 None] Trying to clone 8a719b6d-7731-41c3-8ee2-640dc5a15f28 from image eea3f98a-f64b-4ae5-950b-6d03ae89a234 at location (None, [{'url': 'file:///opt/stack/data/glance/images/eea3f98a-f64b-4ae5-950b-6d03ae89a234', 'metadata': {}}]). {{(pid=83924) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 28 22:16:37 devstack cinder-volume[83924]: DEBUG cinder.image.image_utils [None req-4b2b2d08-46ee-4171-b779-6234403ea050 tempest-VolumesGetTest-2004936499 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_eea3f98a-f64b-4ae5-950b-6d03ae89a234_0bedew6idevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83924) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 28 22:16:37 devstack cinder-volume[83924]: INFO cinder.image.image_utils [None req-4b2b2d08-46ee-4171-b779-6234403ea050 tempest-VolumesGetTest-2004936499 None] Image download 20.69 MB at 20.69 MB/s
Apr 28 22:16:37 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[258c5ad6-b633-4c6d-8b63-35b15aae1617]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:16:37 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4b2b2d08-46ee-4171-b779-6234403ea050 tempest-VolumesGetTest-2004936499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eea3f98a-f64b-4ae5-950b-6d03ae89a234_0bedew6idevstack@QuobyteHD {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:16:38 devstack sudo[92642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eea3f98a-f64b-4ae5-950b-6d03ae89a234_0bedew6idevstack@QuobyteHD
Apr 28 22:16:38 devstack sudo[92642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:16:38 devstack sudo[92642]: pam_unix(sudo:session): session closed for user root
Apr 28 22:16:38 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4b2b2d08-46ee-4171-b779-6234403ea050 tempest-VolumesGetTest-2004936499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eea3f98a-f64b-4ae5-950b-6d03ae89a234_0bedew6idevstack@QuobyteHD" returned: 0 in 0.635s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:16:38 devstack cinder-volume[83924]: DEBUG cinder.image.image_utils [None req-4b2b2d08-46ee-4171-b779-6234403ea050 tempest-VolumesGetTest-2004936499 None] Temporary image eea3f98a-f64b-4ae5-950b-6d03ae89a234 is fetched for user 8010fe4423504fbe919b8e6b005d29c1. {{(pid=83924) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 28 22:16:38 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[518efdc7-9030-401f-99ee-f614532ad682]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:16:38 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4b2b2d08-46ee-4171-b779-6234403ea050 tempest-VolumesGetTest-2004936499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eea3f98a-f64b-4ae5-950b-6d03ae89a234_0bedew6idevstack@QuobyteHD {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:16:38 devstack sudo[92647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eea3f98a-f64b-4ae5-950b-6d03ae89a234_0bedew6idevstack@QuobyteHD
Apr 28 22:16:38 devstack sudo[92647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:16:39 devstack sudo[92647]: pam_unix(sudo:session): session closed for user root
Apr 28 22:16:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4b2b2d08-46ee-4171-b779-6234403ea050 tempest-VolumesGetTest-2004936499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eea3f98a-f64b-4ae5-950b-6d03ae89a234_0bedew6idevstack@QuobyteHD" returned: 0 in 0.661s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:16:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-4b2b2d08-46ee-4171-b779-6234403ea050 tempest-VolumesGetTest-2004936499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:16:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-4b2b2d08-46ee-4171-b779-6234403ea050 tempest-VolumesGetTest-2004936499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:16:39 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-4b2b2d08-46ee-4171-b779-6234403ea050 tempest-VolumesGetTest-2004936499 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:16:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-129435420',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a719b6d-7731-41c3-8ee2-640dc5a15f28,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='59efabb3c53c4ff18b30b6927da3a729',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:16:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:16:37Z,use_quota=True,user_id='8010fe4423504fbe919b8e6b005d29c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:16:39 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-4b2b2d08-46ee-4171-b779-6234403ea050 tempest-VolumesGetTest-2004936499 None] Creating volume 8a719b6d-7731-41c3-8ee2-640dc5a15f28 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:16:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-4b2b2d08-46ee-4171-b779-6234403ea050 tempest-VolumesGetTest-2004936499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:16:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-4b2b2d08-46ee-4171-b779-6234403ea050 tempest-VolumesGetTest-2004936499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:16:39 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-4b2b2d08-46ee-4171-b779-6234403ea050 tempest-VolumesGetTest-2004936499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:16:39 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-4b2b2d08-46ee-4171-b779-6234403ea050 tempest-VolumesGetTest-2004936499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:16:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-4b2b2d08-46ee-4171-b779-6234403ea050 tempest-VolumesGetTest-2004936499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:16:39 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-4b2b2d08-46ee-4171-b779-6234403ea050 tempest-VolumesGetTest-2004936499 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:16:39 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-4b2b2d08-46ee-4171-b779-6234403ea050 tempest-VolumesGetTest-2004936499 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:16:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4b2b2d08-46ee-4171-b779-6234403ea050 tempest-VolumesGetTest-2004936499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8a719b6d-7731-41c3-8ee2-640dc5a15f28 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:16:39 devstack sudo[92652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8a719b6d-7731-41c3-8ee2-640dc5a15f28 1073741824
Apr 28 22:16:39 devstack sudo[92652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:16:39 devstack cinder-volume[83924]: DEBUG oslo_service.periodic_task [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83924) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 28 22:16:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:16:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:16:39 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:16:39 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:16:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:16:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:16:39 devstack sudo[92654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:16:39 devstack sudo[92654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:16:40 devstack sudo[92652]: pam_unix(sudo:session): session closed for user root
Apr 28 22:16:40 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4b2b2d08-46ee-4171-b779-6234403ea050 tempest-VolumesGetTest-2004936499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8a719b6d-7731-41c3-8ee2-640dc5a15f28 1073741824" returned: 0 in 0.738s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:16:40 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4b2b2d08-46ee-4171-b779-6234403ea050 tempest-VolumesGetTest-2004936499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8a719b6d-7731-41c3-8ee2-640dc5a15f28 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:16:40 devstack sudo[92659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8a719b6d-7731-41c3-8ee2-640dc5a15f28
Apr 28 22:16:40 devstack sudo[92659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:16:40 devstack sudo[92654]: pam_unix(sudo:session): session closed for user root
Apr 28 22:16:40 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.583s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:16:40 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:16:40 devstack sudo[92659]: pam_unix(sudo:session): session closed for user root
Apr 28 22:16:40 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4b2b2d08-46ee-4171-b779-6234403ea050 tempest-VolumesGetTest-2004936499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8a719b6d-7731-41c3-8ee2-640dc5a15f28" returned: 0 in 0.559s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:16:40 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-4b2b2d08-46ee-4171-b779-6234403ea050 tempest-VolumesGetTest-2004936499 None] <== create_volume: return (1340ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:16:40 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-4b2b2d08-46ee-4171-b779-6234403ea050 tempest-VolumesGetTest-2004936499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.345s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:16:40 devstack cinder-volume[83924]: DEBUG cinder.volume.volume_utils [None req-4b2b2d08-46ee-4171-b779-6234403ea050 tempest-VolumesGetTest-2004936499 None] Attempting download of eea3f98a-f64b-4ae5-950b-6d03ae89a234 ((None, [{'url': 'file:///opt/stack/data/glance/images/eea3f98a-f64b-4ae5-950b-6d03ae89a234', 'metadata': {}}])) to volume 8a719b6d-7731-41c3-8ee2-640dc5a15f28. {{(pid=83924) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 28 22:16:40 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[942b7e1e-9be7-43f9-a228-60bc04ef78f8]: (4, 'raw') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:16:40 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4b2b2d08-46ee-4171-b779-6234403ea050 tempest-VolumesGetTest-2004936499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eea3f98a-f64b-4ae5-950b-6d03ae89a234_cay2irwx {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:16:40 devstack sudo[92663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eea3f98a-f64b-4ae5-950b-6d03ae89a234_cay2irwx
Apr 28 22:16:40 devstack sudo[92663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:16:41 devstack sudo[92663]: pam_unix(sudo:session): session closed for user root
Apr 28 22:16:41 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4b2b2d08-46ee-4171-b779-6234403ea050 tempest-VolumesGetTest-2004936499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eea3f98a-f64b-4ae5-950b-6d03ae89a234_cay2irwx" returned: 0 in 0.626s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:16:41 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4b2b2d08-46ee-4171-b779-6234403ea050 tempest-VolumesGetTest-2004936499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eea3f98a-f64b-4ae5-950b-6d03ae89a234_cay2irwx {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:16:41 devstack sudo[92667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eea3f98a-f64b-4ae5-950b-6d03ae89a234_cay2irwx
Apr 28 22:16:41 devstack sudo[92667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:16:41 devstack sudo[92667]: pam_unix(sudo:session): session closed for user root
Apr 28 22:16:41 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4b2b2d08-46ee-4171-b779-6234403ea050 tempest-VolumesGetTest-2004936499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eea3f98a-f64b-4ae5-950b-6d03ae89a234_cay2irwx" returned: 1 in 0.621s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:16:41 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4b2b2d08-46ee-4171-b779-6234403ea050 tempest-VolumesGetTest-2004936499 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eea3f98a-f64b-4ae5-950b-6d03ae89a234_cay2irwx' failed. Not Retrying. {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 28 22:16:41 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd552ae8-ca2a-4dc0-ba6b-d39be1aa6351]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:16:41 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4b2b2d08-46ee-4171-b779-6234403ea050 tempest-VolumesGetTest-2004936499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eea3f98a-f64b-4ae5-950b-6d03ae89a234_0bedew6idevstack@QuobyteHD {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:16:42 devstack sudo[92671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eea3f98a-f64b-4ae5-950b-6d03ae89a234_0bedew6idevstack@QuobyteHD
Apr 28 22:16:42 devstack sudo[92671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:16:42 devstack sudo[92671]: pam_unix(sudo:session): session closed for user root
Apr 28 22:16:42 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4b2b2d08-46ee-4171-b779-6234403ea050 tempest-VolumesGetTest-2004936499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eea3f98a-f64b-4ae5-950b-6d03ae89a234_0bedew6idevstack@QuobyteHD" returned: 0 in 0.624s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:16:42 devstack cinder-volume[83924]: DEBUG cinder.image.image_utils [None req-4b2b2d08-46ee-4171-b779-6234403ea050 tempest-VolumesGetTest-2004936499 None] eea3f98a-f64b-4ae5-950b-6d03ae89a234 was qcow2, converting to raw {{(pid=83924) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 28 22:16:42 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4b2b2d08-46ee-4171-b779-6234403ea050 tempest-VolumesGetTest-2004936499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eea3f98a-f64b-4ae5-950b-6d03ae89a234_0bedew6idevstack@QuobyteHD /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8a719b6d-7731-41c3-8ee2-640dc5a15f28 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:16:42 devstack sudo[92676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eea3f98a-f64b-4ae5-950b-6d03ae89a234_0bedew6idevstack@QuobyteHD /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8a719b6d-7731-41c3-8ee2-640dc5a15f28
Apr 28 22:16:42 devstack sudo[92676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:16:44 devstack sudo[92676]: pam_unix(sudo:session): session closed for user root
Apr 28 22:16:44 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4b2b2d08-46ee-4171-b779-6234403ea050 tempest-VolumesGetTest-2004936499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eea3f98a-f64b-4ae5-950b-6d03ae89a234_0bedew6idevstack@QuobyteHD /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8a719b6d-7731-41c3-8ee2-640dc5a15f28" returned: 0 in 1.709s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:16:44 devstack cinder-volume[83924]: DEBUG cinder.image.image_utils [None req-4b2b2d08-46ee-4171-b779-6234403ea050 tempest-VolumesGetTest-2004936499 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_eea3f98a-f64b-4ae5-950b-6d03ae89a234_0bedew6idevstack@QuobyteHD, size 112.00 MB, duration 1.71 sec, destination /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8a719b6d-7731-41c3-8ee2-640dc5a15f28 {{(pid=83924) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 28 22:16:44 devstack cinder-volume[83924]: INFO cinder.image.image_utils [None req-4b2b2d08-46ee-4171-b779-6234403ea050 tempest-VolumesGetTest-2004936499 None] Converted 112.00 MB image at 65.46 MB/s
Apr 28 22:16:44 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4b2b2d08-46ee-4171-b779-6234403ea050 tempest-VolumesGetTest-2004936499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8a719b6d-7731-41c3-8ee2-640dc5a15f28 1G {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:16:44 devstack sudo[92686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8a719b6d-7731-41c3-8ee2-640dc5a15f28 1G
Apr 28 22:16:44 devstack sudo[92686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:16:44 devstack sudo[92686]: pam_unix(sudo:session): session closed for user root
Apr 28 22:16:44 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4b2b2d08-46ee-4171-b779-6234403ea050 tempest-VolumesGetTest-2004936499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8a719b6d-7731-41c3-8ee2-640dc5a15f28 1G" returned: 0 in 0.600s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:16:44 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[4154e671-b17d-4514-b1ad-3906065cc71c]: (4, 'raw') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:16:44 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4b2b2d08-46ee-4171-b779-6234403ea050 tempest-VolumesGetTest-2004936499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8a719b6d-7731-41c3-8ee2-640dc5a15f28 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:16:45 devstack sudo[92691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8a719b6d-7731-41c3-8ee2-640dc5a15f28
Apr 28 22:16:45 devstack sudo[92691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:16:45 devstack sudo[92691]: pam_unix(sudo:session): session closed for user root
Apr 28 22:16:45 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4b2b2d08-46ee-4171-b779-6234403ea050 tempest-VolumesGetTest-2004936499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8a719b6d-7731-41c3-8ee2-640dc5a15f28" returned: 0 in 0.657s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:16:45 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4b2b2d08-46ee-4171-b779-6234403ea050 tempest-VolumesGetTest-2004936499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8a719b6d-7731-41c3-8ee2-640dc5a15f28 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:16:45 devstack sudo[92695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8a719b6d-7731-41c3-8ee2-640dc5a15f28
Apr 28 22:16:45 devstack sudo[92695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:16:46 devstack sudo[92695]: pam_unix(sudo:session): session closed for user root
Apr 28 22:16:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4b2b2d08-46ee-4171-b779-6234403ea050 tempest-VolumesGetTest-2004936499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8a719b6d-7731-41c3-8ee2-640dc5a15f28" returned: 1 in 0.642s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:16:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4b2b2d08-46ee-4171-b779-6234403ea050 tempest-VolumesGetTest-2004936499 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8a719b6d-7731-41c3-8ee2-640dc5a15f28' failed. Not Retrying. {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 28 22:16:46 devstack cinder-volume[83924]: DEBUG cinder.volume.volume_utils [None req-4b2b2d08-46ee-4171-b779-6234403ea050 tempest-VolumesGetTest-2004936499 None] Downloaded image eea3f98a-f64b-4ae5-950b-6d03ae89a234 ((None, [{'url': 'file:///opt/stack/data/glance/images/eea3f98a-f64b-4ae5-950b-6d03ae89a234', 'metadata': {}}])) to volume 8a719b6d-7731-41c3-8ee2-640dc5a15f28 successfully. {{(pid=83924) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 28 22:16:46 devstack cinder-volume[83924]: DEBUG cinder.image.image_utils [None req-4b2b2d08-46ee-4171-b779-6234403ea050 tempest-VolumesGetTest-2004936499 None] Temporary image eea3f98a-f64b-4ae5-950b-6d03ae89a234 for user 8010fe4423504fbe919b8e6b005d29c1 is deleted. {{(pid=83924) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 28 22:16:46 devstack cinder-volume[83924]: DEBUG cinder.volume.volume_utils [None req-4b2b2d08-46ee-4171-b779-6234403ea050 tempest-VolumesGetTest-2004936499 None] Marking volume 8a719b6d-7731-41c3-8ee2-640dc5a15f28 as bootable. {{(pid=83924) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 28 22:16:46 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b2b2d08-46ee-4171-b779-6234403ea050 tempest-VolumesGetTest-2004936499 None] Copying metadata from image eea3f98a-f64b-4ae5-950b-6d03ae89a234 to 8a719b6d-7731-41c3-8ee2-640dc5a15f28. {{(pid=83924) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 28 22:16:46 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b2b2d08-46ee-4171-b779-6234403ea050 tempest-VolumesGetTest-2004936499 None] Creating volume glance metadata for volume 8a719b6d-7731-41c3-8ee2-640dc5a15f28 backed by image eea3f98a-f64b-4ae5-950b-6d03ae89a234 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'eea3f98a-f64b-4ae5-950b-6d03ae89a234', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83924) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 28 22:16:46 devstack cinder-volume[83924]: DEBUG dbcounter [-] [83924] Writing DB stats cinder:SELECT=75,cinder:UPDATE=112,cinder:DELETE=8,cinder:INSERT=23 {{(pid=83924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 28 22:16:46 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-4b2b2d08-46ee-4171-b779-6234403ea050 tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96e74fb9-98f1-410d-aebe-4df26698d1e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a719b6d-7731-41c3-8ee2-640dc5a15f28', 'volume_size': 1, 'image_id': 'eea3f98a-f64b-4ae5-950b-6d03ae89a234', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eea3f98a-f64b-4ae5-950b-6d03ae89a234', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c4919824590f4575ada7761aea13c85e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eea3f98a-f64b-4ae5-950b-6d03ae89a234', 'created_at': datetime.datetime(2026, 4, 28, 19, 59, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 19, 59, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eea3f98a-f64b-4ae5-950b-6d03ae89a234/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7844d56d8260>}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:16:46 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-4b2b2d08-46ee-4171-b779-6234403ea050 tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aee37942-667e-4488-8d15-a6a431a1ee54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:16:46 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-4b2b2d08-46ee-4171-b779-6234403ea050 tempest-VolumesGetTest-2004936499 None] Volume volume-8a719b6d-7731-41c3-8ee2-640dc5a15f28 (8a719b6d-7731-41c3-8ee2-640dc5a15f28): created successfully
Apr 28 22:16:46 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-4b2b2d08-46ee-4171-b779-6234403ea050 tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aee37942-667e-4488-8d15-a6a431a1ee54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:16:46 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-4b2b2d08-46ee-4171-b779-6234403ea050 tempest-VolumesGetTest-2004936499 None] Flow 'volume_create_manager' (65956374-31d9-473a-b770-d769e37c1d81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:16:46 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-4b2b2d08-46ee-4171-b779-6234403ea050 tempest-VolumesGetTest-2004936499 None] Created volume successfully.
Apr 28 22:16:47 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-81d7b040-3743-4983-aa9c-bd964b31eea2 tempest-VolumesGetTest-2004936499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:16:47 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-81d7b040-3743-4983-aa9c-bd964b31eea2 tempest-VolumesGetTest-2004936499 None] Flow 'volume_create_manager' (bbfeab02-75ef-4974-ba0e-bf1681eeb486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:16:47 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-81d7b040-3743-4983-aa9c-bd964b31eea2 tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfd7bfd9-6436-45ac-a711-067b0274fb08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:16:47 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-81d7b040-3743-4983-aa9c-bd964b31eea2 tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfd7bfd9-6436-45ac-a711-067b0274fb08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:16:47Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-602729459',display_name='tempest-VolumesGetTest-Volume-905853261',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ccce0a0-8950-4852-a157-aed31979b659,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59efabb3c53c4ff18b30b6927da3a729',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:16:47Z,use_quota=True,user_id='8010fe4423504fbe919b8e6b005d29c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:16:47 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-81d7b040-3743-4983-aa9c-bd964b31eea2 tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (801ce9b4-ee44-4337-a967-2b88376c103c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:16:47 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-81d7b040-3743-4983-aa9c-bd964b31eea2 tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (801ce9b4-ee44-4337-a967-2b88376c103c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:16:47 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-81d7b040-3743-4983-aa9c-bd964b31eea2 tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c74ae3b9-6910-42b1-8ceb-df0bfa4f53d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:16:47 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-81d7b040-3743-4983-aa9c-bd964b31eea2 tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c74ae3b9-6910-42b1-8ceb-df0bfa4f53d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ccce0a0-8950-4852-a157-aed31979b659', 'volume_name': 'volume-3ccce0a0-8950-4852-a157-aed31979b659', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:16:47 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-81d7b040-3743-4983-aa9c-bd964b31eea2 tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aca4265-32fd-4535-a786-532b206491be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:16:47 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-81d7b040-3743-4983-aa9c-bd964b31eea2 tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aca4265-32fd-4535-a786-532b206491be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:16:47 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-81d7b040-3743-4983-aa9c-bd964b31eea2 tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d01cb3de-8139-4c0d-a26d-ee5f37cc8ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:16:47 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-81d7b040-3743-4983-aa9c-bd964b31eea2 tempest-VolumesGetTest-2004936499 None] Volume 3ccce0a0-8950-4852-a157-aed31979b659: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ccce0a0-8950-4852-a157-aed31979b659', 'volume_size': 1}
Apr 28 22:16:47 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-81d7b040-3743-4983-aa9c-bd964b31eea2 tempest-VolumesGetTest-2004936499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:16:47 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-81d7b040-3743-4983-aa9c-bd964b31eea2 tempest-VolumesGetTest-2004936499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:16:47 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-81d7b040-3743-4983-aa9c-bd964b31eea2 tempest-VolumesGetTest-2004936499 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:16:47Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-602729459',display_name='tempest-VolumesGetTest-Volume-905853261',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ccce0a0-8950-4852-a157-aed31979b659,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59efabb3c53c4ff18b30b6927da3a729',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:16:47Z,use_quota=True,user_id='8010fe4423504fbe919b8e6b005d29c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:16:47 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-81d7b040-3743-4983-aa9c-bd964b31eea2 tempest-VolumesGetTest-2004936499 None] Creating volume 3ccce0a0-8950-4852-a157-aed31979b659 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:16:47 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-81d7b040-3743-4983-aa9c-bd964b31eea2 tempest-VolumesGetTest-2004936499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:16:47 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-81d7b040-3743-4983-aa9c-bd964b31eea2 tempest-VolumesGetTest-2004936499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:16:47 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-81d7b040-3743-4983-aa9c-bd964b31eea2 tempest-VolumesGetTest-2004936499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:16:47 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-81d7b040-3743-4983-aa9c-bd964b31eea2 tempest-VolumesGetTest-2004936499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:16:47 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-81d7b040-3743-4983-aa9c-bd964b31eea2 tempest-VolumesGetTest-2004936499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:16:47 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-81d7b040-3743-4983-aa9c-bd964b31eea2 tempest-VolumesGetTest-2004936499 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:16:47 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-81d7b040-3743-4983-aa9c-bd964b31eea2 tempest-VolumesGetTest-2004936499 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:16:47 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-81d7b040-3743-4983-aa9c-bd964b31eea2 tempest-VolumesGetTest-2004936499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3ccce0a0-8950-4852-a157-aed31979b659 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:16:47 devstack sudo[92700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3ccce0a0-8950-4852-a157-aed31979b659 1073741824
Apr 28 22:16:47 devstack sudo[92700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:16:48 devstack sudo[92700]: pam_unix(sudo:session): session closed for user root
Apr 28 22:16:48 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-81d7b040-3743-4983-aa9c-bd964b31eea2 tempest-VolumesGetTest-2004936499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3ccce0a0-8950-4852-a157-aed31979b659 1073741824" returned: 0 in 0.719s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:16:48 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-81d7b040-3743-4983-aa9c-bd964b31eea2 tempest-VolumesGetTest-2004936499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3ccce0a0-8950-4852-a157-aed31979b659 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:16:48 devstack sudo[92706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3ccce0a0-8950-4852-a157-aed31979b659
Apr 28 22:16:48 devstack sudo[92706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:16:48 devstack sudo[92706]: pam_unix(sudo:session): session closed for user root
Apr 28 22:16:48 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-81d7b040-3743-4983-aa9c-bd964b31eea2 tempest-VolumesGetTest-2004936499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3ccce0a0-8950-4852-a157-aed31979b659" returned: 0 in 0.574s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:16:48 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-81d7b040-3743-4983-aa9c-bd964b31eea2 tempest-VolumesGetTest-2004936499 None] <== create_volume: return (1332ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:16:48 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-81d7b040-3743-4983-aa9c-bd964b31eea2 tempest-VolumesGetTest-2004936499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.335s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:16:48 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-81d7b040-3743-4983-aa9c-bd964b31eea2 tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d01cb3de-8139-4c0d-a26d-ee5f37cc8ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ccce0a0-8950-4852-a157-aed31979b659', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:16:48 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-81d7b040-3743-4983-aa9c-bd964b31eea2 tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e68443e1-e21e-4ade-8d4d-9bd357b5af90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:16:48 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-81d7b040-3743-4983-aa9c-bd964b31eea2 tempest-VolumesGetTest-2004936499 None] Volume volume-3ccce0a0-8950-4852-a157-aed31979b659 (3ccce0a0-8950-4852-a157-aed31979b659): created successfully
Apr 28 22:16:48 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-81d7b040-3743-4983-aa9c-bd964b31eea2 tempest-VolumesGetTest-2004936499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e68443e1-e21e-4ade-8d4d-9bd357b5af90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:16:48 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-81d7b040-3743-4983-aa9c-bd964b31eea2 tempest-VolumesGetTest-2004936499 None] Flow 'volume_create_manager' (bbfeab02-75ef-4974-ba0e-bf1681eeb486) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:16:48 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-81d7b040-3743-4983-aa9c-bd964b31eea2 tempest-VolumesGetTest-2004936499 None] Created volume successfully.
Apr 28 22:16:49 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-a7a4bace-c71a-4fad-ba89-718f38bc194b tempest-VolumesGetTest-2004936499 None] Acquiring lock "cinder-3ccce0a0-8950-4852-a157-aed31979b659-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:16:49 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-a7a4bace-c71a-4fad-ba89-718f38bc194b tempest-VolumesGetTest-2004936499 None] Lock "cinder-3ccce0a0-8950-4852-a157-aed31979b659-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:16:49 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-a7a4bace-c71a-4fad-ba89-718f38bc194b tempest-VolumesGetTest-2004936499 None] Acquiring lock "cinder-quobyte-3ccce0a0-8950-4852-a157-aed31979b659" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:16:49 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-a7a4bace-c71a-4fad-ba89-718f38bc194b tempest-VolumesGetTest-2004936499 None] Lock "cinder-quobyte-3ccce0a0-8950-4852-a157-aed31979b659" acquired by "delete_volume" :: waited 0.022s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:16:49 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7611e64-3385-4d6d-972d-2673ab7c1a4e]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:16:49 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a7a4bace-c71a-4fad-ba89-718f38bc194b tempest-VolumesGetTest-2004936499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3ccce0a0-8950-4852-a157-aed31979b659 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:16:49 devstack sudo[92709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3ccce0a0-8950-4852-a157-aed31979b659
Apr 28 22:16:49 devstack sudo[92709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:16:50 devstack sudo[92709]: pam_unix(sudo:session): session closed for user root
Apr 28 22:16:50 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a7a4bace-c71a-4fad-ba89-718f38bc194b tempest-VolumesGetTest-2004936499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3ccce0a0-8950-4852-a157-aed31979b659" returned: 0 in 0.691s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:16:50 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a7a4bace-c71a-4fad-ba89-718f38bc194b tempest-VolumesGetTest-2004936499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3ccce0a0-8950-4852-a157-aed31979b659 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:16:50 devstack sudo[92714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3ccce0a0-8950-4852-a157-aed31979b659
Apr 28 22:16:50 devstack sudo[92714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:16:50 devstack sudo[92714]: pam_unix(sudo:session): session closed for user root
Apr 28 22:16:50 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a7a4bace-c71a-4fad-ba89-718f38bc194b tempest-VolumesGetTest-2004936499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-3ccce0a0-8950-4852-a157-aed31979b659" returned: 0 in 0.567s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:16:50 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-a7a4bace-c71a-4fad-ba89-718f38bc194b tempest-VolumesGetTest-2004936499 None] Lock "cinder-quobyte-3ccce0a0-8950-4852-a157-aed31979b659" released by "delete_volume" :: held 1.309s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:16:50 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-a7a4bace-c71a-4fad-ba89-718f38bc194b tempest-VolumesGetTest-2004936499 None] Created reservations ['94bab5b3-99cf-4533-945d-a00afb3d5b37', 'c561ba92-6928-4b0e-9c91-1fd1d10ceff9', '83f36cd7-8b19-49aa-806c-549d8b36abc1', 'b296f81d-5153-4529-8be4-b55994bf8bca'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:16:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-a7a4bace-c71a-4fad-ba89-718f38bc194b tempest-VolumesGetTest-2004936499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:16:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-a7a4bace-c71a-4fad-ba89-718f38bc194b tempest-VolumesGetTest-2004936499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:16:51 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-a7a4bace-c71a-4fad-ba89-718f38bc194b tempest-VolumesGetTest-2004936499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:16:51 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-a7a4bace-c71a-4fad-ba89-718f38bc194b tempest-VolumesGetTest-2004936499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:16:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-a7a4bace-c71a-4fad-ba89-718f38bc194b tempest-VolumesGetTest-2004936499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:16:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a7a4bace-c71a-4fad-ba89-718f38bc194b tempest-VolumesGetTest-2004936499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:16:51 devstack sudo[92717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:16:51 devstack sudo[92717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:16:51 devstack sudo[92717]: pam_unix(sudo:session): session closed for user root
Apr 28 22:16:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a7a4bace-c71a-4fad-ba89-718f38bc194b tempest-VolumesGetTest-2004936499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.586s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:16:51 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-a7a4bace-c71a-4fad-ba89-718f38bc194b tempest-VolumesGetTest-2004936499 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:16:51 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-a7a4bace-c71a-4fad-ba89-718f38bc194b tempest-VolumesGetTest-2004936499 None] Deleted volume successfully.
Apr 28 22:16:51 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-a7a4bace-c71a-4fad-ba89-718f38bc194b tempest-VolumesGetTest-2004936499 None] Lock "cinder-3ccce0a0-8950-4852-a157-aed31979b659-delete_volume" released by "delete_volume" :: held 2.098s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:16:51 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-22b1c9ea-e91a-4eca-a95e-8f7b68c2ed52 tempest-VolumesGetTest-2004936499 None] Acquiring lock "cinder-8a719b6d-7731-41c3-8ee2-640dc5a15f28-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:16:51 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-22b1c9ea-e91a-4eca-a95e-8f7b68c2ed52 tempest-VolumesGetTest-2004936499 None] Lock "cinder-8a719b6d-7731-41c3-8ee2-640dc5a15f28-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:16:51 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-22b1c9ea-e91a-4eca-a95e-8f7b68c2ed52 tempest-VolumesGetTest-2004936499 None] Acquiring lock "cinder-quobyte-8a719b6d-7731-41c3-8ee2-640dc5a15f28" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:16:51 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-22b1c9ea-e91a-4eca-a95e-8f7b68c2ed52 tempest-VolumesGetTest-2004936499 None] Lock "cinder-quobyte-8a719b6d-7731-41c3-8ee2-640dc5a15f28" acquired by "delete_volume" :: waited 0.017s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:16:51 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0d7149-35ba-4888-b070-99701ba93ec7]: (4, 'raw') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:16:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-22b1c9ea-e91a-4eca-a95e-8f7b68c2ed52 tempest-VolumesGetTest-2004936499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8a719b6d-7731-41c3-8ee2-640dc5a15f28 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:16:52 devstack sudo[92720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8a719b6d-7731-41c3-8ee2-640dc5a15f28
Apr 28 22:16:52 devstack sudo[92720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:16:52 devstack sudo[92720]: pam_unix(sudo:session): session closed for user root
Apr 28 22:16:52 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-22b1c9ea-e91a-4eca-a95e-8f7b68c2ed52 tempest-VolumesGetTest-2004936499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8a719b6d-7731-41c3-8ee2-640dc5a15f28" returned: 0 in 0.659s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:16:52 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-22b1c9ea-e91a-4eca-a95e-8f7b68c2ed52 tempest-VolumesGetTest-2004936499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8a719b6d-7731-41c3-8ee2-640dc5a15f28 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:16:52 devstack sudo[92724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8a719b6d-7731-41c3-8ee2-640dc5a15f28
Apr 28 22:16:52 devstack sudo[92724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:16:53 devstack sudo[92724]: pam_unix(sudo:session): session closed for user root
Apr 28 22:16:53 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-22b1c9ea-e91a-4eca-a95e-8f7b68c2ed52 tempest-VolumesGetTest-2004936499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8a719b6d-7731-41c3-8ee2-640dc5a15f28" returned: 1 in 0.664s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:16:53 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-22b1c9ea-e91a-4eca-a95e-8f7b68c2ed52 tempest-VolumesGetTest-2004936499 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8a719b6d-7731-41c3-8ee2-640dc5a15f28' failed. Not Retrying. {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 28 22:16:53 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-22b1c9ea-e91a-4eca-a95e-8f7b68c2ed52 tempest-VolumesGetTest-2004936499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8a719b6d-7731-41c3-8ee2-640dc5a15f28 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:16:53 devstack sudo[92730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8a719b6d-7731-41c3-8ee2-640dc5a15f28
Apr 28 22:16:53 devstack sudo[92730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:16:53 devstack sudo[92730]: pam_unix(sudo:session): session closed for user root
Apr 28 22:16:53 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-22b1c9ea-e91a-4eca-a95e-8f7b68c2ed52 tempest-VolumesGetTest-2004936499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8a719b6d-7731-41c3-8ee2-640dc5a15f28" returned: 0 in 0.545s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:16:53 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-22b1c9ea-e91a-4eca-a95e-8f7b68c2ed52 tempest-VolumesGetTest-2004936499 None] Lock "cinder-quobyte-8a719b6d-7731-41c3-8ee2-640dc5a15f28" released by "delete_volume" :: held 1.931s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:16:53 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-22b1c9ea-e91a-4eca-a95e-8f7b68c2ed52 tempest-VolumesGetTest-2004936499 None] Created reservations ['f0a4de83-1be9-4027-bf25-fd7b1e831e58', 'ac2edc05-b349-477d-888a-71a93ba51766', 'd47b8e95-c319-4591-bea6-07b02a6dcfe0', 'd7344774-08a5-42e8-a1d1-4416a91d34bb'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:16:53 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-22b1c9ea-e91a-4eca-a95e-8f7b68c2ed52 tempest-VolumesGetTest-2004936499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:16:53 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-22b1c9ea-e91a-4eca-a95e-8f7b68c2ed52 tempest-VolumesGetTest-2004936499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:16:53 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-22b1c9ea-e91a-4eca-a95e-8f7b68c2ed52 tempest-VolumesGetTest-2004936499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:16:53 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-22b1c9ea-e91a-4eca-a95e-8f7b68c2ed52 tempest-VolumesGetTest-2004936499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:16:53 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-22b1c9ea-e91a-4eca-a95e-8f7b68c2ed52 tempest-VolumesGetTest-2004936499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:16:53 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-22b1c9ea-e91a-4eca-a95e-8f7b68c2ed52 tempest-VolumesGetTest-2004936499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:16:53 devstack sudo[92733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:16:53 devstack sudo[92733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:16:54 devstack sudo[92733]: pam_unix(sudo:session): session closed for user root
Apr 28 22:16:54 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-22b1c9ea-e91a-4eca-a95e-8f7b68c2ed52 tempest-VolumesGetTest-2004936499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.637s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:16:54 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-22b1c9ea-e91a-4eca-a95e-8f7b68c2ed52 tempest-VolumesGetTest-2004936499 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:16:54 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-22b1c9ea-e91a-4eca-a95e-8f7b68c2ed52 tempest-VolumesGetTest-2004936499 None] Deleted volume successfully.
Apr 28 22:16:54 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-22b1c9ea-e91a-4eca-a95e-8f7b68c2ed52 tempest-VolumesGetTest-2004936499 None] Lock "cinder-8a719b6d-7731-41c3-8ee2-640dc5a15f28-delete_volume" released by "delete_volume" :: held 2.759s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:16:56 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef9469a4-98eb-48f6-b17f-39be22b3da00 tempest-VolumesListTestJSON-486354339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:16:56 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-ef9469a4-98eb-48f6-b17f-39be22b3da00 tempest-VolumesListTestJSON-486354339 None] Flow 'volume_create_manager' (7814a2c0-b44c-4d9a-a348-96e3117dab31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:16:56 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-ef9469a4-98eb-48f6-b17f-39be22b3da00 tempest-VolumesListTestJSON-486354339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d0f7b16-551b-4f87-8d78-63958eb951ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:16:56 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-ef9469a4-98eb-48f6-b17f-39be22b3da00 tempest-VolumesListTestJSON-486354339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d0f7b16-551b-4f87-8d78-63958eb951ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:16:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1244448735',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=658bec9e-f6f8-4ae2-bb4f-90c3cc5ae0f2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2ba6c91b2fb74f66bfab1bb0b95af4e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:16:57Z,use_quota=True,user_id='1ec4088bfc404daf8f427b11e5cd1487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:16:56 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-ef9469a4-98eb-48f6-b17f-39be22b3da00 tempest-VolumesListTestJSON-486354339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d21da3a2-cb69-4e2f-b95d-27697e0a1abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:16:56 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-ef9469a4-98eb-48f6-b17f-39be22b3da00 tempest-VolumesListTestJSON-486354339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d21da3a2-cb69-4e2f-b95d-27697e0a1abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:16:56 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-ef9469a4-98eb-48f6-b17f-39be22b3da00 tempest-VolumesListTestJSON-486354339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff891eef-a829-4aa0-971e-458197a5d1b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:16:56 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-ef9469a4-98eb-48f6-b17f-39be22b3da00 tempest-VolumesListTestJSON-486354339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff891eef-a829-4aa0-971e-458197a5d1b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '658bec9e-f6f8-4ae2-bb4f-90c3cc5ae0f2', 'volume_name': 'volume-658bec9e-f6f8-4ae2-bb4f-90c3cc5ae0f2', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:16:56 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-ef9469a4-98eb-48f6-b17f-39be22b3da00 tempest-VolumesListTestJSON-486354339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5295a851-0e3e-4373-8dde-632dc5a8b7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:16:56 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-ef9469a4-98eb-48f6-b17f-39be22b3da00 tempest-VolumesListTestJSON-486354339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5295a851-0e3e-4373-8dde-632dc5a8b7d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:16:56 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-ef9469a4-98eb-48f6-b17f-39be22b3da00 tempest-VolumesListTestJSON-486354339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33d69649-2bee-47aa-98e9-b190c1a4813d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:16:56 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-ef9469a4-98eb-48f6-b17f-39be22b3da00 tempest-VolumesListTestJSON-486354339 None] Volume 658bec9e-f6f8-4ae2-bb4f-90c3cc5ae0f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-658bec9e-f6f8-4ae2-bb4f-90c3cc5ae0f2', 'volume_size': 1}
Apr 28 22:16:56 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-ef9469a4-98eb-48f6-b17f-39be22b3da00 tempest-VolumesListTestJSON-486354339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:16:56 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-ef9469a4-98eb-48f6-b17f-39be22b3da00 tempest-VolumesListTestJSON-486354339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:16:56 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-ef9469a4-98eb-48f6-b17f-39be22b3da00 tempest-VolumesListTestJSON-486354339 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:16:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1244448735',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=658bec9e-f6f8-4ae2-bb4f-90c3cc5ae0f2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2ba6c91b2fb74f66bfab1bb0b95af4e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:16:57Z,use_quota=True,user_id='1ec4088bfc404daf8f427b11e5cd1487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:16:56 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-ef9469a4-98eb-48f6-b17f-39be22b3da00 tempest-VolumesListTestJSON-486354339 None] Creating volume 658bec9e-f6f8-4ae2-bb4f-90c3cc5ae0f2 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:16:56 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-ef9469a4-98eb-48f6-b17f-39be22b3da00 tempest-VolumesListTestJSON-486354339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:16:56 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-ef9469a4-98eb-48f6-b17f-39be22b3da00 tempest-VolumesListTestJSON-486354339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:16:56 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-ef9469a4-98eb-48f6-b17f-39be22b3da00 tempest-VolumesListTestJSON-486354339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:16:56 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-ef9469a4-98eb-48f6-b17f-39be22b3da00 tempest-VolumesListTestJSON-486354339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:16:56 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-ef9469a4-98eb-48f6-b17f-39be22b3da00 tempest-VolumesListTestJSON-486354339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:16:56 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-ef9469a4-98eb-48f6-b17f-39be22b3da00 tempest-VolumesListTestJSON-486354339 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:16:56 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-ef9469a4-98eb-48f6-b17f-39be22b3da00 tempest-VolumesListTestJSON-486354339 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:16:56 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-ef9469a4-98eb-48f6-b17f-39be22b3da00 tempest-VolumesListTestJSON-486354339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-658bec9e-f6f8-4ae2-bb4f-90c3cc5ae0f2 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:16:56 devstack sudo[92737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-658bec9e-f6f8-4ae2-bb4f-90c3cc5ae0f2 1073741824
Apr 28 22:16:56 devstack sudo[92737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:16:57 devstack sudo[92737]: pam_unix(sudo:session): session closed for user root
Apr 28 22:16:57 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-ef9469a4-98eb-48f6-b17f-39be22b3da00 tempest-VolumesListTestJSON-486354339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-658bec9e-f6f8-4ae2-bb4f-90c3cc5ae0f2 1073741824" returned: 0 in 0.714s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:16:57 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-ef9469a4-98eb-48f6-b17f-39be22b3da00 tempest-VolumesListTestJSON-486354339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-658bec9e-f6f8-4ae2-bb4f-90c3cc5ae0f2 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:16:57 devstack sudo[92742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-658bec9e-f6f8-4ae2-bb4f-90c3cc5ae0f2
Apr 28 22:16:57 devstack sudo[92742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:16:58 devstack sudo[92742]: pam_unix(sudo:session): session closed for user root
Apr 28 22:16:58 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-ef9469a4-98eb-48f6-b17f-39be22b3da00 tempest-VolumesListTestJSON-486354339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-658bec9e-f6f8-4ae2-bb4f-90c3cc5ae0f2" returned: 0 in 0.559s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:16:58 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-ef9469a4-98eb-48f6-b17f-39be22b3da00 tempest-VolumesListTestJSON-486354339 None] <== create_volume: return (1309ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:16:58 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-ef9469a4-98eb-48f6-b17f-39be22b3da00 tempest-VolumesListTestJSON-486354339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.311s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:16:58 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-ef9469a4-98eb-48f6-b17f-39be22b3da00 tempest-VolumesListTestJSON-486354339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33d69649-2bee-47aa-98e9-b190c1a4813d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-658bec9e-f6f8-4ae2-bb4f-90c3cc5ae0f2', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:16:58 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-ef9469a4-98eb-48f6-b17f-39be22b3da00 tempest-VolumesListTestJSON-486354339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (789a1e5f-8d66-4f67-b8f2-af6baac753fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:16:58 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-ef9469a4-98eb-48f6-b17f-39be22b3da00 tempest-VolumesListTestJSON-486354339 None] Volume volume-658bec9e-f6f8-4ae2-bb4f-90c3cc5ae0f2 (658bec9e-f6f8-4ae2-bb4f-90c3cc5ae0f2): created successfully
Apr 28 22:16:58 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-ef9469a4-98eb-48f6-b17f-39be22b3da00 tempest-VolumesListTestJSON-486354339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (789a1e5f-8d66-4f67-b8f2-af6baac753fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:16:58 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-ef9469a4-98eb-48f6-b17f-39be22b3da00 tempest-VolumesListTestJSON-486354339 None] Flow 'volume_create_manager' (7814a2c0-b44c-4d9a-a348-96e3117dab31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:16:58 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-ef9469a4-98eb-48f6-b17f-39be22b3da00 tempest-VolumesListTestJSON-486354339 None] Created volume successfully.
Apr 28 22:16:59 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-f068983f-eb2c-46d6-8a09-b50a778305ca tempest-VolumesListTestJSON-486354339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:16:59 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f068983f-eb2c-46d6-8a09-b50a778305ca tempest-VolumesListTestJSON-486354339 None] Flow 'volume_create_manager' (5a0c319e-e9c2-41ee-8dcb-4fd0b32625e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:16:59 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f068983f-eb2c-46d6-8a09-b50a778305ca tempest-VolumesListTestJSON-486354339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adc8a805-dd69-4b9b-8c31-a281d11354a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:16:59 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f068983f-eb2c-46d6-8a09-b50a778305ca tempest-VolumesListTestJSON-486354339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adc8a805-dd69-4b9b-8c31-a281d11354a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:16:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1309573064',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67175878-c004-40e3-be64-88022c696fbb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2ba6c91b2fb74f66bfab1bb0b95af4e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:16:59Z,use_quota=True,user_id='1ec4088bfc404daf8f427b11e5cd1487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:16:59 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f068983f-eb2c-46d6-8a09-b50a778305ca tempest-VolumesListTestJSON-486354339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6911f4dd-3f56-4bd3-8d62-b9f4fc0d9909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:16:59 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f068983f-eb2c-46d6-8a09-b50a778305ca tempest-VolumesListTestJSON-486354339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6911f4dd-3f56-4bd3-8d62-b9f4fc0d9909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:16:59 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f068983f-eb2c-46d6-8a09-b50a778305ca tempest-VolumesListTestJSON-486354339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcc0941c-1de0-44e5-bef2-57f559df7ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:16:59 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f068983f-eb2c-46d6-8a09-b50a778305ca tempest-VolumesListTestJSON-486354339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcc0941c-1de0-44e5-bef2-57f559df7ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67175878-c004-40e3-be64-88022c696fbb', 'volume_name': 'volume-67175878-c004-40e3-be64-88022c696fbb', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:16:59 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f068983f-eb2c-46d6-8a09-b50a778305ca tempest-VolumesListTestJSON-486354339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6adb9871-6b29-46b6-bc6f-e3f87833fa3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:16:59 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f068983f-eb2c-46d6-8a09-b50a778305ca tempest-VolumesListTestJSON-486354339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6adb9871-6b29-46b6-bc6f-e3f87833fa3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:16:59 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f068983f-eb2c-46d6-8a09-b50a778305ca tempest-VolumesListTestJSON-486354339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d779fa4-8e2c-487e-95cb-1516a46bfbd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:16:59 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-f068983f-eb2c-46d6-8a09-b50a778305ca tempest-VolumesListTestJSON-486354339 None] Volume 67175878-c004-40e3-be64-88022c696fbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67175878-c004-40e3-be64-88022c696fbb', 'volume_size': 1}
Apr 28 22:16:59 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f068983f-eb2c-46d6-8a09-b50a778305ca tempest-VolumesListTestJSON-486354339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:16:59 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f068983f-eb2c-46d6-8a09-b50a778305ca tempest-VolumesListTestJSON-486354339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:16:59 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-f068983f-eb2c-46d6-8a09-b50a778305ca tempest-VolumesListTestJSON-486354339 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:16:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1309573064',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67175878-c004-40e3-be64-88022c696fbb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2ba6c91b2fb74f66bfab1bb0b95af4e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:16:59Z,use_quota=True,user_id='1ec4088bfc404daf8f427b11e5cd1487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:16:59 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-f068983f-eb2c-46d6-8a09-b50a778305ca tempest-VolumesListTestJSON-486354339 None] Creating volume 67175878-c004-40e3-be64-88022c696fbb {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:16:59 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f068983f-eb2c-46d6-8a09-b50a778305ca tempest-VolumesListTestJSON-486354339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:16:59 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f068983f-eb2c-46d6-8a09-b50a778305ca tempest-VolumesListTestJSON-486354339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:16:59 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-f068983f-eb2c-46d6-8a09-b50a778305ca tempest-VolumesListTestJSON-486354339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:16:59 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-f068983f-eb2c-46d6-8a09-b50a778305ca tempest-VolumesListTestJSON-486354339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:16:59 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f068983f-eb2c-46d6-8a09-b50a778305ca tempest-VolumesListTestJSON-486354339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:16:59 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-f068983f-eb2c-46d6-8a09-b50a778305ca tempest-VolumesListTestJSON-486354339 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:16:59 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-f068983f-eb2c-46d6-8a09-b50a778305ca tempest-VolumesListTestJSON-486354339 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:16:59 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f068983f-eb2c-46d6-8a09-b50a778305ca tempest-VolumesListTestJSON-486354339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-67175878-c004-40e3-be64-88022c696fbb 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:16:59 devstack sudo[92745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-67175878-c004-40e3-be64-88022c696fbb 1073741824
Apr 28 22:16:59 devstack sudo[92745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:16:59 devstack sudo[92745]: pam_unix(sudo:session): session closed for user root
Apr 28 22:16:59 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f068983f-eb2c-46d6-8a09-b50a778305ca tempest-VolumesListTestJSON-486354339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-67175878-c004-40e3-be64-88022c696fbb 1073741824" returned: 0 in 0.712s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:16:59 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f068983f-eb2c-46d6-8a09-b50a778305ca tempest-VolumesListTestJSON-486354339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-67175878-c004-40e3-be64-88022c696fbb {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:16:59 devstack sudo[92751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-67175878-c004-40e3-be64-88022c696fbb
Apr 28 22:16:59 devstack sudo[92751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:00 devstack sudo[92751]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:00 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f068983f-eb2c-46d6-8a09-b50a778305ca tempest-VolumesListTestJSON-486354339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-67175878-c004-40e3-be64-88022c696fbb" returned: 0 in 0.555s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:00 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-f068983f-eb2c-46d6-8a09-b50a778305ca tempest-VolumesListTestJSON-486354339 None] <== create_volume: return (1308ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:17:00 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f068983f-eb2c-46d6-8a09-b50a778305ca tempest-VolumesListTestJSON-486354339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.309s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:17:00 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f068983f-eb2c-46d6-8a09-b50a778305ca tempest-VolumesListTestJSON-486354339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d779fa4-8e2c-487e-95cb-1516a46bfbd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67175878-c004-40e3-be64-88022c696fbb', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:00 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f068983f-eb2c-46d6-8a09-b50a778305ca tempest-VolumesListTestJSON-486354339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d16cd0d1-487a-4f45-913c-91f4f4451700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:00 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-f068983f-eb2c-46d6-8a09-b50a778305ca tempest-VolumesListTestJSON-486354339 None] Volume volume-67175878-c004-40e3-be64-88022c696fbb (67175878-c004-40e3-be64-88022c696fbb): created successfully
Apr 28 22:17:00 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f068983f-eb2c-46d6-8a09-b50a778305ca tempest-VolumesListTestJSON-486354339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d16cd0d1-487a-4f45-913c-91f4f4451700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:00 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f068983f-eb2c-46d6-8a09-b50a778305ca tempest-VolumesListTestJSON-486354339 None] Flow 'volume_create_manager' (5a0c319e-e9c2-41ee-8dcb-4fd0b32625e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:17:00 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-f068983f-eb2c-46d6-8a09-b50a778305ca tempest-VolumesListTestJSON-486354339 None] Created volume successfully.
Apr 28 22:17:01 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-92a0793d-41b4-4a9b-b9f6-3211c9236bd4 tempest-VolumesListTestJSON-486354339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:17:01 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-92a0793d-41b4-4a9b-b9f6-3211c9236bd4 tempest-VolumesListTestJSON-486354339 None] Flow 'volume_create_manager' (58e1115d-b46e-452c-937f-890f8964ea40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:17:01 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-92a0793d-41b4-4a9b-b9f6-3211c9236bd4 tempest-VolumesListTestJSON-486354339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d912cbdc-4fe7-4d4e-bc61-c91c82128e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:01 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-92a0793d-41b4-4a9b-b9f6-3211c9236bd4 tempest-VolumesListTestJSON-486354339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d912cbdc-4fe7-4d4e-bc61-c91c82128e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:17:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1504614599',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fe4e6e8-fee7-412a-8b64-0f0942a65872,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2ba6c91b2fb74f66bfab1bb0b95af4e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:17:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:17:02Z,use_quota=True,user_id='1ec4088bfc404daf8f427b11e5cd1487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:01 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-92a0793d-41b4-4a9b-b9f6-3211c9236bd4 tempest-VolumesListTestJSON-486354339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbe4f68a-aa10-458e-89e0-31f27617e7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:01 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-92a0793d-41b4-4a9b-b9f6-3211c9236bd4 tempest-VolumesListTestJSON-486354339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbe4f68a-aa10-458e-89e0-31f27617e7f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:01 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-92a0793d-41b4-4a9b-b9f6-3211c9236bd4 tempest-VolumesListTestJSON-486354339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e821366d-9d9d-4d79-8761-9a82d4bc58a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:01 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-92a0793d-41b4-4a9b-b9f6-3211c9236bd4 tempest-VolumesListTestJSON-486354339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e821366d-9d9d-4d79-8761-9a82d4bc58a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fe4e6e8-fee7-412a-8b64-0f0942a65872', 'volume_name': 'volume-9fe4e6e8-fee7-412a-8b64-0f0942a65872', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:01 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-92a0793d-41b4-4a9b-b9f6-3211c9236bd4 tempest-VolumesListTestJSON-486354339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6637ebf1-2c58-4180-b925-07d971722d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:01 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-92a0793d-41b4-4a9b-b9f6-3211c9236bd4 tempest-VolumesListTestJSON-486354339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6637ebf1-2c58-4180-b925-07d971722d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:01 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-92a0793d-41b4-4a9b-b9f6-3211c9236bd4 tempest-VolumesListTestJSON-486354339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e5840d9-e455-43b8-bea7-7f391dae61a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:01 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-92a0793d-41b4-4a9b-b9f6-3211c9236bd4 tempest-VolumesListTestJSON-486354339 None] Volume 9fe4e6e8-fee7-412a-8b64-0f0942a65872: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fe4e6e8-fee7-412a-8b64-0f0942a65872', 'volume_size': 1}
Apr 28 22:17:01 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-92a0793d-41b4-4a9b-b9f6-3211c9236bd4 tempest-VolumesListTestJSON-486354339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:17:01 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-92a0793d-41b4-4a9b-b9f6-3211c9236bd4 tempest-VolumesListTestJSON-486354339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:17:01 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-92a0793d-41b4-4a9b-b9f6-3211c9236bd4 tempest-VolumesListTestJSON-486354339 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:17:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1504614599',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fe4e6e8-fee7-412a-8b64-0f0942a65872,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2ba6c91b2fb74f66bfab1bb0b95af4e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:17:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:17:02Z,use_quota=True,user_id='1ec4088bfc404daf8f427b11e5cd1487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:17:01 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-92a0793d-41b4-4a9b-b9f6-3211c9236bd4 tempest-VolumesListTestJSON-486354339 None] Creating volume 9fe4e6e8-fee7-412a-8b64-0f0942a65872 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:17:01 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-92a0793d-41b4-4a9b-b9f6-3211c9236bd4 tempest-VolumesListTestJSON-486354339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:17:01 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-92a0793d-41b4-4a9b-b9f6-3211c9236bd4 tempest-VolumesListTestJSON-486354339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:17:01 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-92a0793d-41b4-4a9b-b9f6-3211c9236bd4 tempest-VolumesListTestJSON-486354339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:17:01 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-92a0793d-41b4-4a9b-b9f6-3211c9236bd4 tempest-VolumesListTestJSON-486354339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:17:01 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-92a0793d-41b4-4a9b-b9f6-3211c9236bd4 tempest-VolumesListTestJSON-486354339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:17:01 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-92a0793d-41b4-4a9b-b9f6-3211c9236bd4 tempest-VolumesListTestJSON-486354339 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:17:01 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-92a0793d-41b4-4a9b-b9f6-3211c9236bd4 tempest-VolumesListTestJSON-486354339 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:17:01 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-92a0793d-41b4-4a9b-b9f6-3211c9236bd4 tempest-VolumesListTestJSON-486354339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9fe4e6e8-fee7-412a-8b64-0f0942a65872 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:01 devstack sudo[92757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9fe4e6e8-fee7-412a-8b64-0f0942a65872 1073741824
Apr 28 22:17:01 devstack sudo[92757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:02 devstack sudo[92757]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:02 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-92a0793d-41b4-4a9b-b9f6-3211c9236bd4 tempest-VolumesListTestJSON-486354339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9fe4e6e8-fee7-412a-8b64-0f0942a65872 1073741824" returned: 0 in 0.811s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:02 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-92a0793d-41b4-4a9b-b9f6-3211c9236bd4 tempest-VolumesListTestJSON-486354339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9fe4e6e8-fee7-412a-8b64-0f0942a65872 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:02 devstack sudo[92762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9fe4e6e8-fee7-412a-8b64-0f0942a65872
Apr 28 22:17:02 devstack sudo[92762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:03 devstack sudo[92762]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:03 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-92a0793d-41b4-4a9b-b9f6-3211c9236bd4 tempest-VolumesListTestJSON-486354339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9fe4e6e8-fee7-412a-8b64-0f0942a65872" returned: 0 in 0.578s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:03 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-92a0793d-41b4-4a9b-b9f6-3211c9236bd4 tempest-VolumesListTestJSON-486354339 None] <== create_volume: return (1433ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:17:03 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-92a0793d-41b4-4a9b-b9f6-3211c9236bd4 tempest-VolumesListTestJSON-486354339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.436s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:17:03 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-92a0793d-41b4-4a9b-b9f6-3211c9236bd4 tempest-VolumesListTestJSON-486354339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e5840d9-e455-43b8-bea7-7f391dae61a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fe4e6e8-fee7-412a-8b64-0f0942a65872', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:03 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-92a0793d-41b4-4a9b-b9f6-3211c9236bd4 tempest-VolumesListTestJSON-486354339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87b94ae2-de3f-4dfe-9853-a234e809f747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:03 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-92a0793d-41b4-4a9b-b9f6-3211c9236bd4 tempest-VolumesListTestJSON-486354339 None] Volume volume-9fe4e6e8-fee7-412a-8b64-0f0942a65872 (9fe4e6e8-fee7-412a-8b64-0f0942a65872): created successfully
Apr 28 22:17:03 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-92a0793d-41b4-4a9b-b9f6-3211c9236bd4 tempest-VolumesListTestJSON-486354339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87b94ae2-de3f-4dfe-9853-a234e809f747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:03 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-92a0793d-41b4-4a9b-b9f6-3211c9236bd4 tempest-VolumesListTestJSON-486354339 None] Flow 'volume_create_manager' (58e1115d-b46e-452c-937f-890f8964ea40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:17:03 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-92a0793d-41b4-4a9b-b9f6-3211c9236bd4 tempest-VolumesListTestJSON-486354339 None] Created volume successfully.
Apr 28 22:17:05 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-6510988b-50f0-4977-91d0-c9b9e2a1bd44 tempest-VolumesListTestJSON-486354339 None] Acquiring lock "cinder-9fe4e6e8-fee7-412a-8b64-0f0942a65872-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:17:05 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-6510988b-50f0-4977-91d0-c9b9e2a1bd44 tempest-VolumesListTestJSON-486354339 None] Lock "cinder-9fe4e6e8-fee7-412a-8b64-0f0942a65872-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:17:05 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-6510988b-50f0-4977-91d0-c9b9e2a1bd44 tempest-VolumesListTestJSON-486354339 None] Acquiring lock "cinder-quobyte-9fe4e6e8-fee7-412a-8b64-0f0942a65872" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:17:05 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-6510988b-50f0-4977-91d0-c9b9e2a1bd44 tempest-VolumesListTestJSON-486354339 None] Lock "cinder-quobyte-9fe4e6e8-fee7-412a-8b64-0f0942a65872" acquired by "delete_volume" :: waited 0.016s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:17:05 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75ddc1c-2c0f-4096-b935-ff13a917b5ea]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:17:05 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-6510988b-50f0-4977-91d0-c9b9e2a1bd44 tempest-VolumesListTestJSON-486354339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9fe4e6e8-fee7-412a-8b64-0f0942a65872 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:05 devstack sudo[92766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9fe4e6e8-fee7-412a-8b64-0f0942a65872
Apr 28 22:17:05 devstack sudo[92766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:06 devstack sudo[92766]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:06 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-6510988b-50f0-4977-91d0-c9b9e2a1bd44 tempest-VolumesListTestJSON-486354339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9fe4e6e8-fee7-412a-8b64-0f0942a65872" returned: 0 in 0.673s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:06 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-6510988b-50f0-4977-91d0-c9b9e2a1bd44 tempest-VolumesListTestJSON-486354339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9fe4e6e8-fee7-412a-8b64-0f0942a65872 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:06 devstack sudo[92771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9fe4e6e8-fee7-412a-8b64-0f0942a65872
Apr 28 22:17:06 devstack sudo[92771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:06 devstack sudo[92771]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:06 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-6510988b-50f0-4977-91d0-c9b9e2a1bd44 tempest-VolumesListTestJSON-486354339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9fe4e6e8-fee7-412a-8b64-0f0942a65872" returned: 0 in 0.605s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:06 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-6510988b-50f0-4977-91d0-c9b9e2a1bd44 tempest-VolumesListTestJSON-486354339 None] Lock "cinder-quobyte-9fe4e6e8-fee7-412a-8b64-0f0942a65872" released by "delete_volume" :: held 1.316s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:17:07 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-6510988b-50f0-4977-91d0-c9b9e2a1bd44 tempest-VolumesListTestJSON-486354339 None] Created reservations ['d49645da-012d-4e13-87aa-845d473fb46e', '2d9518e0-c15e-4b72-88ea-e1ad60842f13', '4eda9200-7ea6-46d3-9414-37848920e6be', 'c6dfb556-049c-482b-a02a-5f90b2802346'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:17:07 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-6510988b-50f0-4977-91d0-c9b9e2a1bd44 tempest-VolumesListTestJSON-486354339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:17:07 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-6510988b-50f0-4977-91d0-c9b9e2a1bd44 tempest-VolumesListTestJSON-486354339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:17:07 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-6510988b-50f0-4977-91d0-c9b9e2a1bd44 tempest-VolumesListTestJSON-486354339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:17:07 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-6510988b-50f0-4977-91d0-c9b9e2a1bd44 tempest-VolumesListTestJSON-486354339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:17:07 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-6510988b-50f0-4977-91d0-c9b9e2a1bd44 tempest-VolumesListTestJSON-486354339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:17:07 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-6510988b-50f0-4977-91d0-c9b9e2a1bd44 tempest-VolumesListTestJSON-486354339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:07 devstack sudo[92774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:17:07 devstack sudo[92774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:07 devstack sudo[92774]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:07 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-6510988b-50f0-4977-91d0-c9b9e2a1bd44 tempest-VolumesListTestJSON-486354339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.564s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:07 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-6510988b-50f0-4977-91d0-c9b9e2a1bd44 tempest-VolumesListTestJSON-486354339 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:17:07 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-6510988b-50f0-4977-91d0-c9b9e2a1bd44 tempest-VolumesListTestJSON-486354339 None] Deleted volume successfully.
Apr 28 22:17:07 devstack cinder-volume[83924]: DEBUG dbcounter [-] [83924] Writing DB stats cinder:INSERT=31,cinder:UPDATE=89,cinder:SELECT=66,cinder:DELETE=8 {{(pid=83924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 28 22:17:07 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-6510988b-50f0-4977-91d0-c9b9e2a1bd44 tempest-VolumesListTestJSON-486354339 None] Lock "cinder-9fe4e6e8-fee7-412a-8b64-0f0942a65872-delete_volume" released by "delete_volume" :: held 2.071s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:17:07 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-1ad049f2-7330-490d-a44e-2b4a56c54fbe tempest-VolumesListTestJSON-486354339 None] Acquiring lock "cinder-67175878-c004-40e3-be64-88022c696fbb-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:17:07 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-1ad049f2-7330-490d-a44e-2b4a56c54fbe tempest-VolumesListTestJSON-486354339 None] Lock "cinder-67175878-c004-40e3-be64-88022c696fbb-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:17:07 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-1ad049f2-7330-490d-a44e-2b4a56c54fbe tempest-VolumesListTestJSON-486354339 None] Acquiring lock "cinder-quobyte-67175878-c004-40e3-be64-88022c696fbb" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:17:07 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-1ad049f2-7330-490d-a44e-2b4a56c54fbe tempest-VolumesListTestJSON-486354339 None] Lock "cinder-quobyte-67175878-c004-40e3-be64-88022c696fbb" acquired by "delete_volume" :: waited 0.016s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:17:08 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd5be40-bd65-48a8-ac63-d91a3cb2db07]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:17:08 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-1ad049f2-7330-490d-a44e-2b4a56c54fbe tempest-VolumesListTestJSON-486354339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-67175878-c004-40e3-be64-88022c696fbb {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:08 devstack sudo[92777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-67175878-c004-40e3-be64-88022c696fbb
Apr 28 22:17:08 devstack sudo[92777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:08 devstack sudo[92777]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:08 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-1ad049f2-7330-490d-a44e-2b4a56c54fbe tempest-VolumesListTestJSON-486354339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-67175878-c004-40e3-be64-88022c696fbb" returned: 0 in 0.654s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:08 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-1ad049f2-7330-490d-a44e-2b4a56c54fbe tempest-VolumesListTestJSON-486354339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-67175878-c004-40e3-be64-88022c696fbb {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:08 devstack sudo[92782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-67175878-c004-40e3-be64-88022c696fbb
Apr 28 22:17:08 devstack sudo[92782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:09 devstack sudo[92782]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:09 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-1ad049f2-7330-490d-a44e-2b4a56c54fbe tempest-VolumesListTestJSON-486354339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-67175878-c004-40e3-be64-88022c696fbb" returned: 0 in 0.576s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:09 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-1ad049f2-7330-490d-a44e-2b4a56c54fbe tempest-VolumesListTestJSON-486354339 None] Lock "cinder-quobyte-67175878-c004-40e3-be64-88022c696fbb" released by "delete_volume" :: held 1.271s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:17:09 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-1ad049f2-7330-490d-a44e-2b4a56c54fbe tempest-VolumesListTestJSON-486354339 None] Created reservations ['063837ed-d876-414c-99c2-644451141326', 'f14d596b-3d8e-4da2-b97c-01f2d3c7dec0', '4853b55d-f5cb-4453-89b9-8bf548d01b72', '05ba89d5-a076-4571-b232-00cce4a94ddd'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:17:09 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-1ad049f2-7330-490d-a44e-2b4a56c54fbe tempest-VolumesListTestJSON-486354339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:17:09 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-1ad049f2-7330-490d-a44e-2b4a56c54fbe tempest-VolumesListTestJSON-486354339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:17:09 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-1ad049f2-7330-490d-a44e-2b4a56c54fbe tempest-VolumesListTestJSON-486354339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:17:09 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-1ad049f2-7330-490d-a44e-2b4a56c54fbe tempest-VolumesListTestJSON-486354339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:17:09 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-1ad049f2-7330-490d-a44e-2b4a56c54fbe tempest-VolumesListTestJSON-486354339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:17:09 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-1ad049f2-7330-490d-a44e-2b4a56c54fbe tempest-VolumesListTestJSON-486354339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:09 devstack sudo[92785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:17:09 devstack sudo[92785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:09 devstack sudo[92785]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:09 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-1ad049f2-7330-490d-a44e-2b4a56c54fbe tempest-VolumesListTestJSON-486354339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.556s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:09 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-1ad049f2-7330-490d-a44e-2b4a56c54fbe tempest-VolumesListTestJSON-486354339 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:17:09 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-1ad049f2-7330-490d-a44e-2b4a56c54fbe tempest-VolumesListTestJSON-486354339 None] Deleted volume successfully.
Apr 28 22:17:09 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-1ad049f2-7330-490d-a44e-2b4a56c54fbe tempest-VolumesListTestJSON-486354339 None] Lock "cinder-67175878-c004-40e3-be64-88022c696fbb-delete_volume" released by "delete_volume" :: held 2.030s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:17:10 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-8a4758ab-9412-48f7-9550-48fb4b959fc7 tempest-VolumesListTestJSON-486354339 None] Acquiring lock "cinder-658bec9e-f6f8-4ae2-bb4f-90c3cc5ae0f2-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:17:10 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-8a4758ab-9412-48f7-9550-48fb4b959fc7 tempest-VolumesListTestJSON-486354339 None] Lock "cinder-658bec9e-f6f8-4ae2-bb4f-90c3cc5ae0f2-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:17:10 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-8a4758ab-9412-48f7-9550-48fb4b959fc7 tempest-VolumesListTestJSON-486354339 None] Acquiring lock "cinder-quobyte-658bec9e-f6f8-4ae2-bb4f-90c3cc5ae0f2" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:17:10 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-8a4758ab-9412-48f7-9550-48fb4b959fc7 tempest-VolumesListTestJSON-486354339 None] Lock "cinder-quobyte-658bec9e-f6f8-4ae2-bb4f-90c3cc5ae0f2" acquired by "delete_volume" :: waited 0.016s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:17:10 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e8b9ea-3278-4bae-8578-5e1964c3804f]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:17:10 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-8a4758ab-9412-48f7-9550-48fb4b959fc7 tempest-VolumesListTestJSON-486354339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-658bec9e-f6f8-4ae2-bb4f-90c3cc5ae0f2 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:10 devstack sudo[92788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-658bec9e-f6f8-4ae2-bb4f-90c3cc5ae0f2
Apr 28 22:17:10 devstack sudo[92788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:10 devstack sudo[92788]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:10 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-8a4758ab-9412-48f7-9550-48fb4b959fc7 tempest-VolumesListTestJSON-486354339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-658bec9e-f6f8-4ae2-bb4f-90c3cc5ae0f2" returned: 0 in 0.685s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:10 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-8a4758ab-9412-48f7-9550-48fb4b959fc7 tempest-VolumesListTestJSON-486354339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-658bec9e-f6f8-4ae2-bb4f-90c3cc5ae0f2 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:10 devstack sudo[92794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-658bec9e-f6f8-4ae2-bb4f-90c3cc5ae0f2
Apr 28 22:17:10 devstack sudo[92794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:11 devstack sudo[92794]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:11 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-8a4758ab-9412-48f7-9550-48fb4b959fc7 tempest-VolumesListTestJSON-486354339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-658bec9e-f6f8-4ae2-bb4f-90c3cc5ae0f2" returned: 0 in 0.594s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:11 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-8a4758ab-9412-48f7-9550-48fb4b959fc7 tempest-VolumesListTestJSON-486354339 None] Lock "cinder-quobyte-658bec9e-f6f8-4ae2-bb4f-90c3cc5ae0f2" released by "delete_volume" :: held 1.318s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:17:11 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-8a4758ab-9412-48f7-9550-48fb4b959fc7 tempest-VolumesListTestJSON-486354339 None] Created reservations ['5d40b9cf-364b-4232-bb0e-530564407d0a', 'c8f409b9-e972-456e-96c6-ab02e987c491', '8fa2cde4-e87a-4145-8aad-f55a71867212', '08d2ef2c-d840-4124-999a-0e408ba86ee0'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:17:11 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-8a4758ab-9412-48f7-9550-48fb4b959fc7 tempest-VolumesListTestJSON-486354339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:17:11 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-8a4758ab-9412-48f7-9550-48fb4b959fc7 tempest-VolumesListTestJSON-486354339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:17:11 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-8a4758ab-9412-48f7-9550-48fb4b959fc7 tempest-VolumesListTestJSON-486354339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:17:11 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-8a4758ab-9412-48f7-9550-48fb4b959fc7 tempest-VolumesListTestJSON-486354339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:17:11 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-8a4758ab-9412-48f7-9550-48fb4b959fc7 tempest-VolumesListTestJSON-486354339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:17:11 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-8a4758ab-9412-48f7-9550-48fb4b959fc7 tempest-VolumesListTestJSON-486354339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:11 devstack sudo[92797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:17:11 devstack sudo[92797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:12 devstack sudo[92797]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:12 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-8a4758ab-9412-48f7-9550-48fb4b959fc7 tempest-VolumesListTestJSON-486354339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.556s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:12 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-8a4758ab-9412-48f7-9550-48fb4b959fc7 tempest-VolumesListTestJSON-486354339 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:17:12 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-8a4758ab-9412-48f7-9550-48fb4b959fc7 tempest-VolumesListTestJSON-486354339 None] Deleted volume successfully.
Apr 28 22:17:12 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-8a4758ab-9412-48f7-9550-48fb4b959fc7 tempest-VolumesListTestJSON-486354339 None] Lock "cinder-658bec9e-f6f8-4ae2-bb4f-90c3cc5ae0f2-delete_volume" released by "delete_volume" :: held 2.062s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:17:21 devstack cinder-volume[83924]: DEBUG dbcounter [-] [83924] Writing DB stats cinder:SELECT=12,cinder:INSERT=2,cinder:UPDATE=16 {{(pid=83924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 28 22:17:22 devstack cinder-volume[83924]: DEBUG dbcounter [-] [83924] Writing DB stats cinder:INSERT=15,cinder:SELECT=31,cinder:UPDATE=52,cinder:DELETE=6 {{(pid=83924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 28 22:17:23 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c627de5-06fd-4946-aad7-8d93f47bd39d tempest-VolumeDependencyTests-1826445949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:17:23 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-0c627de5-06fd-4946-aad7-8d93f47bd39d tempest-VolumeDependencyTests-1826445949 None] Flow 'volume_create_manager' (c135d262-44f5-4000-bba9-baef31443d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:17:23 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-0c627de5-06fd-4946-aad7-8d93f47bd39d tempest-VolumeDependencyTests-1826445949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (952eeea7-8d94-44c2-b2cc-7f73df915768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:23 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-0c627de5-06fd-4946-aad7-8d93f47bd39d tempest-VolumeDependencyTests-1826445949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (952eeea7-8d94-44c2-b2cc-7f73df915768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:17:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1980122554',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd54e365-b397-4625-9a1a-c331a110f554,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0a8cf6e955c4797a45097f8aba2542e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:17:23Z,use_quota=True,user_id='8d0c1e1ebfa748e2b733fb77632a8e6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:23 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-0c627de5-06fd-4946-aad7-8d93f47bd39d tempest-VolumeDependencyTests-1826445949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb1fde29-1bf6-412f-bf03-66e778b89d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:23 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-0c627de5-06fd-4946-aad7-8d93f47bd39d tempest-VolumeDependencyTests-1826445949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb1fde29-1bf6-412f-bf03-66e778b89d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:23 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-0c627de5-06fd-4946-aad7-8d93f47bd39d tempest-VolumeDependencyTests-1826445949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6485791d-d775-4a3f-9cf5-24386abee917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:23 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-0c627de5-06fd-4946-aad7-8d93f47bd39d tempest-VolumeDependencyTests-1826445949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6485791d-d775-4a3f-9cf5-24386abee917) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd54e365-b397-4625-9a1a-c331a110f554', 'volume_name': 'volume-cd54e365-b397-4625-9a1a-c331a110f554', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:23 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-0c627de5-06fd-4946-aad7-8d93f47bd39d tempest-VolumeDependencyTests-1826445949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d325810-1a99-4ef1-aa7a-6a936137edbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:23 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-0c627de5-06fd-4946-aad7-8d93f47bd39d tempest-VolumeDependencyTests-1826445949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d325810-1a99-4ef1-aa7a-6a936137edbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:23 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-0c627de5-06fd-4946-aad7-8d93f47bd39d tempest-VolumeDependencyTests-1826445949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33050c81-1f95-445d-a89e-56737bade766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:23 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-0c627de5-06fd-4946-aad7-8d93f47bd39d tempest-VolumeDependencyTests-1826445949 None] Volume cd54e365-b397-4625-9a1a-c331a110f554: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd54e365-b397-4625-9a1a-c331a110f554', 'volume_size': 1}
Apr 28 22:17:23 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-0c627de5-06fd-4946-aad7-8d93f47bd39d tempest-VolumeDependencyTests-1826445949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:17:23 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-0c627de5-06fd-4946-aad7-8d93f47bd39d tempest-VolumeDependencyTests-1826445949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:17:23 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-0c627de5-06fd-4946-aad7-8d93f47bd39d tempest-VolumeDependencyTests-1826445949 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:17:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1980122554',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd54e365-b397-4625-9a1a-c331a110f554,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0a8cf6e955c4797a45097f8aba2542e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:17:23Z,use_quota=True,user_id='8d0c1e1ebfa748e2b733fb77632a8e6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:17:23 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-0c627de5-06fd-4946-aad7-8d93f47bd39d tempest-VolumeDependencyTests-1826445949 None] Creating volume cd54e365-b397-4625-9a1a-c331a110f554 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:17:23 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-0c627de5-06fd-4946-aad7-8d93f47bd39d tempest-VolumeDependencyTests-1826445949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:17:23 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-0c627de5-06fd-4946-aad7-8d93f47bd39d tempest-VolumeDependencyTests-1826445949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:17:23 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-0c627de5-06fd-4946-aad7-8d93f47bd39d tempest-VolumeDependencyTests-1826445949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:17:23 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-0c627de5-06fd-4946-aad7-8d93f47bd39d tempest-VolumeDependencyTests-1826445949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:17:23 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-0c627de5-06fd-4946-aad7-8d93f47bd39d tempest-VolumeDependencyTests-1826445949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:17:23 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-0c627de5-06fd-4946-aad7-8d93f47bd39d tempest-VolumeDependencyTests-1826445949 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:17:23 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-0c627de5-06fd-4946-aad7-8d93f47bd39d tempest-VolumeDependencyTests-1826445949 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:17:23 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-0c627de5-06fd-4946-aad7-8d93f47bd39d tempest-VolumeDependencyTests-1826445949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cd54e365-b397-4625-9a1a-c331a110f554 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:23 devstack sudo[92874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cd54e365-b397-4625-9a1a-c331a110f554 1073741824
Apr 28 22:17:23 devstack sudo[92874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:23 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-24034eb6-9b35-46b2-9e01-54b41c56cdd5 tempest-CreateVolumesFromImageTest-1357551715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:17:23 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-24034eb6-9b35-46b2-9e01-54b41c56cdd5 tempest-CreateVolumesFromImageTest-1357551715 None] Flow 'volume_create_manager' (fd4e0018-ed11-4286-870f-94539a1141e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:17:23 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-24034eb6-9b35-46b2-9e01-54b41c56cdd5 tempest-CreateVolumesFromImageTest-1357551715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32c5e05d-6ecc-47fa-86fd-6454f8e76db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:23 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-24034eb6-9b35-46b2-9e01-54b41c56cdd5 tempest-CreateVolumesFromImageTest-1357551715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32c5e05d-6ecc-47fa-86fd-6454f8e76db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:17:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2146422770',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0514471e-48c7-45c8-8657-a5c6de954165,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fbcd288834f4d84901a50baef70fc1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:17:23Z,use_quota=True,user_id='3e11e437e8954f85b77f958044fb6d05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:23 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-24034eb6-9b35-46b2-9e01-54b41c56cdd5 tempest-CreateVolumesFromImageTest-1357551715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f046044-4c6b-442c-b507-d0b90b3f0068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:23 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-24034eb6-9b35-46b2-9e01-54b41c56cdd5 tempest-CreateVolumesFromImageTest-1357551715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f046044-4c6b-442c-b507-d0b90b3f0068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:23 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-24034eb6-9b35-46b2-9e01-54b41c56cdd5 tempest-CreateVolumesFromImageTest-1357551715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b91a0f61-471b-41d3-aeef-bc289d63af60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:23 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-24034eb6-9b35-46b2-9e01-54b41c56cdd5 tempest-CreateVolumesFromImageTest-1357551715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b91a0f61-471b-41d3-aeef-bc289d63af60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0514471e-48c7-45c8-8657-a5c6de954165', 'volume_name': 'volume-0514471e-48c7-45c8-8657-a5c6de954165', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:23 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-24034eb6-9b35-46b2-9e01-54b41c56cdd5 tempest-CreateVolumesFromImageTest-1357551715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d93869ea-ee8e-4d5c-87c5-5b0d0a48fcda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:23 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-24034eb6-9b35-46b2-9e01-54b41c56cdd5 tempest-CreateVolumesFromImageTest-1357551715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d93869ea-ee8e-4d5c-87c5-5b0d0a48fcda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:23 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-24034eb6-9b35-46b2-9e01-54b41c56cdd5 tempest-CreateVolumesFromImageTest-1357551715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da0169c2-bcb5-4bfa-884b-bf439fb8728f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:23 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-24034eb6-9b35-46b2-9e01-54b41c56cdd5 tempest-CreateVolumesFromImageTest-1357551715 None] Volume 0514471e-48c7-45c8-8657-a5c6de954165: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0514471e-48c7-45c8-8657-a5c6de954165', 'volume_size': 1}
Apr 28 22:17:23 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-24034eb6-9b35-46b2-9e01-54b41c56cdd5 tempest-CreateVolumesFromImageTest-1357551715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:17:23 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-0796bc55-d4d6-4e60-810a-c31b202a4306 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:17:23 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-0796bc55-d4d6-4e60-810a-c31b202a4306 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Flow 'volume_create_manager' (c84e16c6-4b37-40e6-8856-656a6212551e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:17:24 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-0796bc55-d4d6-4e60-810a-c31b202a4306 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64d287d5-7ba8-4521-b5ce-62d2c99ece21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:24 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-0796bc55-d4d6-4e60-810a-c31b202a4306 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64d287d5-7ba8-4521-b5ce-62d2c99ece21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:17:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1353907078',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='609f6249a87f4b5eb1ea4978d34fdb2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:17:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:17:24Z,use_quota=True,user_id='ab1cae9809144a3f925f6115d5ac18d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:24 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-0796bc55-d4d6-4e60-810a-c31b202a4306 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2c9d77e-f152-41d3-9ecb-5c8f4cff518b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:24 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-0796bc55-d4d6-4e60-810a-c31b202a4306 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2c9d77e-f152-41d3-9ecb-5c8f4cff518b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:24 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-0796bc55-d4d6-4e60-810a-c31b202a4306 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6341d7de-f72d-48a4-989d-89be2fd7cf5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:24 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-0796bc55-d4d6-4e60-810a-c31b202a4306 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6341d7de-f72d-48a4-989d-89be2fd7cf5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b', 'volume_name': 'volume-b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:24 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-0796bc55-d4d6-4e60-810a-c31b202a4306 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f94bd8f7-c297-44f7-9693-363361df3d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:24 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-0796bc55-d4d6-4e60-810a-c31b202a4306 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f94bd8f7-c297-44f7-9693-363361df3d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:24 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-0796bc55-d4d6-4e60-810a-c31b202a4306 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ca59e7d-3ca2-4958-a755-40c8f677b47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:24 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-0796bc55-d4d6-4e60-810a-c31b202a4306 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Volume b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b', 'volume_size': 1}
Apr 28 22:17:24 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-0796bc55-d4d6-4e60-810a-c31b202a4306 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:17:24 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-b296824c-2724-4ec9-8abc-e084e268059b tempest-CreateVolumesFromImageTest-1357551715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:17:24 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b296824c-2724-4ec9-8abc-e084e268059b tempest-CreateVolumesFromImageTest-1357551715 None] Flow 'volume_create_manager' (e84d6acb-5ab7-48b1-a6fa-dea8309a3247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:17:24 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b296824c-2724-4ec9-8abc-e084e268059b tempest-CreateVolumesFromImageTest-1357551715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3216999-2cfe-49ed-96e6-2572d20d3c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:24 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b296824c-2724-4ec9-8abc-e084e268059b tempest-CreateVolumesFromImageTest-1357551715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3216999-2cfe-49ed-96e6-2572d20d3c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:17:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-754024881',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30f95dbb-07f6-42c2-8d89-d98bce6e158b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fbcd288834f4d84901a50baef70fc1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:17:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:17:24Z,use_quota=True,user_id='3e11e437e8954f85b77f958044fb6d05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:24 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b296824c-2724-4ec9-8abc-e084e268059b tempest-CreateVolumesFromImageTest-1357551715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8912eb7d-1628-4518-b8c7-8bb3d82fd3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:24 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b296824c-2724-4ec9-8abc-e084e268059b tempest-CreateVolumesFromImageTest-1357551715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8912eb7d-1628-4518-b8c7-8bb3d82fd3a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:24 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b296824c-2724-4ec9-8abc-e084e268059b tempest-CreateVolumesFromImageTest-1357551715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (231aa449-0234-4dea-8bb2-adfa9ae392f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:24 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b296824c-2724-4ec9-8abc-e084e268059b tempest-CreateVolumesFromImageTest-1357551715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (231aa449-0234-4dea-8bb2-adfa9ae392f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30f95dbb-07f6-42c2-8d89-d98bce6e158b', 'volume_name': 'volume-30f95dbb-07f6-42c2-8d89-d98bce6e158b', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:24 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b296824c-2724-4ec9-8abc-e084e268059b tempest-CreateVolumesFromImageTest-1357551715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45ccef63-87b6-4d1e-99b8-9143301d30be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:24 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b296824c-2724-4ec9-8abc-e084e268059b tempest-CreateVolumesFromImageTest-1357551715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45ccef63-87b6-4d1e-99b8-9143301d30be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:24 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b296824c-2724-4ec9-8abc-e084e268059b tempest-CreateVolumesFromImageTest-1357551715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a1fb6d8-234f-4b31-81f4-3dc4294761ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:24 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-b296824c-2724-4ec9-8abc-e084e268059b tempest-CreateVolumesFromImageTest-1357551715 None] Volume 30f95dbb-07f6-42c2-8d89-d98bce6e158b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30f95dbb-07f6-42c2-8d89-d98bce6e158b', 'volume_size': 1}
Apr 28 22:17:24 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b296824c-2724-4ec9-8abc-e084e268059b tempest-CreateVolumesFromImageTest-1357551715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:17:24 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-c57fbd2c-0623-4550-83fb-dd6c14ab0ff5 tempest-CreateVolumesFromImageTest-1357551715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:17:24 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-c57fbd2c-0623-4550-83fb-dd6c14ab0ff5 tempest-CreateVolumesFromImageTest-1357551715 None] Flow 'volume_create_manager' (bb957716-34a6-4ec1-9afc-83f893383460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:17:24 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-c57fbd2c-0623-4550-83fb-dd6c14ab0ff5 tempest-CreateVolumesFromImageTest-1357551715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56adbbf8-ffed-4271-8081-a5b4bc2bab58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:24 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-c57fbd2c-0623-4550-83fb-dd6c14ab0ff5 tempest-CreateVolumesFromImageTest-1357551715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56adbbf8-ffed-4271-8081-a5b4bc2bab58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:17:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-501261685',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edee61d4-e5aa-4624-8ded-7c824fcbca53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fbcd288834f4d84901a50baef70fc1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:17:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:17:24Z,use_quota=True,user_id='3e11e437e8954f85b77f958044fb6d05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:24 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-c57fbd2c-0623-4550-83fb-dd6c14ab0ff5 tempest-CreateVolumesFromImageTest-1357551715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (975bcb7a-f2cb-4abd-bc0d-ec232208e0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:24 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-c57fbd2c-0623-4550-83fb-dd6c14ab0ff5 tempest-CreateVolumesFromImageTest-1357551715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (975bcb7a-f2cb-4abd-bc0d-ec232208e0ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:24 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-c57fbd2c-0623-4550-83fb-dd6c14ab0ff5 tempest-CreateVolumesFromImageTest-1357551715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e77296e4-486a-4a46-a91f-0253e8a3faf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:24 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-c57fbd2c-0623-4550-83fb-dd6c14ab0ff5 tempest-CreateVolumesFromImageTest-1357551715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e77296e4-486a-4a46-a91f-0253e8a3faf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edee61d4-e5aa-4624-8ded-7c824fcbca53', 'volume_name': 'volume-edee61d4-e5aa-4624-8ded-7c824fcbca53', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:24 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-c57fbd2c-0623-4550-83fb-dd6c14ab0ff5 tempest-CreateVolumesFromImageTest-1357551715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cbc7024-5443-4368-b066-2a591af0015d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:24 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-c57fbd2c-0623-4550-83fb-dd6c14ab0ff5 tempest-CreateVolumesFromImageTest-1357551715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cbc7024-5443-4368-b066-2a591af0015d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:24 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-c57fbd2c-0623-4550-83fb-dd6c14ab0ff5 tempest-CreateVolumesFromImageTest-1357551715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09cbcc92-d9a8-48c1-a89c-bb1451d5cebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:24 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-c57fbd2c-0623-4550-83fb-dd6c14ab0ff5 tempest-CreateVolumesFromImageTest-1357551715 None] Volume edee61d4-e5aa-4624-8ded-7c824fcbca53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edee61d4-e5aa-4624-8ded-7c824fcbca53', 'volume_size': 1}
Apr 28 22:17:24 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-c57fbd2c-0623-4550-83fb-dd6c14ab0ff5 tempest-CreateVolumesFromImageTest-1357551715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:17:24 devstack sudo[92874]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:24 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-0c627de5-06fd-4946-aad7-8d93f47bd39d tempest-VolumeDependencyTests-1826445949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cd54e365-b397-4625-9a1a-c331a110f554 1073741824" returned: 0 in 1.208s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:24 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-0c627de5-06fd-4946-aad7-8d93f47bd39d tempest-VolumeDependencyTests-1826445949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cd54e365-b397-4625-9a1a-c331a110f554 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:24 devstack sudo[92882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cd54e365-b397-4625-9a1a-c331a110f554
Apr 28 22:17:24 devstack sudo[92882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:24 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dcab695-bbed-4472-9e01-b14401ebe492 tempest-CreateVolumesFromImageTest-1357551715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:17:24 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3dcab695-bbed-4472-9e01-b14401ebe492 tempest-CreateVolumesFromImageTest-1357551715 None] Flow 'volume_create_manager' (b5edaa41-8ad8-40f7-b5e8-fd51d476452a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:17:24 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3dcab695-bbed-4472-9e01-b14401ebe492 tempest-CreateVolumesFromImageTest-1357551715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bca8211c-d547-4509-aea2-2c6ff19a362a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:24 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3dcab695-bbed-4472-9e01-b14401ebe492 tempest-CreateVolumesFromImageTest-1357551715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bca8211c-d547-4509-aea2-2c6ff19a362a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:17:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-392622804',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5379392f-96a0-4a94-a520-47c1da4f4b44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fbcd288834f4d84901a50baef70fc1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:17:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:17:25Z,use_quota=True,user_id='3e11e437e8954f85b77f958044fb6d05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:24 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3dcab695-bbed-4472-9e01-b14401ebe492 tempest-CreateVolumesFromImageTest-1357551715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6482ee9-535e-47d1-8ec6-98a478aee574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:24 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3dcab695-bbed-4472-9e01-b14401ebe492 tempest-CreateVolumesFromImageTest-1357551715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6482ee9-535e-47d1-8ec6-98a478aee574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:24 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3dcab695-bbed-4472-9e01-b14401ebe492 tempest-CreateVolumesFromImageTest-1357551715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da7f726a-1db1-46a6-8df0-6bfaf15a3bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:24 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3dcab695-bbed-4472-9e01-b14401ebe492 tempest-CreateVolumesFromImageTest-1357551715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da7f726a-1db1-46a6-8df0-6bfaf15a3bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5379392f-96a0-4a94-a520-47c1da4f4b44', 'volume_name': 'volume-5379392f-96a0-4a94-a520-47c1da4f4b44', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:24 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3dcab695-bbed-4472-9e01-b14401ebe492 tempest-CreateVolumesFromImageTest-1357551715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54a99224-3747-4e62-beac-42869a41c443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:24 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3dcab695-bbed-4472-9e01-b14401ebe492 tempest-CreateVolumesFromImageTest-1357551715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54a99224-3747-4e62-beac-42869a41c443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:24 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3dcab695-bbed-4472-9e01-b14401ebe492 tempest-CreateVolumesFromImageTest-1357551715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa594965-a25a-45c2-aafd-10edb84151d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:24 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-3dcab695-bbed-4472-9e01-b14401ebe492 tempest-CreateVolumesFromImageTest-1357551715 None] Volume 5379392f-96a0-4a94-a520-47c1da4f4b44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5379392f-96a0-4a94-a520-47c1da4f4b44', 'volume_size': 1}
Apr 28 22:17:24 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-3dcab695-bbed-4472-9e01-b14401ebe492 tempest-CreateVolumesFromImageTest-1357551715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:17:25 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9eceaaa-201c-478b-829c-6e5a4d3482e4 tempest-CreateVolumesFromImageTest-1357551715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:17:25 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f9eceaaa-201c-478b-829c-6e5a4d3482e4 tempest-CreateVolumesFromImageTest-1357551715 None] Flow 'volume_create_manager' (331f0b92-a17b-438e-b605-e85a2d2f62af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:17:25 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f9eceaaa-201c-478b-829c-6e5a4d3482e4 tempest-CreateVolumesFromImageTest-1357551715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89813418-7129-40cc-afdd-310b15fa5167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:25 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f9eceaaa-201c-478b-829c-6e5a4d3482e4 tempest-CreateVolumesFromImageTest-1357551715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89813418-7129-40cc-afdd-310b15fa5167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:17:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1148277825',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70253ef5-a8ae-4434-a14b-a515ea038138,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fbcd288834f4d84901a50baef70fc1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:17:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:17:25Z,use_quota=True,user_id='3e11e437e8954f85b77f958044fb6d05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:25 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f9eceaaa-201c-478b-829c-6e5a4d3482e4 tempest-CreateVolumesFromImageTest-1357551715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75149151-d5a4-485f-9ab2-2e5788822307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:25 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f9eceaaa-201c-478b-829c-6e5a4d3482e4 tempest-CreateVolumesFromImageTest-1357551715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75149151-d5a4-485f-9ab2-2e5788822307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:25 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f9eceaaa-201c-478b-829c-6e5a4d3482e4 tempest-CreateVolumesFromImageTest-1357551715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6a3c231-2c49-424e-97d5-dd86b954b176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:25 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f9eceaaa-201c-478b-829c-6e5a4d3482e4 tempest-CreateVolumesFromImageTest-1357551715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6a3c231-2c49-424e-97d5-dd86b954b176) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70253ef5-a8ae-4434-a14b-a515ea038138', 'volume_name': 'volume-70253ef5-a8ae-4434-a14b-a515ea038138', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:25 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f9eceaaa-201c-478b-829c-6e5a4d3482e4 tempest-CreateVolumesFromImageTest-1357551715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65931384-f93c-4acc-b4b0-1db76448b184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:25 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f9eceaaa-201c-478b-829c-6e5a4d3482e4 tempest-CreateVolumesFromImageTest-1357551715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65931384-f93c-4acc-b4b0-1db76448b184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:25 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f9eceaaa-201c-478b-829c-6e5a4d3482e4 tempest-CreateVolumesFromImageTest-1357551715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3babfe29-736d-484d-9e8f-8a889ada38fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:25 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-f9eceaaa-201c-478b-829c-6e5a4d3482e4 tempest-CreateVolumesFromImageTest-1357551715 None] Volume 70253ef5-a8ae-4434-a14b-a515ea038138: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70253ef5-a8ae-4434-a14b-a515ea038138', 'volume_size': 1}
Apr 28 22:17:25 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f9eceaaa-201c-478b-829c-6e5a4d3482e4 tempest-CreateVolumesFromImageTest-1357551715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:17:25 devstack sudo[92882]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:25 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-0c627de5-06fd-4946-aad7-8d93f47bd39d tempest-VolumeDependencyTests-1826445949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cd54e365-b397-4625-9a1a-c331a110f554" returned: 0 in 0.746s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:25 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-0c627de5-06fd-4946-aad7-8d93f47bd39d tempest-VolumeDependencyTests-1826445949 None] <== create_volume: return (2007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:17:25 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-0c627de5-06fd-4946-aad7-8d93f47bd39d tempest-VolumeDependencyTests-1826445949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.010s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:17:25 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-24034eb6-9b35-46b2-9e01-54b41c56cdd5 tempest-CreateVolumesFromImageTest-1357551715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.740s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:17:25 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-24034eb6-9b35-46b2-9e01-54b41c56cdd5 tempest-CreateVolumesFromImageTest-1357551715 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:17:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2146422770',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0514471e-48c7-45c8-8657-a5c6de954165,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fbcd288834f4d84901a50baef70fc1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:17:23Z,use_quota=True,user_id='3e11e437e8954f85b77f958044fb6d05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:17:25 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-24034eb6-9b35-46b2-9e01-54b41c56cdd5 tempest-CreateVolumesFromImageTest-1357551715 None] Creating volume 0514471e-48c7-45c8-8657-a5c6de954165 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:17:25 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-24034eb6-9b35-46b2-9e01-54b41c56cdd5 tempest-CreateVolumesFromImageTest-1357551715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:17:25 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-24034eb6-9b35-46b2-9e01-54b41c56cdd5 tempest-CreateVolumesFromImageTest-1357551715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:17:25 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-24034eb6-9b35-46b2-9e01-54b41c56cdd5 tempest-CreateVolumesFromImageTest-1357551715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:17:25 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-24034eb6-9b35-46b2-9e01-54b41c56cdd5 tempest-CreateVolumesFromImageTest-1357551715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:17:25 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-24034eb6-9b35-46b2-9e01-54b41c56cdd5 tempest-CreateVolumesFromImageTest-1357551715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:17:25 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-24034eb6-9b35-46b2-9e01-54b41c56cdd5 tempest-CreateVolumesFromImageTest-1357551715 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:17:25 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-24034eb6-9b35-46b2-9e01-54b41c56cdd5 tempest-CreateVolumesFromImageTest-1357551715 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:17:25 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-24034eb6-9b35-46b2-9e01-54b41c56cdd5 tempest-CreateVolumesFromImageTest-1357551715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-0514471e-48c7-45c8-8657-a5c6de954165 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:25 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-0c627de5-06fd-4946-aad7-8d93f47bd39d tempest-VolumeDependencyTests-1826445949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33050c81-1f95-445d-a89e-56737bade766) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd54e365-b397-4625-9a1a-c331a110f554', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:25 devstack sudo[92885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-0514471e-48c7-45c8-8657-a5c6de954165 1073741824
Apr 28 22:17:25 devstack sudo[92885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:25 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-0c627de5-06fd-4946-aad7-8d93f47bd39d tempest-VolumeDependencyTests-1826445949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a3e8e2a-4af8-4774-8ac5-8c0c77d8474b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:25 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-0c627de5-06fd-4946-aad7-8d93f47bd39d tempest-VolumeDependencyTests-1826445949 None] Volume volume-cd54e365-b397-4625-9a1a-c331a110f554 (cd54e365-b397-4625-9a1a-c331a110f554): created successfully
Apr 28 22:17:25 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-0c627de5-06fd-4946-aad7-8d93f47bd39d tempest-VolumeDependencyTests-1826445949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a3e8e2a-4af8-4774-8ac5-8c0c77d8474b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:25 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-0c627de5-06fd-4946-aad7-8d93f47bd39d tempest-VolumeDependencyTests-1826445949 None] Flow 'volume_create_manager' (c135d262-44f5-4000-bba9-baef31443d7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:17:25 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-0c627de5-06fd-4946-aad7-8d93f47bd39d tempest-VolumeDependencyTests-1826445949 None] Created volume successfully.
Apr 28 22:17:26 devstack sudo[92885]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:26 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-24034eb6-9b35-46b2-9e01-54b41c56cdd5 tempest-CreateVolumesFromImageTest-1357551715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-0514471e-48c7-45c8-8657-a5c6de954165 1073741824" returned: 0 in 0.898s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:26 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-24034eb6-9b35-46b2-9e01-54b41c56cdd5 tempest-CreateVolumesFromImageTest-1357551715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-0514471e-48c7-45c8-8657-a5c6de954165 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:26 devstack sudo[92896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-0514471e-48c7-45c8-8657-a5c6de954165
Apr 28 22:17:26 devstack sudo[92896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:26 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-91fecd63-eb70-4674-a2fb-0b32850eefa1 tempest-VolumeDependencyTests-1826445949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:17:26 devstack sudo[92896]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:26 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-24034eb6-9b35-46b2-9e01-54b41c56cdd5 tempest-CreateVolumesFromImageTest-1357551715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-0514471e-48c7-45c8-8657-a5c6de954165" returned: 0 in 0.644s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:26 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-24034eb6-9b35-46b2-9e01-54b41c56cdd5 tempest-CreateVolumesFromImageTest-1357551715 None] <== create_volume: return (1593ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:17:26 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-24034eb6-9b35-46b2-9e01-54b41c56cdd5 tempest-CreateVolumesFromImageTest-1357551715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.595s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:17:26 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-0796bc55-d4d6-4e60-810a-c31b202a4306 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.844s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:17:26 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-0796bc55-d4d6-4e60-810a-c31b202a4306 tempest-CreateVolumesFromSnapshotTest-1887340981 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:17:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1353907078',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='609f6249a87f4b5eb1ea4978d34fdb2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:17:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:17:24Z,use_quota=True,user_id='ab1cae9809144a3f925f6115d5ac18d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:17:26 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-0796bc55-d4d6-4e60-810a-c31b202a4306 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Creating volume b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:17:26 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-0796bc55-d4d6-4e60-810a-c31b202a4306 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:17:26 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-0796bc55-d4d6-4e60-810a-c31b202a4306 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:17:26 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-0796bc55-d4d6-4e60-810a-c31b202a4306 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:17:26 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-0796bc55-d4d6-4e60-810a-c31b202a4306 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:17:26 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-0796bc55-d4d6-4e60-810a-c31b202a4306 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:17:26 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-0796bc55-d4d6-4e60-810a-c31b202a4306 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:17:26 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-0796bc55-d4d6-4e60-810a-c31b202a4306 tempest-CreateVolumesFromSnapshotTest-1887340981 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:17:26 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-0796bc55-d4d6-4e60-810a-c31b202a4306 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:26 devstack sudo[92900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b 1073741824
Apr 28 22:17:26 devstack sudo[92900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:26 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-24034eb6-9b35-46b2-9e01-54b41c56cdd5 tempest-CreateVolumesFromImageTest-1357551715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da0169c2-bcb5-4bfa-884b-bf439fb8728f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0514471e-48c7-45c8-8657-a5c6de954165', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:26 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-24034eb6-9b35-46b2-9e01-54b41c56cdd5 tempest-CreateVolumesFromImageTest-1357551715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c88f5c3c-cd52-4586-8999-ee4f83559b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:26 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-24034eb6-9b35-46b2-9e01-54b41c56cdd5 tempest-CreateVolumesFromImageTest-1357551715 None] Volume volume-0514471e-48c7-45c8-8657-a5c6de954165 (0514471e-48c7-45c8-8657-a5c6de954165): created successfully
Apr 28 22:17:26 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-24034eb6-9b35-46b2-9e01-54b41c56cdd5 tempest-CreateVolumesFromImageTest-1357551715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c88f5c3c-cd52-4586-8999-ee4f83559b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:26 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-24034eb6-9b35-46b2-9e01-54b41c56cdd5 tempest-CreateVolumesFromImageTest-1357551715 None] Flow 'volume_create_manager' (fd4e0018-ed11-4286-870f-94539a1141e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:17:27 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-24034eb6-9b35-46b2-9e01-54b41c56cdd5 tempest-CreateVolumesFromImageTest-1357551715 None] Created volume successfully.
Apr 28 22:17:27 devstack sudo[92900]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:27 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-0796bc55-d4d6-4e60-810a-c31b202a4306 tempest-CreateVolumesFromSnapshotTest-1887340981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b 1073741824" returned: 0 in 0.815s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:27 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-0796bc55-d4d6-4e60-810a-c31b202a4306 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:27 devstack sudo[92906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b
Apr 28 22:17:27 devstack sudo[92906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:28 devstack sudo[92906]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:28 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-0796bc55-d4d6-4e60-810a-c31b202a4306 tempest-CreateVolumesFromSnapshotTest-1887340981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b" returned: 0 in 0.687s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:28 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-0796bc55-d4d6-4e60-810a-c31b202a4306 tempest-CreateVolumesFromSnapshotTest-1887340981 None] <== create_volume: return (1540ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:17:28 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-0796bc55-d4d6-4e60-810a-c31b202a4306 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.543s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:17:28 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b296824c-2724-4ec9-8abc-e084e268059b tempest-CreateVolumesFromImageTest-1357551715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.209s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:17:28 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-b296824c-2724-4ec9-8abc-e084e268059b tempest-CreateVolumesFromImageTest-1357551715 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:17:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-754024881',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30f95dbb-07f6-42c2-8d89-d98bce6e158b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fbcd288834f4d84901a50baef70fc1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:17:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:17:24Z,use_quota=True,user_id='3e11e437e8954f85b77f958044fb6d05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:17:28 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-b296824c-2724-4ec9-8abc-e084e268059b tempest-CreateVolumesFromImageTest-1357551715 None] Creating volume 30f95dbb-07f6-42c2-8d89-d98bce6e158b {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:17:28 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b296824c-2724-4ec9-8abc-e084e268059b tempest-CreateVolumesFromImageTest-1357551715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:17:28 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b296824c-2724-4ec9-8abc-e084e268059b tempest-CreateVolumesFromImageTest-1357551715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:17:28 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-b296824c-2724-4ec9-8abc-e084e268059b tempest-CreateVolumesFromImageTest-1357551715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:17:28 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-b296824c-2724-4ec9-8abc-e084e268059b tempest-CreateVolumesFromImageTest-1357551715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:17:28 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b296824c-2724-4ec9-8abc-e084e268059b tempest-CreateVolumesFromImageTest-1357551715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:17:28 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-b296824c-2724-4ec9-8abc-e084e268059b tempest-CreateVolumesFromImageTest-1357551715 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:17:28 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-b296824c-2724-4ec9-8abc-e084e268059b tempest-CreateVolumesFromImageTest-1357551715 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:17:28 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b296824c-2724-4ec9-8abc-e084e268059b tempest-CreateVolumesFromImageTest-1357551715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-30f95dbb-07f6-42c2-8d89-d98bce6e158b 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:28 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-0796bc55-d4d6-4e60-810a-c31b202a4306 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ca59e7d-3ca2-4958-a755-40c8f677b47c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:28 devstack sudo[92909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-30f95dbb-07f6-42c2-8d89-d98bce6e158b 1073741824
Apr 28 22:17:28 devstack sudo[92909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:28 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-0796bc55-d4d6-4e60-810a-c31b202a4306 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6a8c2c8-3698-4e16-96b6-7f19691d6dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:28 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-0796bc55-d4d6-4e60-810a-c31b202a4306 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Volume volume-b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b (b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b): created successfully
Apr 28 22:17:28 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-0796bc55-d4d6-4e60-810a-c31b202a4306 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6a8c2c8-3698-4e16-96b6-7f19691d6dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:28 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-0796bc55-d4d6-4e60-810a-c31b202a4306 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Flow 'volume_create_manager' (c84e16c6-4b37-40e6-8856-656a6212551e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:17:28 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-0796bc55-d4d6-4e60-810a-c31b202a4306 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Created volume successfully.
Apr 28 22:17:29 devstack sudo[92909]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b296824c-2724-4ec9-8abc-e084e268059b tempest-CreateVolumesFromImageTest-1357551715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-30f95dbb-07f6-42c2-8d89-d98bce6e158b 1073741824" returned: 0 in 0.929s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b296824c-2724-4ec9-8abc-e084e268059b tempest-CreateVolumesFromImageTest-1357551715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-30f95dbb-07f6-42c2-8d89-d98bce6e158b {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:29 devstack sudo[92915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-30f95dbb-07f6-42c2-8d89-d98bce6e158b
Apr 28 22:17:29 devstack sudo[92915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-76d742e1-a3fb-4b04-9f2f-c8874a6a0c71 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:17:30 devstack sudo[92915]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:30 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b296824c-2724-4ec9-8abc-e084e268059b tempest-CreateVolumesFromImageTest-1357551715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-30f95dbb-07f6-42c2-8d89-d98bce6e158b" returned: 0 in 0.724s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:30 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-b296824c-2724-4ec9-8abc-e084e268059b tempest-CreateVolumesFromImageTest-1357551715 None] <== create_volume: return (1711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:17:30 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b296824c-2724-4ec9-8abc-e084e268059b tempest-CreateVolumesFromImageTest-1357551715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.714s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:17:30 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-c57fbd2c-0623-4550-83fb-dd6c14ab0ff5 tempest-CreateVolumesFromImageTest-1357551715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.682s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:17:30 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-c57fbd2c-0623-4550-83fb-dd6c14ab0ff5 tempest-CreateVolumesFromImageTest-1357551715 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:17:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-501261685',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edee61d4-e5aa-4624-8ded-7c824fcbca53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fbcd288834f4d84901a50baef70fc1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:17:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:17:24Z,use_quota=True,user_id='3e11e437e8954f85b77f958044fb6d05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:17:30 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-c57fbd2c-0623-4550-83fb-dd6c14ab0ff5 tempest-CreateVolumesFromImageTest-1357551715 None] Creating volume edee61d4-e5aa-4624-8ded-7c824fcbca53 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:17:30 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-c57fbd2c-0623-4550-83fb-dd6c14ab0ff5 tempest-CreateVolumesFromImageTest-1357551715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:17:30 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-c57fbd2c-0623-4550-83fb-dd6c14ab0ff5 tempest-CreateVolumesFromImageTest-1357551715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:17:30 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-c57fbd2c-0623-4550-83fb-dd6c14ab0ff5 tempest-CreateVolumesFromImageTest-1357551715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:17:30 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-c57fbd2c-0623-4550-83fb-dd6c14ab0ff5 tempest-CreateVolumesFromImageTest-1357551715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:17:30 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-c57fbd2c-0623-4550-83fb-dd6c14ab0ff5 tempest-CreateVolumesFromImageTest-1357551715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:17:30 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-c57fbd2c-0623-4550-83fb-dd6c14ab0ff5 tempest-CreateVolumesFromImageTest-1357551715 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:17:30 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-c57fbd2c-0623-4550-83fb-dd6c14ab0ff5 tempest-CreateVolumesFromImageTest-1357551715 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:17:30 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c57fbd2c-0623-4550-83fb-dd6c14ab0ff5 tempest-CreateVolumesFromImageTest-1357551715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-edee61d4-e5aa-4624-8ded-7c824fcbca53 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:30 devstack sudo[92918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-edee61d4-e5aa-4624-8ded-7c824fcbca53 1073741824
Apr 28 22:17:30 devstack sudo[92918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:30 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b296824c-2724-4ec9-8abc-e084e268059b tempest-CreateVolumesFromImageTest-1357551715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a1fb6d8-234f-4b31-81f4-3dc4294761ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30f95dbb-07f6-42c2-8d89-d98bce6e158b', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:30 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b296824c-2724-4ec9-8abc-e084e268059b tempest-CreateVolumesFromImageTest-1357551715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89217be3-d722-4487-9623-e50d7de8486a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:30 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-b296824c-2724-4ec9-8abc-e084e268059b tempest-CreateVolumesFromImageTest-1357551715 None] Volume volume-30f95dbb-07f6-42c2-8d89-d98bce6e158b (30f95dbb-07f6-42c2-8d89-d98bce6e158b): created successfully
Apr 28 22:17:30 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b296824c-2724-4ec9-8abc-e084e268059b tempest-CreateVolumesFromImageTest-1357551715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89217be3-d722-4487-9623-e50d7de8486a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:30 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b296824c-2724-4ec9-8abc-e084e268059b tempest-CreateVolumesFromImageTest-1357551715 None] Flow 'volume_create_manager' (e84d6acb-5ab7-48b1-a6fa-dea8309a3247) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:17:30 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-b296824c-2724-4ec9-8abc-e084e268059b tempest-CreateVolumesFromImageTest-1357551715 None] Created volume successfully.
Apr 28 22:17:31 devstack sudo[92918]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c57fbd2c-0623-4550-83fb-dd6c14ab0ff5 tempest-CreateVolumesFromImageTest-1357551715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-edee61d4-e5aa-4624-8ded-7c824fcbca53 1073741824" returned: 0 in 0.849s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c57fbd2c-0623-4550-83fb-dd6c14ab0ff5 tempest-CreateVolumesFromImageTest-1357551715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-edee61d4-e5aa-4624-8ded-7c824fcbca53 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:31 devstack sudo[92924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-edee61d4-e5aa-4624-8ded-7c824fcbca53
Apr 28 22:17:31 devstack sudo[92924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:31 devstack sudo[92924]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c57fbd2c-0623-4550-83fb-dd6c14ab0ff5 tempest-CreateVolumesFromImageTest-1357551715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-edee61d4-e5aa-4624-8ded-7c824fcbca53" returned: 0 in 0.633s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:31 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-c57fbd2c-0623-4550-83fb-dd6c14ab0ff5 tempest-CreateVolumesFromImageTest-1357551715 None] <== create_volume: return (1526ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:17:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-c57fbd2c-0623-4550-83fb-dd6c14ab0ff5 tempest-CreateVolumesFromImageTest-1357551715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.531s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:17:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-3dcab695-bbed-4472-9e01-b14401ebe492 tempest-CreateVolumesFromImageTest-1357551715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.733s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:17:31 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-3dcab695-bbed-4472-9e01-b14401ebe492 tempest-CreateVolumesFromImageTest-1357551715 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:17:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-392622804',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5379392f-96a0-4a94-a520-47c1da4f4b44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fbcd288834f4d84901a50baef70fc1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:17:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:17:25Z,use_quota=True,user_id='3e11e437e8954f85b77f958044fb6d05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:17:31 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-3dcab695-bbed-4472-9e01-b14401ebe492 tempest-CreateVolumesFromImageTest-1357551715 None] Creating volume 5379392f-96a0-4a94-a520-47c1da4f4b44 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:17:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-3dcab695-bbed-4472-9e01-b14401ebe492 tempest-CreateVolumesFromImageTest-1357551715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:17:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-3dcab695-bbed-4472-9e01-b14401ebe492 tempest-CreateVolumesFromImageTest-1357551715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:17:31 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-3dcab695-bbed-4472-9e01-b14401ebe492 tempest-CreateVolumesFromImageTest-1357551715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:17:31 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-3dcab695-bbed-4472-9e01-b14401ebe492 tempest-CreateVolumesFromImageTest-1357551715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:17:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-3dcab695-bbed-4472-9e01-b14401ebe492 tempest-CreateVolumesFromImageTest-1357551715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:17:31 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-3dcab695-bbed-4472-9e01-b14401ebe492 tempest-CreateVolumesFromImageTest-1357551715 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:17:31 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-3dcab695-bbed-4472-9e01-b14401ebe492 tempest-CreateVolumesFromImageTest-1357551715 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:17:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-3dcab695-bbed-4472-9e01-b14401ebe492 tempest-CreateVolumesFromImageTest-1357551715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-5379392f-96a0-4a94-a520-47c1da4f4b44 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:31 devstack sudo[92927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-5379392f-96a0-4a94-a520-47c1da4f4b44 1073741824
Apr 28 22:17:31 devstack sudo[92927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:31 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-c57fbd2c-0623-4550-83fb-dd6c14ab0ff5 tempest-CreateVolumesFromImageTest-1357551715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09cbcc92-d9a8-48c1-a89c-bb1451d5cebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edee61d4-e5aa-4624-8ded-7c824fcbca53', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:31 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-c57fbd2c-0623-4550-83fb-dd6c14ab0ff5 tempest-CreateVolumesFromImageTest-1357551715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb05a95e-96e3-404a-9157-38ed2494d5c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:31 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-c57fbd2c-0623-4550-83fb-dd6c14ab0ff5 tempest-CreateVolumesFromImageTest-1357551715 None] Volume volume-edee61d4-e5aa-4624-8ded-7c824fcbca53 (edee61d4-e5aa-4624-8ded-7c824fcbca53): created successfully
Apr 28 22:17:31 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-c57fbd2c-0623-4550-83fb-dd6c14ab0ff5 tempest-CreateVolumesFromImageTest-1357551715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb05a95e-96e3-404a-9157-38ed2494d5c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:31 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-c57fbd2c-0623-4550-83fb-dd6c14ab0ff5 tempest-CreateVolumesFromImageTest-1357551715 None] Flow 'volume_create_manager' (bb957716-34a6-4ec1-9afc-83f893383460) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:17:31 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-c57fbd2c-0623-4550-83fb-dd6c14ab0ff5 tempest-CreateVolumesFromImageTest-1357551715 None] Created volume successfully.
Apr 28 22:17:32 devstack sudo[92927]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:32 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-3dcab695-bbed-4472-9e01-b14401ebe492 tempest-CreateVolumesFromImageTest-1357551715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-5379392f-96a0-4a94-a520-47c1da4f4b44 1073741824" returned: 0 in 0.835s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:32 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-3dcab695-bbed-4472-9e01-b14401ebe492 tempest-CreateVolumesFromImageTest-1357551715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-5379392f-96a0-4a94-a520-47c1da4f4b44 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:32 devstack sudo[92933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-5379392f-96a0-4a94-a520-47c1da4f4b44
Apr 28 22:17:32 devstack sudo[92933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:33 devstack sudo[92933]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:33 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-3dcab695-bbed-4472-9e01-b14401ebe492 tempest-CreateVolumesFromImageTest-1357551715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-5379392f-96a0-4a94-a520-47c1da4f4b44" returned: 0 in 0.626s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:33 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-3dcab695-bbed-4472-9e01-b14401ebe492 tempest-CreateVolumesFromImageTest-1357551715 None] <== create_volume: return (1505ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:17:33 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-3dcab695-bbed-4472-9e01-b14401ebe492 tempest-CreateVolumesFromImageTest-1357551715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.507s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:17:33 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f9eceaaa-201c-478b-829c-6e5a4d3482e4 tempest-CreateVolumesFromImageTest-1357551715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.944s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:17:33 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-f9eceaaa-201c-478b-829c-6e5a4d3482e4 tempest-CreateVolumesFromImageTest-1357551715 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:17:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1148277825',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70253ef5-a8ae-4434-a14b-a515ea038138,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fbcd288834f4d84901a50baef70fc1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:17:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:17:25Z,use_quota=True,user_id='3e11e437e8954f85b77f958044fb6d05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:17:33 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-f9eceaaa-201c-478b-829c-6e5a4d3482e4 tempest-CreateVolumesFromImageTest-1357551715 None] Creating volume 70253ef5-a8ae-4434-a14b-a515ea038138 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:17:33 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f9eceaaa-201c-478b-829c-6e5a4d3482e4 tempest-CreateVolumesFromImageTest-1357551715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:17:33 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f9eceaaa-201c-478b-829c-6e5a4d3482e4 tempest-CreateVolumesFromImageTest-1357551715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:17:33 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-f9eceaaa-201c-478b-829c-6e5a4d3482e4 tempest-CreateVolumesFromImageTest-1357551715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:17:33 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-f9eceaaa-201c-478b-829c-6e5a4d3482e4 tempest-CreateVolumesFromImageTest-1357551715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:17:33 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f9eceaaa-201c-478b-829c-6e5a4d3482e4 tempest-CreateVolumesFromImageTest-1357551715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:17:33 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-f9eceaaa-201c-478b-829c-6e5a4d3482e4 tempest-CreateVolumesFromImageTest-1357551715 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:17:33 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-f9eceaaa-201c-478b-829c-6e5a4d3482e4 tempest-CreateVolumesFromImageTest-1357551715 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:17:33 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f9eceaaa-201c-478b-829c-6e5a4d3482e4 tempest-CreateVolumesFromImageTest-1357551715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-70253ef5-a8ae-4434-a14b-a515ea038138 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:33 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3dcab695-bbed-4472-9e01-b14401ebe492 tempest-CreateVolumesFromImageTest-1357551715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa594965-a25a-45c2-aafd-10edb84151d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5379392f-96a0-4a94-a520-47c1da4f4b44', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:33 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3dcab695-bbed-4472-9e01-b14401ebe492 tempest-CreateVolumesFromImageTest-1357551715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a80b7ecc-8540-4614-8579-1d46ec8876b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:33 devstack sudo[92937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-70253ef5-a8ae-4434-a14b-a515ea038138 1073741824
Apr 28 22:17:33 devstack sudo[92937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:33 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-3dcab695-bbed-4472-9e01-b14401ebe492 tempest-CreateVolumesFromImageTest-1357551715 None] Volume volume-5379392f-96a0-4a94-a520-47c1da4f4b44 (5379392f-96a0-4a94-a520-47c1da4f4b44): created successfully
Apr 28 22:17:33 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3dcab695-bbed-4472-9e01-b14401ebe492 tempest-CreateVolumesFromImageTest-1357551715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a80b7ecc-8540-4614-8579-1d46ec8876b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:33 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3dcab695-bbed-4472-9e01-b14401ebe492 tempest-CreateVolumesFromImageTest-1357551715 None] Flow 'volume_create_manager' (b5edaa41-8ad8-40f7-b5e8-fd51d476452a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:17:33 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-3dcab695-bbed-4472-9e01-b14401ebe492 tempest-CreateVolumesFromImageTest-1357551715 None] Created volume successfully.
Apr 28 22:17:34 devstack sudo[92937]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:34 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f9eceaaa-201c-478b-829c-6e5a4d3482e4 tempest-CreateVolumesFromImageTest-1357551715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-70253ef5-a8ae-4434-a14b-a515ea038138 1073741824" returned: 0 in 0.920s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:34 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f9eceaaa-201c-478b-829c-6e5a4d3482e4 tempest-CreateVolumesFromImageTest-1357551715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-70253ef5-a8ae-4434-a14b-a515ea038138 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:34 devstack sudo[92943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-70253ef5-a8ae-4434-a14b-a515ea038138
Apr 28 22:17:34 devstack sudo[92943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:34 devstack sudo[92943]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:34 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f9eceaaa-201c-478b-829c-6e5a4d3482e4 tempest-CreateVolumesFromImageTest-1357551715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-70253ef5-a8ae-4434-a14b-a515ea038138" returned: 0 in 0.612s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:34 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-f9eceaaa-201c-478b-829c-6e5a4d3482e4 tempest-CreateVolumesFromImageTest-1357551715 None] <== create_volume: return (1579ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:17:34 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f9eceaaa-201c-478b-829c-6e5a4d3482e4 tempest-CreateVolumesFromImageTest-1357551715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.582s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:17:34 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-91fecd63-eb70-4674-a2fb-0b32850eefa1 tempest-VolumeDependencyTests-1826445949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.053s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:17:34 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f9eceaaa-201c-478b-829c-6e5a4d3482e4 tempest-CreateVolumesFromImageTest-1357551715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3babfe29-736d-484d-9e8f-8a889ada38fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70253ef5-a8ae-4434-a14b-a515ea038138', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:34 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f9eceaaa-201c-478b-829c-6e5a4d3482e4 tempest-CreateVolumesFromImageTest-1357551715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a828b96-9e57-4d1d-a755-753203a031a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:34 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-91fecd63-eb70-4674-a2fb-0b32850eefa1 tempest-VolumeDependencyTests-1826445949 None] Creating offline snapshot b4fd5b2c-6967-4bd5-a5f4-8ea2b8d4833c of volume cd54e365-b397-4625-9a1a-c331a110f554 {{(pid=83924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 22:17:34 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-f9eceaaa-201c-478b-829c-6e5a4d3482e4 tempest-CreateVolumesFromImageTest-1357551715 None] Volume volume-70253ef5-a8ae-4434-a14b-a515ea038138 (70253ef5-a8ae-4434-a14b-a515ea038138): created successfully
Apr 28 22:17:34 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f9eceaaa-201c-478b-829c-6e5a4d3482e4 tempest-CreateVolumesFromImageTest-1357551715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a828b96-9e57-4d1d-a755-753203a031a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:34 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f9eceaaa-201c-478b-829c-6e5a4d3482e4 tempest-CreateVolumesFromImageTest-1357551715 None] Flow 'volume_create_manager' (331f0b92-a17b-438e-b605-e85a2d2f62af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:17:34 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0c3d3e-42f2-4ef4-8087-eb6a4a13736f]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:17:34 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-91fecd63-eb70-4674-a2fb-0b32850eefa1 tempest-VolumeDependencyTests-1826445949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cd54e365-b397-4625-9a1a-c331a110f554 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:34 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-f9eceaaa-201c-478b-829c-6e5a4d3482e4 tempest-CreateVolumesFromImageTest-1357551715 None] Created volume successfully.
Apr 28 22:17:35 devstack sudo[92948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cd54e365-b397-4625-9a1a-c331a110f554
Apr 28 22:17:35 devstack sudo[92948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:35 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-5499ccae-b646-4dac-b61a-c719b7c89571 tempest-CreateVolumesFromImageTest-1357551715 None] Acquiring lock "cinder-70253ef5-a8ae-4434-a14b-a515ea038138-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:17:35 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-5499ccae-b646-4dac-b61a-c719b7c89571 tempest-CreateVolumesFromImageTest-1357551715 None] Lock "cinder-70253ef5-a8ae-4434-a14b-a515ea038138-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:17:35 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-5499ccae-b646-4dac-b61a-c719b7c89571 tempest-CreateVolumesFromImageTest-1357551715 None] Acquiring lock "cinder-quobyte-70253ef5-a8ae-4434-a14b-a515ea038138" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:17:35 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-5499ccae-b646-4dac-b61a-c719b7c89571 tempest-CreateVolumesFromImageTest-1357551715 None] Lock "cinder-quobyte-70253ef5-a8ae-4434-a14b-a515ea038138" acquired by "delete_volume" :: waited 0.017s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:17:35 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e46acada-2728-4bd6-8299-adcfe2bd25c5]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:17:35 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5499ccae-b646-4dac-b61a-c719b7c89571 tempest-CreateVolumesFromImageTest-1357551715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-70253ef5-a8ae-4434-a14b-a515ea038138 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:35 devstack sudo[92950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-70253ef5-a8ae-4434-a14b-a515ea038138
Apr 28 22:17:35 devstack sudo[92950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:35 devstack sudo[92948]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:35 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-91fecd63-eb70-4674-a2fb-0b32850eefa1 tempest-VolumeDependencyTests-1826445949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cd54e365-b397-4625-9a1a-c331a110f554" returned: 0 in 0.770s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:35 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-91fecd63-eb70-4674-a2fb-0b32850eefa1 tempest-VolumeDependencyTests-1826445949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cd54e365-b397-4625-9a1a-c331a110f554,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cd54e365-b397-4625-9a1a-c331a110f554.b4fd5b2c-6967-4bd5-a5f4-8ea2b8d4833c 1G {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:35 devstack sudo[92955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cd54e365-b397-4625-9a1a-c331a110f554,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cd54e365-b397-4625-9a1a-c331a110f554.b4fd5b2c-6967-4bd5-a5f4-8ea2b8d4833c 1G
Apr 28 22:17:35 devstack sudo[92955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:36 devstack sudo[92950]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:36 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5499ccae-b646-4dac-b61a-c719b7c89571 tempest-CreateVolumesFromImageTest-1357551715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-70253ef5-a8ae-4434-a14b-a515ea038138" returned: 0 in 0.727s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:36 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5499ccae-b646-4dac-b61a-c719b7c89571 tempest-CreateVolumesFromImageTest-1357551715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-70253ef5-a8ae-4434-a14b-a515ea038138 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:36 devstack sudo[92960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-70253ef5-a8ae-4434-a14b-a515ea038138
Apr 28 22:17:36 devstack sudo[92960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:36 devstack sudo[92955]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:36 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-91fecd63-eb70-4674-a2fb-0b32850eefa1 tempest-VolumeDependencyTests-1826445949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cd54e365-b397-4625-9a1a-c331a110f554,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cd54e365-b397-4625-9a1a-c331a110f554.b4fd5b2c-6967-4bd5-a5f4-8ea2b8d4833c 1G" returned: 0 in 0.891s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:36 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-91fecd63-eb70-4674-a2fb-0b32850eefa1 tempest-VolumeDependencyTests-1826445949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd54e365-b397-4625-9a1a-c331a110f554 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cd54e365-b397-4625-9a1a-c331a110f554.b4fd5b2c-6967-4bd5-a5f4-8ea2b8d4833c {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:36 devstack sudo[92966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd54e365-b397-4625-9a1a-c331a110f554 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cd54e365-b397-4625-9a1a-c331a110f554.b4fd5b2c-6967-4bd5-a5f4-8ea2b8d4833c
Apr 28 22:17:36 devstack sudo[92966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:36 devstack sudo[92960]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:36 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5499ccae-b646-4dac-b61a-c719b7c89571 tempest-CreateVolumesFromImageTest-1357551715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-70253ef5-a8ae-4434-a14b-a515ea038138" returned: 0 in 0.659s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:36 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-5499ccae-b646-4dac-b61a-c719b7c89571 tempest-CreateVolumesFromImageTest-1357551715 None] Lock "cinder-quobyte-70253ef5-a8ae-4434-a14b-a515ea038138" released by "delete_volume" :: held 1.439s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:17:36 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-5499ccae-b646-4dac-b61a-c719b7c89571 tempest-CreateVolumesFromImageTest-1357551715 None] Created reservations ['fa457982-1510-4f78-80fc-4eeb748ec70d', '68525357-ced4-4f34-b7c5-cf40766c090c', '4bcfb3f7-6034-4793-9f85-8142cdd536c7', '8d6326eb-c4cf-4e39-bab5-0fec85fa3de5'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:17:36 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-5499ccae-b646-4dac-b61a-c719b7c89571 tempest-CreateVolumesFromImageTest-1357551715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:17:36 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-5499ccae-b646-4dac-b61a-c719b7c89571 tempest-CreateVolumesFromImageTest-1357551715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:17:36 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-5499ccae-b646-4dac-b61a-c719b7c89571 tempest-CreateVolumesFromImageTest-1357551715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:17:36 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-5499ccae-b646-4dac-b61a-c719b7c89571 tempest-CreateVolumesFromImageTest-1357551715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:17:36 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-5499ccae-b646-4dac-b61a-c719b7c89571 tempest-CreateVolumesFromImageTest-1357551715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:17:36 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5499ccae-b646-4dac-b61a-c719b7c89571 tempest-CreateVolumesFromImageTest-1357551715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:36 devstack sudo[92968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:17:36 devstack sudo[92968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:37 devstack sudo[92966]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:37 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-91fecd63-eb70-4674-a2fb-0b32850eefa1 tempest-VolumeDependencyTests-1826445949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd54e365-b397-4625-9a1a-c331a110f554 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cd54e365-b397-4625-9a1a-c331a110f554.b4fd5b2c-6967-4bd5-a5f4-8ea2b8d4833c" returned: 0 in 0.699s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:37 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-91fecd63-eb70-4674-a2fb-0b32850eefa1 tempest-VolumeDependencyTests-1826445949 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cd54e365-b397-4625-9a1a-c331a110f554.b4fd5b2c-6967-4bd5-a5f4-8ea2b8d4833c is being set with open permissions: ugo+rw
Apr 28 22:17:37 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-91fecd63-eb70-4674-a2fb-0b32850eefa1 tempest-VolumeDependencyTests-1826445949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cd54e365-b397-4625-9a1a-c331a110f554.b4fd5b2c-6967-4bd5-a5f4-8ea2b8d4833c {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:37 devstack sudo[92974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cd54e365-b397-4625-9a1a-c331a110f554.b4fd5b2c-6967-4bd5-a5f4-8ea2b8d4833c
Apr 28 22:17:37 devstack sudo[92974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:37 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-c186183a-9306-482a-9ec5-52d77364211d tempest-CreateVolumesFromImageTest-1357551715 None] Acquiring lock "cinder-5379392f-96a0-4a94-a520-47c1da4f4b44-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:17:37 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-c186183a-9306-482a-9ec5-52d77364211d tempest-CreateVolumesFromImageTest-1357551715 None] Lock "cinder-5379392f-96a0-4a94-a520-47c1da4f4b44-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:17:37 devstack sudo[92968]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:37 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5499ccae-b646-4dac-b61a-c719b7c89571 tempest-CreateVolumesFromImageTest-1357551715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.684s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:37 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-5499ccae-b646-4dac-b61a-c719b7c89571 tempest-CreateVolumesFromImageTest-1357551715 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:17:37 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-5499ccae-b646-4dac-b61a-c719b7c89571 tempest-CreateVolumesFromImageTest-1357551715 None] Deleted volume successfully.
Apr 28 22:17:37 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-c186183a-9306-482a-9ec5-52d77364211d tempest-CreateVolumesFromImageTest-1357551715 None] Acquiring lock "cinder-quobyte-5379392f-96a0-4a94-a520-47c1da4f4b44" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:17:37 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-5499ccae-b646-4dac-b61a-c719b7c89571 tempest-CreateVolumesFromImageTest-1357551715 None] Lock "cinder-70253ef5-a8ae-4434-a14b-a515ea038138-delete_volume" released by "delete_volume" :: held 2.377s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:17:37 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-c186183a-9306-482a-9ec5-52d77364211d tempest-CreateVolumesFromImageTest-1357551715 None] Lock "cinder-quobyte-5379392f-96a0-4a94-a520-47c1da4f4b44" acquired by "delete_volume" :: waited 0.018s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:17:37 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ea5f31-ad17-44c4-8a74-828e9be6a16e]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:17:37 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c186183a-9306-482a-9ec5-52d77364211d tempest-CreateVolumesFromImageTest-1357551715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-5379392f-96a0-4a94-a520-47c1da4f4b44 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:37 devstack sudo[92977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-5379392f-96a0-4a94-a520-47c1da4f4b44
Apr 28 22:17:37 devstack sudo[92977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:37 devstack sudo[92974]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:37 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-91fecd63-eb70-4674-a2fb-0b32850eefa1 tempest-VolumeDependencyTests-1826445949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cd54e365-b397-4625-9a1a-c331a110f554.b4fd5b2c-6967-4bd5-a5f4-8ea2b8d4833c" returned: 0 in 0.629s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:37 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-91fecd63-eb70-4674-a2fb-0b32850eefa1 tempest-VolumeDependencyTests-1826445949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cd54e365-b397-4625-9a1a-c331a110f554.info {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:37 devstack sudo[92980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cd54e365-b397-4625-9a1a-c331a110f554.info
Apr 28 22:17:37 devstack sudo[92980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:38 devstack sudo[92977]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:38 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c186183a-9306-482a-9ec5-52d77364211d tempest-CreateVolumesFromImageTest-1357551715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-5379392f-96a0-4a94-a520-47c1da4f4b44" returned: 0 in 1.016s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:38 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c186183a-9306-482a-9ec5-52d77364211d tempest-CreateVolumesFromImageTest-1357551715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-5379392f-96a0-4a94-a520-47c1da4f4b44 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:38 devstack sudo[92987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-5379392f-96a0-4a94-a520-47c1da4f4b44
Apr 28 22:17:38 devstack sudo[92987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:38 devstack sudo[92980]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:38 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-91fecd63-eb70-4674-a2fb-0b32850eefa1 tempest-VolumeDependencyTests-1826445949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cd54e365-b397-4625-9a1a-c331a110f554.info" returned: 0 in 0.773s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:38 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-91fecd63-eb70-4674-a2fb-0b32850eefa1 tempest-VolumeDependencyTests-1826445949 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cd54e365-b397-4625-9a1a-c331a110f554.info is being set with open permissions: ugo+rw
Apr 28 22:17:38 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-91fecd63-eb70-4674-a2fb-0b32850eefa1 tempest-VolumeDependencyTests-1826445949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cd54e365-b397-4625-9a1a-c331a110f554.info {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:38 devstack sudo[92989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cd54e365-b397-4625-9a1a-c331a110f554.info
Apr 28 22:17:38 devstack sudo[92989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:39 devstack sudo[92989]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-91fecd63-eb70-4674-a2fb-0b32850eefa1 tempest-VolumeDependencyTests-1826445949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cd54e365-b397-4625-9a1a-c331a110f554.info" returned: 0 in 0.634s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:39 devstack sudo[92987]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-91fecd63-eb70-4674-a2fb-0b32850eefa1 tempest-VolumeDependencyTests-1826445949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.533s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:17:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-76d742e1-a3fb-4b04-9f2f-c8874a6a0c71 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.800s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:17:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c186183a-9306-482a-9ec5-52d77364211d tempest-CreateVolumesFromImageTest-1357551715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-5379392f-96a0-4a94-a520-47c1da4f4b44" returned: 0 in 0.749s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:39 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-76d742e1-a3fb-4b04-9f2f-c8874a6a0c71 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Creating offline snapshot 619be5e7-1ec3-4662-8ae8-8fc2d83057f5 of volume b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b {{(pid=83924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 22:17:39 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-c186183a-9306-482a-9ec5-52d77364211d tempest-CreateVolumesFromImageTest-1357551715 None] Lock "cinder-quobyte-5379392f-96a0-4a94-a520-47c1da4f4b44" released by "delete_volume" :: held 1.827s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:17:39 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33b0fe7-2755-4ef3-a613-86021de9376e]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:17:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-76d742e1-a3fb-4b04-9f2f-c8874a6a0c71 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:39 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-91fecd63-eb70-4674-a2fb-0b32850eefa1 tempest-VolumeDependencyTests-1826445949 None] Create snapshot completed successfully
Apr 28 22:17:39 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-c186183a-9306-482a-9ec5-52d77364211d tempest-CreateVolumesFromImageTest-1357551715 None] Created reservations ['5ba0ddf0-0bfa-4250-ab48-aca57ae19ca9', '14e3f957-a699-4df2-8e81-0d0d5b127907', 'eb8cab6f-5d00-4fa3-9729-854853325700', 'aed60e51-edbe-4f43-a346-3eee9cbc7fc5'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:17:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-c186183a-9306-482a-9ec5-52d77364211d tempest-CreateVolumesFromImageTest-1357551715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:17:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-c186183a-9306-482a-9ec5-52d77364211d tempest-CreateVolumesFromImageTest-1357551715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:17:39 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-c186183a-9306-482a-9ec5-52d77364211d tempest-CreateVolumesFromImageTest-1357551715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:17:39 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-c186183a-9306-482a-9ec5-52d77364211d tempest-CreateVolumesFromImageTest-1357551715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:17:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-c186183a-9306-482a-9ec5-52d77364211d tempest-CreateVolumesFromImageTest-1357551715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:17:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c186183a-9306-482a-9ec5-52d77364211d tempest-CreateVolumesFromImageTest-1357551715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:39 devstack sudo[92993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b
Apr 28 22:17:39 devstack sudo[92993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:39 devstack sudo[92994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:17:39 devstack sudo[92994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:39 devstack cinder-volume[83924]: DEBUG oslo_service.periodic_task [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83924) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 28 22:17:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:17:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:17:39 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:17:39 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:17:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:17:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:39 devstack sudo[92997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:17:39 devstack sudo[92997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:39 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-464a2250-48ad-4309-b9e6-de88709e8c66 tempest-CreateVolumesFromImageTest-1357551715 None] Acquiring lock "cinder-edee61d4-e5aa-4624-8ded-7c824fcbca53-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:17:39 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-464a2250-48ad-4309-b9e6-de88709e8c66 tempest-CreateVolumesFromImageTest-1357551715 None] Lock "cinder-edee61d4-e5aa-4624-8ded-7c824fcbca53-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:17:39 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-464a2250-48ad-4309-b9e6-de88709e8c66 tempest-CreateVolumesFromImageTest-1357551715 None] Acquiring lock "cinder-quobyte-edee61d4-e5aa-4624-8ded-7c824fcbca53" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:17:39 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-464a2250-48ad-4309-b9e6-de88709e8c66 tempest-CreateVolumesFromImageTest-1357551715 None] Lock "cinder-quobyte-edee61d4-e5aa-4624-8ded-7c824fcbca53" acquired by "delete_volume" :: waited 0.025s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:17:40 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[576cdfd8-7e8f-4772-8ab7-8edb6744a2f9]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:17:40 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-464a2250-48ad-4309-b9e6-de88709e8c66 tempest-CreateVolumesFromImageTest-1357551715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-edee61d4-e5aa-4624-8ded-7c824fcbca53 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:40 devstack sudo[92999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-edee61d4-e5aa-4624-8ded-7c824fcbca53
Apr 28 22:17:40 devstack sudo[92999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:40 devstack sudo[92993]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:40 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-76d742e1-a3fb-4b04-9f2f-c8874a6a0c71 tempest-CreateVolumesFromSnapshotTest-1887340981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b" returned: 0 in 1.083s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:40 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-76d742e1-a3fb-4b04-9f2f-c8874a6a0c71 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b.619be5e7-1ec3-4662-8ae8-8fc2d83057f5 1G {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:40 devstack sudo[92994]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:40 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c186183a-9306-482a-9ec5-52d77364211d tempest-CreateVolumesFromImageTest-1357551715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.977s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:40 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-c186183a-9306-482a-9ec5-52d77364211d tempest-CreateVolumesFromImageTest-1357551715 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:17:40 devstack sudo[93007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b.619be5e7-1ec3-4662-8ae8-8fc2d83057f5 1G
Apr 28 22:17:40 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-c186183a-9306-482a-9ec5-52d77364211d tempest-CreateVolumesFromImageTest-1357551715 None] Deleted volume successfully.
Apr 28 22:17:40 devstack sudo[93007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:40 devstack sudo[92997]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:40 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.890s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:40 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:17:40 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-c186183a-9306-482a-9ec5-52d77364211d tempest-CreateVolumesFromImageTest-1357551715 None] Lock "cinder-5379392f-96a0-4a94-a520-47c1da4f4b44-delete_volume" released by "delete_volume" :: held 3.115s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:17:40 devstack sudo[92999]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:40 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-464a2250-48ad-4309-b9e6-de88709e8c66 tempest-CreateVolumesFromImageTest-1357551715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-edee61d4-e5aa-4624-8ded-7c824fcbca53" returned: 0 in 0.902s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:40 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-464a2250-48ad-4309-b9e6-de88709e8c66 tempest-CreateVolumesFromImageTest-1357551715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-edee61d4-e5aa-4624-8ded-7c824fcbca53 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:40 devstack sudo[93012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-edee61d4-e5aa-4624-8ded-7c824fcbca53
Apr 28 22:17:40 devstack sudo[93012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:41 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-73c64b5f-7449-440b-b734-0f5b649b6aa3 tempest-VolumeDependencyTests-1826445949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:17:41 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-73c64b5f-7449-440b-b734-0f5b649b6aa3 tempest-VolumeDependencyTests-1826445949 None] Flow 'volume_create_manager' (f7d7e02f-433e-4b2b-a792-5a8cc8ca7957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:17:41 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-73c64b5f-7449-440b-b734-0f5b649b6aa3 tempest-VolumeDependencyTests-1826445949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (832312a8-c652-43fb-8fb3-fd3324cc35a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:41 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-73c64b5f-7449-440b-b734-0f5b649b6aa3 tempest-VolumeDependencyTests-1826445949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (832312a8-c652-43fb-8fb3-fd3324cc35a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:17:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1669521651',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15fd5642-02a9-4f15-a052-b6159a068a24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0a8cf6e955c4797a45097f8aba2542e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:17:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b4fd5b2c-6967-4bd5-a5f4-8ea2b8d4833c,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:17:41Z,use_quota=True,user_id='8d0c1e1ebfa748e2b733fb77632a8e6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:41 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-73c64b5f-7449-440b-b734-0f5b649b6aa3 tempest-VolumeDependencyTests-1826445949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ead8a1fc-5037-4f01-8b22-18e5c935838a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:41 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-73c64b5f-7449-440b-b734-0f5b649b6aa3 tempest-VolumeDependencyTests-1826445949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ead8a1fc-5037-4f01-8b22-18e5c935838a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:41 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-73c64b5f-7449-440b-b734-0f5b649b6aa3 tempest-VolumeDependencyTests-1826445949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc63eb3b-b4c3-46bc-b5b7-d78ef54c0457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:41 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-73c64b5f-7449-440b-b734-0f5b649b6aa3 tempest-VolumeDependencyTests-1826445949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc63eb3b-b4c3-46bc-b5b7-d78ef54c0457) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '15fd5642-02a9-4f15-a052-b6159a068a24', 'volume_name': 'volume-15fd5642-02a9-4f15-a052-b6159a068a24', 'volume_size': 1, 'snapshot_id': 'b4fd5b2c-6967-4bd5-a5f4-8ea2b8d4833c'}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:41 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-73c64b5f-7449-440b-b734-0f5b649b6aa3 tempest-VolumeDependencyTests-1826445949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18c83863-0fb9-4e9d-a0dd-7d4c358d2f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:41 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-73c64b5f-7449-440b-b734-0f5b649b6aa3 tempest-VolumeDependencyTests-1826445949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18c83863-0fb9-4e9d-a0dd-7d4c358d2f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:41 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-73c64b5f-7449-440b-b734-0f5b649b6aa3 tempest-VolumeDependencyTests-1826445949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed6a4059-9af2-4832-9547-368a6718e12f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:41 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-73c64b5f-7449-440b-b734-0f5b649b6aa3 tempest-VolumeDependencyTests-1826445949 None] Volume 15fd5642-02a9-4f15-a052-b6159a068a24: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-15fd5642-02a9-4f15-a052-b6159a068a24', 'volume_size': 1, 'snapshot_id': 'b4fd5b2c-6967-4bd5-a5f4-8ea2b8d4833c'}
Apr 28 22:17:41 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-73c64b5f-7449-440b-b734-0f5b649b6aa3 tempest-VolumeDependencyTests-1826445949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:17:41 devstack sudo[93007]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:41 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-76d742e1-a3fb-4b04-9f2f-c8874a6a0c71 tempest-CreateVolumesFromSnapshotTest-1887340981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b.619be5e7-1ec3-4662-8ae8-8fc2d83057f5 1G" returned: 0 in 1.067s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:41 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-76d742e1-a3fb-4b04-9f2f-c8874a6a0c71 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b.619be5e7-1ec3-4662-8ae8-8fc2d83057f5 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:41 devstack sudo[93018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b.619be5e7-1ec3-4662-8ae8-8fc2d83057f5
Apr 28 22:17:41 devstack sudo[93018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:41 devstack sudo[93012]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:41 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-464a2250-48ad-4309-b9e6-de88709e8c66 tempest-CreateVolumesFromImageTest-1357551715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-edee61d4-e5aa-4624-8ded-7c824fcbca53" returned: 0 in 0.814s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:41 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-464a2250-48ad-4309-b9e6-de88709e8c66 tempest-CreateVolumesFromImageTest-1357551715 None] Lock "cinder-quobyte-edee61d4-e5aa-4624-8ded-7c824fcbca53" released by "delete_volume" :: held 1.784s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:17:41 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-464a2250-48ad-4309-b9e6-de88709e8c66 tempest-CreateVolumesFromImageTest-1357551715 None] Created reservations ['7e4b8460-4b0d-4ab7-9299-aa2f31bed437', '642dc3f6-54ce-46a0-a6b4-7dadd8b3128e', 'fc968302-b8aa-40d7-b9ea-db1d733d88b8', '92d5efc3-dfb3-4063-8c1c-20feabee7bc6'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:17:41 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-464a2250-48ad-4309-b9e6-de88709e8c66 tempest-CreateVolumesFromImageTest-1357551715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:17:41 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-464a2250-48ad-4309-b9e6-de88709e8c66 tempest-CreateVolumesFromImageTest-1357551715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:17:41 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-464a2250-48ad-4309-b9e6-de88709e8c66 tempest-CreateVolumesFromImageTest-1357551715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:17:41 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-464a2250-48ad-4309-b9e6-de88709e8c66 tempest-CreateVolumesFromImageTest-1357551715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:17:41 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-464a2250-48ad-4309-b9e6-de88709e8c66 tempest-CreateVolumesFromImageTest-1357551715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:17:41 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-464a2250-48ad-4309-b9e6-de88709e8c66 tempest-CreateVolumesFromImageTest-1357551715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:41 devstack sudo[93021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:17:41 devstack sudo[93021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:42 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-4943e897-fb6c-4011-9803-c4fddd87583d tempest-CreateVolumesFromImageTest-1357551715 None] Acquiring lock "cinder-30f95dbb-07f6-42c2-8d89-d98bce6e158b-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:17:42 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-4943e897-fb6c-4011-9803-c4fddd87583d tempest-CreateVolumesFromImageTest-1357551715 None] Lock "cinder-30f95dbb-07f6-42c2-8d89-d98bce6e158b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:17:42 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-4943e897-fb6c-4011-9803-c4fddd87583d tempest-CreateVolumesFromImageTest-1357551715 None] Acquiring lock "cinder-quobyte-30f95dbb-07f6-42c2-8d89-d98bce6e158b" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:17:42 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-4943e897-fb6c-4011-9803-c4fddd87583d tempest-CreateVolumesFromImageTest-1357551715 None] Lock "cinder-quobyte-30f95dbb-07f6-42c2-8d89-d98bce6e158b" acquired by "delete_volume" :: waited 0.016s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:17:42 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba83498-9f9f-4bfe-adf0-69edc4712650]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:17:42 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4943e897-fb6c-4011-9803-c4fddd87583d tempest-CreateVolumesFromImageTest-1357551715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-30f95dbb-07f6-42c2-8d89-d98bce6e158b {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:42 devstack sudo[93018]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:42 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-76d742e1-a3fb-4b04-9f2f-c8874a6a0c71 tempest-CreateVolumesFromSnapshotTest-1887340981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b.619be5e7-1ec3-4662-8ae8-8fc2d83057f5" returned: 0 in 0.817s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:42 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-76d742e1-a3fb-4b04-9f2f-c8874a6a0c71 tempest-CreateVolumesFromSnapshotTest-1887340981 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b.619be5e7-1ec3-4662-8ae8-8fc2d83057f5 is being set with open permissions: ugo+rw
Apr 28 22:17:42 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-76d742e1-a3fb-4b04-9f2f-c8874a6a0c71 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b.619be5e7-1ec3-4662-8ae8-8fc2d83057f5 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:42 devstack sudo[93026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-30f95dbb-07f6-42c2-8d89-d98bce6e158b
Apr 28 22:17:42 devstack sudo[93026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:42 devstack sudo[93027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b.619be5e7-1ec3-4662-8ae8-8fc2d83057f5
Apr 28 22:17:42 devstack sudo[93027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:42 devstack sudo[93021]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:42 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-464a2250-48ad-4309-b9e6-de88709e8c66 tempest-CreateVolumesFromImageTest-1357551715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.757s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:42 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-464a2250-48ad-4309-b9e6-de88709e8c66 tempest-CreateVolumesFromImageTest-1357551715 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:17:42 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-464a2250-48ad-4309-b9e6-de88709e8c66 tempest-CreateVolumesFromImageTest-1357551715 None] Deleted volume successfully.
Apr 28 22:17:42 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-464a2250-48ad-4309-b9e6-de88709e8c66 tempest-CreateVolumesFromImageTest-1357551715 None] Lock "cinder-edee61d4-e5aa-4624-8ded-7c824fcbca53-delete_volume" released by "delete_volume" :: held 2.838s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:17:43 devstack sudo[93026]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:43 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4943e897-fb6c-4011-9803-c4fddd87583d tempest-CreateVolumesFromImageTest-1357551715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-30f95dbb-07f6-42c2-8d89-d98bce6e158b" returned: 0 in 0.719s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:43 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4943e897-fb6c-4011-9803-c4fddd87583d tempest-CreateVolumesFromImageTest-1357551715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-30f95dbb-07f6-42c2-8d89-d98bce6e158b {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:43 devstack sudo[93035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-30f95dbb-07f6-42c2-8d89-d98bce6e158b
Apr 28 22:17:43 devstack sudo[93035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:43 devstack sudo[93027]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:43 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-76d742e1-a3fb-4b04-9f2f-c8874a6a0c71 tempest-CreateVolumesFromSnapshotTest-1887340981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b.619be5e7-1ec3-4662-8ae8-8fc2d83057f5" returned: 0 in 0.696s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:43 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-76d742e1-a3fb-4b04-9f2f-c8874a6a0c71 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b.info {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:43 devstack sudo[93037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b.info
Apr 28 22:17:43 devstack sudo[93037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:43 devstack sudo[93035]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:43 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4943e897-fb6c-4011-9803-c4fddd87583d tempest-CreateVolumesFromImageTest-1357551715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-30f95dbb-07f6-42c2-8d89-d98bce6e158b" returned: 0 in 0.670s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:43 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-4943e897-fb6c-4011-9803-c4fddd87583d tempest-CreateVolumesFromImageTest-1357551715 None] Lock "cinder-quobyte-30f95dbb-07f6-42c2-8d89-d98bce6e158b" released by "delete_volume" :: held 1.458s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:17:43 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-4943e897-fb6c-4011-9803-c4fddd87583d tempest-CreateVolumesFromImageTest-1357551715 None] Created reservations ['e93299f4-15f3-4bb7-a141-9488b8e306b0', '9d03b358-05c5-4b3d-9414-13edf970ce56', 'cca285af-80ad-435a-9343-acf2c134c201', '5474a49f-abff-4f64-9e9f-daf0bc449987'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:17:43 devstack sudo[93037]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:43 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-76d742e1-a3fb-4b04-9f2f-c8874a6a0c71 tempest-CreateVolumesFromSnapshotTest-1887340981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b.info" returned: 0 in 0.737s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:43 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-76d742e1-a3fb-4b04-9f2f-c8874a6a0c71 tempest-CreateVolumesFromSnapshotTest-1887340981 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b.info is being set with open permissions: ugo+rw
Apr 28 22:17:43 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-76d742e1-a3fb-4b04-9f2f-c8874a6a0c71 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b.info {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:43 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-4943e897-fb6c-4011-9803-c4fddd87583d tempest-CreateVolumesFromImageTest-1357551715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:17:43 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-4943e897-fb6c-4011-9803-c4fddd87583d tempest-CreateVolumesFromImageTest-1357551715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:17:43 devstack sudo[93042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b.info
Apr 28 22:17:43 devstack sudo[93042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:43 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-4943e897-fb6c-4011-9803-c4fddd87583d tempest-CreateVolumesFromImageTest-1357551715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:17:43 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-4943e897-fb6c-4011-9803-c4fddd87583d tempest-CreateVolumesFromImageTest-1357551715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:17:43 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-4943e897-fb6c-4011-9803-c4fddd87583d tempest-CreateVolumesFromImageTest-1357551715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:17:43 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4943e897-fb6c-4011-9803-c4fddd87583d tempest-CreateVolumesFromImageTest-1357551715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:43 devstack sudo[93044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:17:43 devstack sudo[93044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:44 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-c0e258c0-35ab-4663-8896-e6efcd494e40 tempest-CreateVolumesFromImageTest-1357551715 None] Acquiring lock "cinder-0514471e-48c7-45c8-8657-a5c6de954165-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:17:44 devstack sudo[93042]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:44 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-76d742e1-a3fb-4b04-9f2f-c8874a6a0c71 tempest-CreateVolumesFromSnapshotTest-1887340981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b.info" returned: 0 in 0.718s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:44 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-76d742e1-a3fb-4b04-9f2f-c8874a6a0c71 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.242s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:17:44 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-73c64b5f-7449-440b-b734-0f5b649b6aa3 tempest-VolumeDependencyTests-1826445949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.275s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:17:44 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-73c64b5f-7449-440b-b734-0f5b649b6aa3 tempest-VolumeDependencyTests-1826445949 None] Acquiring lock "cinder-quobyte-b4fd5b2c-6967-4bd5-a5f4-8ea2b8d4833c-15fd5642-02a9-4f15-a052-b6159a068a24" by "_create_volume_from_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:17:44 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-c0e258c0-35ab-4663-8896-e6efcd494e40 tempest-CreateVolumesFromImageTest-1357551715 None] Lock "cinder-0514471e-48c7-45c8-8657-a5c6de954165-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:17:44 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-73c64b5f-7449-440b-b734-0f5b649b6aa3 tempest-VolumeDependencyTests-1826445949 None] Lock "cinder-quobyte-b4fd5b2c-6967-4bd5-a5f4-8ea2b8d4833c-15fd5642-02a9-4f15-a052-b6159a068a24" acquired by "_create_volume_from_snapshot" :: waited 0.054s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:17:44 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-73c64b5f-7449-440b-b734-0f5b649b6aa3 tempest-VolumeDependencyTests-1826445949 None] Creating volume 15fd5642-02a9-4f15-a052-b6159a068a24 from snapshot b4fd5b2c-6967-4bd5-a5f4-8ea2b8d4833c {{(pid=83924) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 28 22:17:44 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-73c64b5f-7449-440b-b734-0f5b649b6aa3 tempest-VolumeDependencyTests-1826445949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:17:44 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-73c64b5f-7449-440b-b734-0f5b649b6aa3 tempest-VolumeDependencyTests-1826445949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:17:44 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-73c64b5f-7449-440b-b734-0f5b649b6aa3 tempest-VolumeDependencyTests-1826445949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:17:44 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-73c64b5f-7449-440b-b734-0f5b649b6aa3 tempest-VolumeDependencyTests-1826445949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:17:44 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-73c64b5f-7449-440b-b734-0f5b649b6aa3 tempest-VolumeDependencyTests-1826445949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:17:44 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-73c64b5f-7449-440b-b734-0f5b649b6aa3 tempest-VolumeDependencyTests-1826445949 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:17:44 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-73c64b5f-7449-440b-b734-0f5b649b6aa3 tempest-VolumeDependencyTests-1826445949 None] Acquiring lock "cinder-quobyte-15fd5642-02a9-4f15-a052-b6159a068a24" by "_copy_volume_from_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:17:44 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-76d742e1-a3fb-4b04-9f2f-c8874a6a0c71 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Create snapshot completed successfully
Apr 28 22:17:44 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-73c64b5f-7449-440b-b734-0f5b649b6aa3 tempest-VolumeDependencyTests-1826445949 None] Lock "cinder-quobyte-15fd5642-02a9-4f15-a052-b6159a068a24" acquired by "_copy_volume_from_snapshot" :: waited 0.103s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:17:44 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-73c64b5f-7449-440b-b734-0f5b649b6aa3 tempest-VolumeDependencyTests-1826445949 None] snapshot: b4fd5b2c-6967-4bd5-a5f4-8ea2b8d4833c, volume: 15fd5642-02a9-4f15-a052-b6159a068a24,  {{(pid=83924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 28 22:17:44 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-73c64b5f-7449-440b-b734-0f5b649b6aa3 tempest-VolumeDependencyTests-1826445949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:17:44 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-73c64b5f-7449-440b-b734-0f5b649b6aa3 tempest-VolumeDependencyTests-1826445949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:17:44 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-73c64b5f-7449-440b-b734-0f5b649b6aa3 tempest-VolumeDependencyTests-1826445949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:17:44 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-73c64b5f-7449-440b-b734-0f5b649b6aa3 tempest-VolumeDependencyTests-1826445949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:17:44 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-73c64b5f-7449-440b-b734-0f5b649b6aa3 tempest-VolumeDependencyTests-1826445949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:17:44 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-c0e258c0-35ab-4663-8896-e6efcd494e40 tempest-CreateVolumesFromImageTest-1357551715 None] Acquiring lock "cinder-quobyte-0514471e-48c7-45c8-8657-a5c6de954165" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:17:44 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[8350e68c-a2a1-4c94-ba31-51649b6ea0c1]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:17:44 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-73c64b5f-7449-440b-b734-0f5b649b6aa3 tempest-VolumeDependencyTests-1826445949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cd54e365-b397-4625-9a1a-c331a110f554.b4fd5b2c-6967-4bd5-a5f4-8ea2b8d4833c {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:44 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-c0e258c0-35ab-4663-8896-e6efcd494e40 tempest-CreateVolumesFromImageTest-1357551715 None] Lock "cinder-quobyte-0514471e-48c7-45c8-8657-a5c6de954165" acquired by "delete_volume" :: waited 0.033s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:17:44 devstack sudo[93044]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:44 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4943e897-fb6c-4011-9803-c4fddd87583d tempest-CreateVolumesFromImageTest-1357551715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.988s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:44 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-4943e897-fb6c-4011-9803-c4fddd87583d tempest-CreateVolumesFromImageTest-1357551715 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:17:44 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-4943e897-fb6c-4011-9803-c4fddd87583d tempest-CreateVolumesFromImageTest-1357551715 None] Deleted volume successfully.
Apr 28 22:17:44 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa40a155-ac4a-4aef-b5e6-2f8bc74521e8]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:17:44 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c0e258c0-35ab-4663-8896-e6efcd494e40 tempest-CreateVolumesFromImageTest-1357551715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-0514471e-48c7-45c8-8657-a5c6de954165 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:44 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-4943e897-fb6c-4011-9803-c4fddd87583d tempest-CreateVolumesFromImageTest-1357551715 None] Lock "cinder-30f95dbb-07f6-42c2-8d89-d98bce6e158b-delete_volume" released by "delete_volume" :: held 2.773s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:17:45 devstack sudo[93048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cd54e365-b397-4625-9a1a-c331a110f554.b4fd5b2c-6967-4bd5-a5f4-8ea2b8d4833c
Apr 28 22:17:45 devstack sudo[93048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:45 devstack sudo[93049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-0514471e-48c7-45c8-8657-a5c6de954165
Apr 28 22:17:45 devstack sudo[93049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:45 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-1852fb41-5623-4e3d-b728-35104913564d tempest-CreateVolumesFromSnapshotTest-1887340981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:17:45 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-1852fb41-5623-4e3d-b728-35104913564d tempest-CreateVolumesFromSnapshotTest-1887340981 None] Flow 'volume_create_manager' (cd1e5119-2bed-4fb9-82ea-4820996cd4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:17:45 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-1852fb41-5623-4e3d-b728-35104913564d tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3707593-63ce-4fdc-9761-3d8535febeea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:45 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-1852fb41-5623-4e3d-b728-35104913564d tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3707593-63ce-4fdc-9761-3d8535febeea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:17:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-585568013',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcf4d76d-4aae-4420-b048-579a08017922,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='609f6249a87f4b5eb1ea4978d34fdb2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:17:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:17:46Z,use_quota=True,user_id='ab1cae9809144a3f925f6115d5ac18d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:45 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-1852fb41-5623-4e3d-b728-35104913564d tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa9e6aaf-655c-45eb-ae91-651edd35d881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:45 devstack sudo[93049]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:45 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-1852fb41-5623-4e3d-b728-35104913564d tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa9e6aaf-655c-45eb-ae91-651edd35d881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:45 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-1852fb41-5623-4e3d-b728-35104913564d tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99717fee-176e-467f-bd37-3434b8ae26eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:45 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-1852fb41-5623-4e3d-b728-35104913564d tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99717fee-176e-467f-bd37-3434b8ae26eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcf4d76d-4aae-4420-b048-579a08017922', 'volume_name': 'volume-dcf4d76d-4aae-4420-b048-579a08017922', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:45 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-1852fb41-5623-4e3d-b728-35104913564d tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51275165-d591-400a-841f-513b216c519d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:45 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-1852fb41-5623-4e3d-b728-35104913564d tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51275165-d591-400a-841f-513b216c519d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:45 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-1852fb41-5623-4e3d-b728-35104913564d tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f68cbad2-3754-4a88-8f54-00b6fc2ac24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:45 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-1852fb41-5623-4e3d-b728-35104913564d tempest-CreateVolumesFromSnapshotTest-1887340981 None] Volume dcf4d76d-4aae-4420-b048-579a08017922: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcf4d76d-4aae-4420-b048-579a08017922', 'volume_size': 1}
Apr 28 22:17:45 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-1852fb41-5623-4e3d-b728-35104913564d tempest-CreateVolumesFromSnapshotTest-1887340981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:17:45 devstack sudo[93048]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:45 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c0e258c0-35ab-4663-8896-e6efcd494e40 tempest-CreateVolumesFromImageTest-1357551715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-0514471e-48c7-45c8-8657-a5c6de954165" returned: 0 in 1.019s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:45 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c0e258c0-35ab-4663-8896-e6efcd494e40 tempest-CreateVolumesFromImageTest-1357551715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-0514471e-48c7-45c8-8657-a5c6de954165 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:45 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-73c64b5f-7449-440b-b734-0f5b649b6aa3 tempest-VolumeDependencyTests-1826445949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cd54e365-b397-4625-9a1a-c331a110f554.b4fd5b2c-6967-4bd5-a5f4-8ea2b8d4833c" returned: 0 in 1.136s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:45 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-73c64b5f-7449-440b-b734-0f5b649b6aa3 tempest-VolumeDependencyTests-1826445949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd54e365-b397-4625-9a1a-c331a110f554(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 22:17:45 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-73c64b5f-7449-440b-b734-0f5b649b6aa3 tempest-VolumeDependencyTests-1826445949 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cd54e365-b397-4625-9a1a-c331a110f554 {{(pid=83924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 28 22:17:46 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-73c64b5f-7449-440b-b734-0f5b649b6aa3 tempest-VolumeDependencyTests-1826445949 None] Creating direct copy from snapshot {{(pid=83924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 28 22:17:46 devstack sudo[93058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-0514471e-48c7-45c8-8657-a5c6de954165
Apr 28 22:17:46 devstack sudo[93058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:46 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0016b576-98bc-4994-990b-8e72faf1d932]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:17:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-73c64b5f-7449-440b-b734-0f5b649b6aa3 tempest-VolumeDependencyTests-1826445949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cd54e365-b397-4625-9a1a-c331a110f554 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:46 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-06f7b36d-479b-4754-a4d9-5f8d53d61f76 tempest-SnapshotDependencyTests-1655070008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:17:46 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-06f7b36d-479b-4754-a4d9-5f8d53d61f76 tempest-SnapshotDependencyTests-1655070008 None] Flow 'volume_create_manager' (e7daae7d-c0a9-4fd0-a078-c908ac52b94f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:17:46 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-06f7b36d-479b-4754-a4d9-5f8d53d61f76 tempest-SnapshotDependencyTests-1655070008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1946fc3e-8942-4df3-9cce-37dae5de326b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:46 devstack sudo[93060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cd54e365-b397-4625-9a1a-c331a110f554
Apr 28 22:17:46 devstack sudo[93060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:46 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-06f7b36d-479b-4754-a4d9-5f8d53d61f76 tempest-SnapshotDependencyTests-1655070008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1946fc3e-8942-4df3-9cce-37dae5de326b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:17:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1527722530',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=123a3412-28f5-42ca-9424-50f31049250d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89e9a04687ff4a78be01c3f97445761b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:17:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:17:46Z,use_quota=True,user_id='ee59c99401914f22a5a8072c96203521',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:46 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-06f7b36d-479b-4754-a4d9-5f8d53d61f76 tempest-SnapshotDependencyTests-1655070008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bf6a562-d2b4-4e8e-9303-0f87cf7a0320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:46 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-06f7b36d-479b-4754-a4d9-5f8d53d61f76 tempest-SnapshotDependencyTests-1655070008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bf6a562-d2b4-4e8e-9303-0f87cf7a0320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:46 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-06f7b36d-479b-4754-a4d9-5f8d53d61f76 tempest-SnapshotDependencyTests-1655070008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (717e4da6-9531-4fe4-9da5-c3f426cd0995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:46 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-06f7b36d-479b-4754-a4d9-5f8d53d61f76 tempest-SnapshotDependencyTests-1655070008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (717e4da6-9531-4fe4-9da5-c3f426cd0995) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '123a3412-28f5-42ca-9424-50f31049250d', 'volume_name': 'volume-123a3412-28f5-42ca-9424-50f31049250d', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:46 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-06f7b36d-479b-4754-a4d9-5f8d53d61f76 tempest-SnapshotDependencyTests-1655070008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a815d7bf-b498-4901-b0ba-86105545baf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:46 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-06f7b36d-479b-4754-a4d9-5f8d53d61f76 tempest-SnapshotDependencyTests-1655070008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a815d7bf-b498-4901-b0ba-86105545baf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:46 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-06f7b36d-479b-4754-a4d9-5f8d53d61f76 tempest-SnapshotDependencyTests-1655070008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2e0ee63-1cc2-437e-b1f4-af0016cfd536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:46 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-06f7b36d-479b-4754-a4d9-5f8d53d61f76 tempest-SnapshotDependencyTests-1655070008 None] Volume 123a3412-28f5-42ca-9424-50f31049250d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-123a3412-28f5-42ca-9424-50f31049250d', 'volume_size': 1}
Apr 28 22:17:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-06f7b36d-479b-4754-a4d9-5f8d53d61f76 tempest-SnapshotDependencyTests-1655070008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:17:46 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-c986acc4-0738-4902-a9eb-152277981c33 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:17:46 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-c986acc4-0738-4902-a9eb-152277981c33 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Flow 'volume_create_manager' (76eef5f4-1dc0-4cc6-8dc1-9bac38c23128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:17:46 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-c986acc4-0738-4902-a9eb-152277981c33 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04f1713a-63e0-4378-ba44-fe3a94fa73a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:46 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-c986acc4-0738-4902-a9eb-152277981c33 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04f1713a-63e0-4378-ba44-fe3a94fa73a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:17:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-478124895',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=017e4c2c-4a63-425e-ab6c-c25b1234845e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='609f6249a87f4b5eb1ea4978d34fdb2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:17:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:17:46Z,use_quota=True,user_id='ab1cae9809144a3f925f6115d5ac18d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:46 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-c986acc4-0738-4902-a9eb-152277981c33 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baf4b180-4bc8-470f-b907-10856cb23161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:46 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-c986acc4-0738-4902-a9eb-152277981c33 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baf4b180-4bc8-470f-b907-10856cb23161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:46 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-c986acc4-0738-4902-a9eb-152277981c33 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e5fd988-2f1e-4749-842e-94657221defe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:46 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-c986acc4-0738-4902-a9eb-152277981c33 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e5fd988-2f1e-4749-842e-94657221defe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '017e4c2c-4a63-425e-ab6c-c25b1234845e', 'volume_name': 'volume-017e4c2c-4a63-425e-ab6c-c25b1234845e', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:46 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-c986acc4-0738-4902-a9eb-152277981c33 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f24c3614-66d1-49ca-b3a9-cb40a39b8d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:46 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-c986acc4-0738-4902-a9eb-152277981c33 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f24c3614-66d1-49ca-b3a9-cb40a39b8d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:46 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-c986acc4-0738-4902-a9eb-152277981c33 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d53c808-afcf-4d4f-ba81-40de1b2875fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:46 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-c986acc4-0738-4902-a9eb-152277981c33 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Volume 017e4c2c-4a63-425e-ab6c-c25b1234845e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-017e4c2c-4a63-425e-ab6c-c25b1234845e', 'volume_size': 1}
Apr 28 22:17:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-c986acc4-0738-4902-a9eb-152277981c33 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:17:46 devstack sudo[93058]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c0e258c0-35ab-4663-8896-e6efcd494e40 tempest-CreateVolumesFromImageTest-1357551715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-0514471e-48c7-45c8-8657-a5c6de954165" returned: 0 in 0.742s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:46 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-c0e258c0-35ab-4663-8896-e6efcd494e40 tempest-CreateVolumesFromImageTest-1357551715 None] Lock "cinder-quobyte-0514471e-48c7-45c8-8657-a5c6de954165" released by "delete_volume" :: held 1.869s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:17:46 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-c0e258c0-35ab-4663-8896-e6efcd494e40 tempest-CreateVolumesFromImageTest-1357551715 None] Created reservations ['aef14824-8a17-465b-81e8-7d89e5296d5c', '57150d92-bc0b-4314-adbc-612ff0fefd83', '6db6a218-7764-4b6e-9652-074151a6e7ae', '83683659-bdff-4802-94b9-ba5956825f48'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:17:46 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb835d52-c1cd-4c31-9fb1-1d34f5c9c053 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:17:46 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-eb835d52-c1cd-4c31-9fb1-1d34f5c9c053 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Flow 'volume_create_manager' (b04c5d7c-a2a6-429b-b708-2415bfd10893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:17:46 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-eb835d52-c1cd-4c31-9fb1-1d34f5c9c053 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f679b439-d225-494a-813a-8f028d371f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:46 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-eb835d52-c1cd-4c31-9fb1-1d34f5c9c053 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f679b439-d225-494a-813a-8f028d371f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:17:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-896701638',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f755e5f-329b-46c3-bb71-0968006471b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='609f6249a87f4b5eb1ea4978d34fdb2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:17:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:17:47Z,use_quota=True,user_id='ab1cae9809144a3f925f6115d5ac18d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:46 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-eb835d52-c1cd-4c31-9fb1-1d34f5c9c053 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb57c07a-4805-47db-8bb9-732479d9b825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:46 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-eb835d52-c1cd-4c31-9fb1-1d34f5c9c053 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb57c07a-4805-47db-8bb9-732479d9b825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:46 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-eb835d52-c1cd-4c31-9fb1-1d34f5c9c053 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ef36269-fc77-480a-8f98-12c2b71dc6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:46 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-eb835d52-c1cd-4c31-9fb1-1d34f5c9c053 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ef36269-fc77-480a-8f98-12c2b71dc6d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f755e5f-329b-46c3-bb71-0968006471b7', 'volume_name': 'volume-8f755e5f-329b-46c3-bb71-0968006471b7', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:46 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-eb835d52-c1cd-4c31-9fb1-1d34f5c9c053 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8e57da3-fa4e-402a-b82e-c6b07d601712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:46 devstack sudo[93060]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:46 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-eb835d52-c1cd-4c31-9fb1-1d34f5c9c053 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8e57da3-fa4e-402a-b82e-c6b07d601712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:46 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-eb835d52-c1cd-4c31-9fb1-1d34f5c9c053 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d4c5846-52c2-425a-bd7f-7c6cdc6d0496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:46 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-eb835d52-c1cd-4c31-9fb1-1d34f5c9c053 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Volume 8f755e5f-329b-46c3-bb71-0968006471b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f755e5f-329b-46c3-bb71-0968006471b7', 'volume_size': 1}
Apr 28 22:17:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-eb835d52-c1cd-4c31-9fb1-1d34f5c9c053 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:17:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-73c64b5f-7449-440b-b734-0f5b649b6aa3 tempest-VolumeDependencyTests-1826445949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cd54e365-b397-4625-9a1a-c331a110f554" returned: 0 in 0.912s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:46 devstack cinder-volume[83924]: DEBUG cinder.utils [None req-73c64b5f-7449-440b-b734-0f5b649b6aa3 tempest-VolumeDependencyTests-1826445949 None] Path /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-15fd5642-02a9-4f15-a052-b6159a068a24 not found in is_blk_device check {{(pid=83924) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 28 22:17:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-73c64b5f-7449-440b-b734-0f5b649b6aa3 tempest-VolumeDependencyTests-1826445949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cd54e365-b397-4625-9a1a-c331a110f554 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-15fd5642-02a9-4f15-a052-b6159a068a24 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:46 devstack sudo[93066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cd54e365-b397-4625-9a1a-c331a110f554 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-15fd5642-02a9-4f15-a052-b6159a068a24
Apr 28 22:17:46 devstack sudo[93066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-c0e258c0-35ab-4663-8896-e6efcd494e40 tempest-CreateVolumesFromImageTest-1357551715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:17:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-c0e258c0-35ab-4663-8896-e6efcd494e40 tempest-CreateVolumesFromImageTest-1357551715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:17:47 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-c0e258c0-35ab-4663-8896-e6efcd494e40 tempest-CreateVolumesFromImageTest-1357551715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:17:47 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-c0e258c0-35ab-4663-8896-e6efcd494e40 tempest-CreateVolumesFromImageTest-1357551715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:17:47 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-c0e258c0-35ab-4663-8896-e6efcd494e40 tempest-CreateVolumesFromImageTest-1357551715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:17:47 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c0e258c0-35ab-4663-8896-e6efcd494e40 tempest-CreateVolumesFromImageTest-1357551715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:47 devstack sudo[93068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:17:47 devstack sudo[93068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:47 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f5d4e79-79ef-4f4c-8eb6-cc10b7be8c72 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:17:47 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5f5d4e79-79ef-4f4c-8eb6-cc10b7be8c72 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Flow 'volume_create_manager' (c6356b1a-80d5-4e98-b825-901188962192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:17:47 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5f5d4e79-79ef-4f4c-8eb6-cc10b7be8c72 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbb4be01-a2cf-469d-b567-7b6be3c2a648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:47 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5f5d4e79-79ef-4f4c-8eb6-cc10b7be8c72 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbb4be01-a2cf-469d-b567-7b6be3c2a648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:17:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-410925007',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e972a7a-d05a-4387-8d22-5e5b0c08b9a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='609f6249a87f4b5eb1ea4978d34fdb2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:17:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:17:47Z,use_quota=True,user_id='ab1cae9809144a3f925f6115d5ac18d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:47 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5f5d4e79-79ef-4f4c-8eb6-cc10b7be8c72 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af0323e2-6045-4dab-ab98-7170809d4392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:47 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5f5d4e79-79ef-4f4c-8eb6-cc10b7be8c72 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af0323e2-6045-4dab-ab98-7170809d4392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:47 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5f5d4e79-79ef-4f4c-8eb6-cc10b7be8c72 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d926064-41f4-4647-a935-a6524240bad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:47 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5f5d4e79-79ef-4f4c-8eb6-cc10b7be8c72 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d926064-41f4-4647-a935-a6524240bad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e972a7a-d05a-4387-8d22-5e5b0c08b9a3', 'volume_name': 'volume-6e972a7a-d05a-4387-8d22-5e5b0c08b9a3', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:47 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5f5d4e79-79ef-4f4c-8eb6-cc10b7be8c72 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a16f89b-6471-4028-b435-37e219201759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:47 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5f5d4e79-79ef-4f4c-8eb6-cc10b7be8c72 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a16f89b-6471-4028-b435-37e219201759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:47 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5f5d4e79-79ef-4f4c-8eb6-cc10b7be8c72 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8258371-58f1-4002-ba1c-3eebd6c4e776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:47 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-5f5d4e79-79ef-4f4c-8eb6-cc10b7be8c72 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Volume 6e972a7a-d05a-4387-8d22-5e5b0c08b9a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e972a7a-d05a-4387-8d22-5e5b0c08b9a3', 'volume_size': 1}
Apr 28 22:17:47 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-5f5d4e79-79ef-4f4c-8eb6-cc10b7be8c72 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:17:47 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-a94fbd4e-60af-4f27-8af0-379e82579f5a tempest-CreateVolumesFromSnapshotTest-1887340981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:17:47 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a94fbd4e-60af-4f27-8af0-379e82579f5a tempest-CreateVolumesFromSnapshotTest-1887340981 None] Flow 'volume_create_manager' (f8fac70a-ecae-401c-8d51-bbcbebfe3fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:17:47 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a94fbd4e-60af-4f27-8af0-379e82579f5a tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c954b42-35fe-4f81-9eb5-5767ab68beeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:47 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a94fbd4e-60af-4f27-8af0-379e82579f5a tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c954b42-35fe-4f81-9eb5-5767ab68beeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:17:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1981195330',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d68fa99-49cd-4f79-9601-8c300b594c28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='609f6249a87f4b5eb1ea4978d34fdb2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:17:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:17:48Z,use_quota=True,user_id='ab1cae9809144a3f925f6115d5ac18d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:47 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a94fbd4e-60af-4f27-8af0-379e82579f5a tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe1cc28f-c987-4e60-a7bb-6427e9909028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:47 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a94fbd4e-60af-4f27-8af0-379e82579f5a tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe1cc28f-c987-4e60-a7bb-6427e9909028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:47 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a94fbd4e-60af-4f27-8af0-379e82579f5a tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fa3f0ec-4740-4095-900e-35bd1a82a7d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:47 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a94fbd4e-60af-4f27-8af0-379e82579f5a tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fa3f0ec-4740-4095-900e-35bd1a82a7d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d68fa99-49cd-4f79-9601-8c300b594c28', 'volume_name': 'volume-9d68fa99-49cd-4f79-9601-8c300b594c28', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:47 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a94fbd4e-60af-4f27-8af0-379e82579f5a tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f87a851-caf3-4e20-b653-82c9bc6f4a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:47 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a94fbd4e-60af-4f27-8af0-379e82579f5a tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f87a851-caf3-4e20-b653-82c9bc6f4a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:47 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a94fbd4e-60af-4f27-8af0-379e82579f5a tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a8e6ba3-3bae-4736-9111-d314413cae1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:47 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-a94fbd4e-60af-4f27-8af0-379e82579f5a tempest-CreateVolumesFromSnapshotTest-1887340981 None] Volume 9d68fa99-49cd-4f79-9601-8c300b594c28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d68fa99-49cd-4f79-9601-8c300b594c28', 'volume_size': 1}
Apr 28 22:17:47 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-a94fbd4e-60af-4f27-8af0-379e82579f5a tempest-CreateVolumesFromSnapshotTest-1887340981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:17:47 devstack sudo[93068]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:47 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c0e258c0-35ab-4663-8896-e6efcd494e40 tempest-CreateVolumesFromImageTest-1357551715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.925s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:47 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-c0e258c0-35ab-4663-8896-e6efcd494e40 tempest-CreateVolumesFromImageTest-1357551715 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:17:47 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-c0e258c0-35ab-4663-8896-e6efcd494e40 tempest-CreateVolumesFromImageTest-1357551715 None] Deleted volume successfully.
Apr 28 22:17:48 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-c0e258c0-35ab-4663-8896-e6efcd494e40 tempest-CreateVolumesFromImageTest-1357551715 None] Lock "cinder-0514471e-48c7-45c8-8657-a5c6de954165-delete_volume" released by "delete_volume" :: held 3.368s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:17:52 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-5052327e-758b-4518-a042-09fe0986a9d9 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:17:52 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5052327e-758b-4518-a042-09fe0986a9d9 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Flow 'volume_create_manager' (e3b28bad-f487-4f15-ba32-ca419ea16464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:17:52 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5052327e-758b-4518-a042-09fe0986a9d9 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (736ceba9-72e9-47a2-9d9d-9aa8239a8597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:52 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5052327e-758b-4518-a042-09fe0986a9d9 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (736ceba9-72e9-47a2-9d9d-9aa8239a8597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-187402997',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa1b7451-775c-4219-859f-637b95dc0880,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2711656dd43e4a739ef5844f8ca2783d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:17:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:17:53Z,use_quota=True,user_id='951162fa6f8243f1b141d4ce1f760b3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:52 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5052327e-758b-4518-a042-09fe0986a9d9 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07b45b0b-f5c6-44ae-9522-6c8fe2e9aa7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:52 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5052327e-758b-4518-a042-09fe0986a9d9 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07b45b0b-f5c6-44ae-9522-6c8fe2e9aa7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:52 devstack sudo[93066]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:52 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5052327e-758b-4518-a042-09fe0986a9d9 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f62b2b40-5b5f-40f7-8182-574839935aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:52 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5052327e-758b-4518-a042-09fe0986a9d9 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f62b2b40-5b5f-40f7-8182-574839935aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa1b7451-775c-4219-859f-637b95dc0880', 'volume_name': 'volume-aa1b7451-775c-4219-859f-637b95dc0880', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:52 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5052327e-758b-4518-a042-09fe0986a9d9 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f891087-9463-4a10-8a01-a61c102a65a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:52 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5052327e-758b-4518-a042-09fe0986a9d9 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f891087-9463-4a10-8a01-a61c102a65a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:52 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5052327e-758b-4518-a042-09fe0986a9d9 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca1d023d-85fe-4453-a7af-eb23f2ebbf2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:52 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-5052327e-758b-4518-a042-09fe0986a9d9 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Volume aa1b7451-775c-4219-859f-637b95dc0880: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa1b7451-775c-4219-859f-637b95dc0880', 'volume_size': 1}
Apr 28 22:17:52 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-5052327e-758b-4518-a042-09fe0986a9d9 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:17:52 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-73c64b5f-7449-440b-b734-0f5b649b6aa3 tempest-VolumeDependencyTests-1826445949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cd54e365-b397-4625-9a1a-c331a110f554 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-15fd5642-02a9-4f15-a052-b6159a068a24" returned: 0 in 5.772s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:52 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c76d7e-27a3-4fbc-a25d-b5e20e774aa8]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:17:52 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-73c64b5f-7449-440b-b734-0f5b649b6aa3 tempest-VolumeDependencyTests-1826445949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cd54e365-b397-4625-9a1a-c331a110f554 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:52 devstack sudo[93082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cd54e365-b397-4625-9a1a-c331a110f554
Apr 28 22:17:52 devstack sudo[93082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:53 devstack sudo[93082]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:53 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-73c64b5f-7449-440b-b734-0f5b649b6aa3 tempest-VolumeDependencyTests-1826445949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cd54e365-b397-4625-9a1a-c331a110f554" returned: 0 in 0.838s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:53 devstack cinder-volume[83924]: DEBUG cinder.image.image_utils [None req-73c64b5f-7449-440b-b734-0f5b649b6aa3 tempest-VolumeDependencyTests-1826445949 None] Image conversion details: src /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cd54e365-b397-4625-9a1a-c331a110f554, size 1024.00 MB, duration 5.77 sec, destination /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-15fd5642-02a9-4f15-a052-b6159a068a24 {{(pid=83924) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 28 22:17:53 devstack cinder-volume[83924]: INFO cinder.image.image_utils [None req-73c64b5f-7449-440b-b734-0f5b649b6aa3 tempest-VolumeDependencyTests-1826445949 None] Converted 1024.00 MB image at 177.38 MB/s
Apr 28 22:17:53 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-73c64b5f-7449-440b-b734-0f5b649b6aa3 tempest-VolumeDependencyTests-1826445949 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-15fd5642-02a9-4f15-a052-b6159a068a24 is being set with open permissions: ugo+rw
Apr 28 22:17:53 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-73c64b5f-7449-440b-b734-0f5b649b6aa3 tempest-VolumeDependencyTests-1826445949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-15fd5642-02a9-4f15-a052-b6159a068a24 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:53 devstack sudo[93089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-15fd5642-02a9-4f15-a052-b6159a068a24
Apr 28 22:17:53 devstack sudo[93089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:54 devstack sudo[93089]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:54 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-73c64b5f-7449-440b-b734-0f5b649b6aa3 tempest-VolumeDependencyTests-1826445949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-15fd5642-02a9-4f15-a052-b6159a068a24" returned: 0 in 0.594s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:54 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-73c64b5f-7449-440b-b734-0f5b649b6aa3 tempest-VolumeDependencyTests-1826445949 None] Lock "cinder-quobyte-15fd5642-02a9-4f15-a052-b6159a068a24" released by "_copy_volume_from_snapshot" :: held 9.373s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:17:54 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-73c64b5f-7449-440b-b734-0f5b649b6aa3 tempest-VolumeDependencyTests-1826445949 None] Lock "cinder-quobyte-b4fd5b2c-6967-4bd5-a5f4-8ea2b8d4833c-15fd5642-02a9-4f15-a052-b6159a068a24" released by "_create_volume_from_snapshot" :: held 9.498s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:17:54 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-73c64b5f-7449-440b-b734-0f5b649b6aa3 tempest-VolumeDependencyTests-1826445949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.554s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:17:54 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-1852fb41-5623-4e3d-b728-35104913564d tempest-CreateVolumesFromSnapshotTest-1887340981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.226s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:17:54 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-1852fb41-5623-4e3d-b728-35104913564d tempest-CreateVolumesFromSnapshotTest-1887340981 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:17:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-585568013',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcf4d76d-4aae-4420-b048-579a08017922,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='609f6249a87f4b5eb1ea4978d34fdb2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:17:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:17:46Z,use_quota=True,user_id='ab1cae9809144a3f925f6115d5ac18d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:17:54 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-1852fb41-5623-4e3d-b728-35104913564d tempest-CreateVolumesFromSnapshotTest-1887340981 None] Creating volume dcf4d76d-4aae-4420-b048-579a08017922 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:17:54 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-1852fb41-5623-4e3d-b728-35104913564d tempest-CreateVolumesFromSnapshotTest-1887340981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:17:54 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-1852fb41-5623-4e3d-b728-35104913564d tempest-CreateVolumesFromSnapshotTest-1887340981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:17:54 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-1852fb41-5623-4e3d-b728-35104913564d tempest-CreateVolumesFromSnapshotTest-1887340981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:17:54 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-1852fb41-5623-4e3d-b728-35104913564d tempest-CreateVolumesFromSnapshotTest-1887340981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:17:54 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-1852fb41-5623-4e3d-b728-35104913564d tempest-CreateVolumesFromSnapshotTest-1887340981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:17:54 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-1852fb41-5623-4e3d-b728-35104913564d tempest-CreateVolumesFromSnapshotTest-1887340981 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:17:54 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-1852fb41-5623-4e3d-b728-35104913564d tempest-CreateVolumesFromSnapshotTest-1887340981 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:17:54 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-1852fb41-5623-4e3d-b728-35104913564d tempest-CreateVolumesFromSnapshotTest-1887340981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-dcf4d76d-4aae-4420-b048-579a08017922 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:54 devstack sudo[93092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-dcf4d76d-4aae-4420-b048-579a08017922 1073741824
Apr 28 22:17:54 devstack sudo[93092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:54 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-73c64b5f-7449-440b-b734-0f5b649b6aa3 tempest-VolumeDependencyTests-1826445949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed6a4059-9af2-4832-9547-368a6718e12f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15fd5642-02a9-4f15-a052-b6159a068a24', 'volume_size': 1, 'snapshot_id': 'b4fd5b2c-6967-4bd5-a5f4-8ea2b8d4833c'}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:54 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-73c64b5f-7449-440b-b734-0f5b649b6aa3 tempest-VolumeDependencyTests-1826445949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ebd6c4f-ec5b-482c-b8f5-0a05db23fab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:54 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-73c64b5f-7449-440b-b734-0f5b649b6aa3 tempest-VolumeDependencyTests-1826445949 None] Volume volume-15fd5642-02a9-4f15-a052-b6159a068a24 (15fd5642-02a9-4f15-a052-b6159a068a24): created successfully
Apr 28 22:17:54 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-73c64b5f-7449-440b-b734-0f5b649b6aa3 tempest-VolumeDependencyTests-1826445949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ebd6c4f-ec5b-482c-b8f5-0a05db23fab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:54 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-73c64b5f-7449-440b-b734-0f5b649b6aa3 tempest-VolumeDependencyTests-1826445949 None] Flow 'volume_create_manager' (f7d7e02f-433e-4b2b-a792-5a8cc8ca7957) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:17:54 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-73c64b5f-7449-440b-b734-0f5b649b6aa3 tempest-VolumeDependencyTests-1826445949 None] Created volume successfully.
Apr 28 22:17:54 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-8e6d8e4d-4737-487c-b0f4-488af0f067d4 tempest-VolumeDependencyTests-1826445949 None] Acquiring lock "cinder-b4fd5b2c-6967-4bd5-a5f4-8ea2b8d4833c-delete_snapshot" by "delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:17:54 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-8e6d8e4d-4737-487c-b0f4-488af0f067d4 tempest-VolumeDependencyTests-1826445949 None] Lock "cinder-b4fd5b2c-6967-4bd5-a5f4-8ea2b8d4833c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:17:54 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-8e6d8e4d-4737-487c-b0f4-488af0f067d4 tempest-VolumeDependencyTests-1826445949 None] Acquiring lock "cinder-quobyte-cd54e365-b397-4625-9a1a-c331a110f554" by "delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:17:54 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-8e6d8e4d-4737-487c-b0f4-488af0f067d4 tempest-VolumeDependencyTests-1826445949 None] Lock "cinder-quobyte-cd54e365-b397-4625-9a1a-c331a110f554" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:17:54 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-8e6d8e4d-4737-487c-b0f4-488af0f067d4 tempest-VolumeDependencyTests-1826445949 None] Acquiring lock "cinder-quobyte-b4fd5b2c-6967-4bd5-a5f4-8ea2b8d4833c" by "_delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:17:54 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-8e6d8e4d-4737-487c-b0f4-488af0f067d4 tempest-VolumeDependencyTests-1826445949 None] Lock "cinder-quobyte-b4fd5b2c-6967-4bd5-a5f4-8ea2b8d4833c" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:17:54 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-8e6d8e4d-4737-487c-b0f4-488af0f067d4 tempest-VolumeDependencyTests-1826445949 None] Deleting offline snapshot b4fd5b2c-6967-4bd5-a5f4-8ea2b8d4833c of volume cd54e365-b397-4625-9a1a-c331a110f554 {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 22:17:54 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-8e6d8e4d-4737-487c-b0f4-488af0f067d4 tempest-VolumeDependencyTests-1826445949 None] snapshot_file for this snap is: volume-cd54e365-b397-4625-9a1a-c331a110f554.b4fd5b2c-6967-4bd5-a5f4-8ea2b8d4833c {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 22:17:54 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f07bd83b-cdb5-4e20-95bb-1e344ce46ea6]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:17:54 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-8e6d8e4d-4737-487c-b0f4-488af0f067d4 tempest-VolumeDependencyTests-1826445949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cd54e365-b397-4625-9a1a-c331a110f554.b4fd5b2c-6967-4bd5-a5f4-8ea2b8d4833c {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:54 devstack sudo[93097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cd54e365-b397-4625-9a1a-c331a110f554.b4fd5b2c-6967-4bd5-a5f4-8ea2b8d4833c
Apr 28 22:17:54 devstack sudo[93097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:54 devstack sudo[93092]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:54 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-1852fb41-5623-4e3d-b728-35104913564d tempest-CreateVolumesFromSnapshotTest-1887340981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-dcf4d76d-4aae-4420-b048-579a08017922 1073741824" returned: 0 in 0.802s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:55 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-1852fb41-5623-4e3d-b728-35104913564d tempest-CreateVolumesFromSnapshotTest-1887340981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-dcf4d76d-4aae-4420-b048-579a08017922 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:55 devstack sudo[93099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-dcf4d76d-4aae-4420-b048-579a08017922
Apr 28 22:17:55 devstack sudo[93099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:55 devstack sudo[93097]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:55 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-8e6d8e4d-4737-487c-b0f4-488af0f067d4 tempest-VolumeDependencyTests-1826445949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cd54e365-b397-4625-9a1a-c331a110f554.b4fd5b2c-6967-4bd5-a5f4-8ea2b8d4833c" returned: 0 in 0.744s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:55 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-8e6d8e4d-4737-487c-b0f4-488af0f067d4 tempest-VolumeDependencyTests-1826445949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd54e365-b397-4625-9a1a-c331a110f554(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 22:17:55 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[df926d67-5f81-4b12-a84d-9fa5de2fb555]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:17:55 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-8e6d8e4d-4737-487c-b0f4-488af0f067d4 tempest-VolumeDependencyTests-1826445949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cd54e365-b397-4625-9a1a-c331a110f554 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:55 devstack sudo[93099]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:55 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-1852fb41-5623-4e3d-b728-35104913564d tempest-CreateVolumesFromSnapshotTest-1887340981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-dcf4d76d-4aae-4420-b048-579a08017922" returned: 0 in 0.569s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:55 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-1852fb41-5623-4e3d-b728-35104913564d tempest-CreateVolumesFromSnapshotTest-1887340981 None] <== create_volume: return (1411ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:17:55 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-1852fb41-5623-4e3d-b728-35104913564d tempest-CreateVolumesFromSnapshotTest-1887340981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.414s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:17:55 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-06f7b36d-479b-4754-a4d9-5f8d53d61f76 tempest-SnapshotDependencyTests-1655070008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.298s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:17:55 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-06f7b36d-479b-4754-a4d9-5f8d53d61f76 tempest-SnapshotDependencyTests-1655070008 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:17:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1527722530',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=123a3412-28f5-42ca-9424-50f31049250d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89e9a04687ff4a78be01c3f97445761b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:17:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:17:46Z,use_quota=True,user_id='ee59c99401914f22a5a8072c96203521',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:17:55 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-06f7b36d-479b-4754-a4d9-5f8d53d61f76 tempest-SnapshotDependencyTests-1655070008 None] Creating volume 123a3412-28f5-42ca-9424-50f31049250d {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:17:55 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-06f7b36d-479b-4754-a4d9-5f8d53d61f76 tempest-SnapshotDependencyTests-1655070008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:17:55 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-06f7b36d-479b-4754-a4d9-5f8d53d61f76 tempest-SnapshotDependencyTests-1655070008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:17:55 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-06f7b36d-479b-4754-a4d9-5f8d53d61f76 tempest-SnapshotDependencyTests-1655070008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:17:55 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-06f7b36d-479b-4754-a4d9-5f8d53d61f76 tempest-SnapshotDependencyTests-1655070008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:17:55 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-06f7b36d-479b-4754-a4d9-5f8d53d61f76 tempest-SnapshotDependencyTests-1655070008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:17:55 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-06f7b36d-479b-4754-a4d9-5f8d53d61f76 tempest-SnapshotDependencyTests-1655070008 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:17:55 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-06f7b36d-479b-4754-a4d9-5f8d53d61f76 tempest-SnapshotDependencyTests-1655070008 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:17:55 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-06f7b36d-479b-4754-a4d9-5f8d53d61f76 tempest-SnapshotDependencyTests-1655070008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-123a3412-28f5-42ca-9424-50f31049250d 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:55 devstack sudo[93106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-123a3412-28f5-42ca-9424-50f31049250d 1073741824
Apr 28 22:17:55 devstack sudo[93106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:55 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-1852fb41-5623-4e3d-b728-35104913564d tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f68cbad2-3754-4a88-8f54-00b6fc2ac24c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcf4d76d-4aae-4420-b048-579a08017922', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:55 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-1852fb41-5623-4e3d-b728-35104913564d tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3ec79a2-71c9-451b-b26e-278545a2b941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:55 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-1852fb41-5623-4e3d-b728-35104913564d tempest-CreateVolumesFromSnapshotTest-1887340981 None] Volume volume-dcf4d76d-4aae-4420-b048-579a08017922 (dcf4d76d-4aae-4420-b048-579a08017922): created successfully
Apr 28 22:17:55 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-1852fb41-5623-4e3d-b728-35104913564d tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3ec79a2-71c9-451b-b26e-278545a2b941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:55 devstack sudo[93105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cd54e365-b397-4625-9a1a-c331a110f554
Apr 28 22:17:55 devstack sudo[93105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:55 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-1852fb41-5623-4e3d-b728-35104913564d tempest-CreateVolumesFromSnapshotTest-1887340981 None] Flow 'volume_create_manager' (cd1e5119-2bed-4fb9-82ea-4820996cd4e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:17:55 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-1852fb41-5623-4e3d-b728-35104913564d tempest-CreateVolumesFromSnapshotTest-1887340981 None] Created volume successfully.
Apr 28 22:17:56 devstack sudo[93105]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:56 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-8e6d8e4d-4737-487c-b0f4-488af0f067d4 tempest-VolumeDependencyTests-1826445949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cd54e365-b397-4625-9a1a-c331a110f554" returned: 0 in 0.743s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:56 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-8e6d8e4d-4737-487c-b0f4-488af0f067d4 tempest-VolumeDependencyTests-1826445949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cd54e365-b397-4625-9a1a-c331a110f554.b4fd5b2c-6967-4bd5-a5f4-8ea2b8d4833c {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:56 devstack sudo[93116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cd54e365-b397-4625-9a1a-c331a110f554.b4fd5b2c-6967-4bd5-a5f4-8ea2b8d4833c
Apr 28 22:17:56 devstack sudo[93116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:56 devstack sudo[93106]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:56 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-06f7b36d-479b-4754-a4d9-5f8d53d61f76 tempest-SnapshotDependencyTests-1655070008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-123a3412-28f5-42ca-9424-50f31049250d 1073741824" returned: 0 in 0.747s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:56 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-06f7b36d-479b-4754-a4d9-5f8d53d61f76 tempest-SnapshotDependencyTests-1655070008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-123a3412-28f5-42ca-9424-50f31049250d {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:56 devstack sudo[93118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-123a3412-28f5-42ca-9424-50f31049250d
Apr 28 22:17:56 devstack sudo[93118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:56 devstack sudo[93118]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:56 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-06f7b36d-479b-4754-a4d9-5f8d53d61f76 tempest-SnapshotDependencyTests-1655070008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-123a3412-28f5-42ca-9424-50f31049250d" returned: 0 in 0.580s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:56 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-06f7b36d-479b-4754-a4d9-5f8d53d61f76 tempest-SnapshotDependencyTests-1655070008 None] <== create_volume: return (1364ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:17:56 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-06f7b36d-479b-4754-a4d9-5f8d53d61f76 tempest-SnapshotDependencyTests-1655070008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.367s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:17:56 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-c986acc4-0738-4902-a9eb-152277981c33 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.522s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:17:56 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-c986acc4-0738-4902-a9eb-152277981c33 tempest-CreateVolumesFromSnapshotTest-1887340981 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:17:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-478124895',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=017e4c2c-4a63-425e-ab6c-c25b1234845e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='609f6249a87f4b5eb1ea4978d34fdb2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:17:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:17:46Z,use_quota=True,user_id='ab1cae9809144a3f925f6115d5ac18d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:17:56 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-c986acc4-0738-4902-a9eb-152277981c33 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Creating volume 017e4c2c-4a63-425e-ab6c-c25b1234845e {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:17:56 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-c986acc4-0738-4902-a9eb-152277981c33 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:17:56 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-c986acc4-0738-4902-a9eb-152277981c33 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:17:56 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-c986acc4-0738-4902-a9eb-152277981c33 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:17:56 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-c986acc4-0738-4902-a9eb-152277981c33 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:17:56 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-c986acc4-0738-4902-a9eb-152277981c33 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:17:56 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-c986acc4-0738-4902-a9eb-152277981c33 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:17:56 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-c986acc4-0738-4902-a9eb-152277981c33 tempest-CreateVolumesFromSnapshotTest-1887340981 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:17:56 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c986acc4-0738-4902-a9eb-152277981c33 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-017e4c2c-4a63-425e-ab6c-c25b1234845e 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:56 devstack sudo[93116]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:56 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-8e6d8e4d-4737-487c-b0f4-488af0f067d4 tempest-VolumeDependencyTests-1826445949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cd54e365-b397-4625-9a1a-c331a110f554.b4fd5b2c-6967-4bd5-a5f4-8ea2b8d4833c" returned: 0 in 0.709s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:56 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-8e6d8e4d-4737-487c-b0f4-488af0f067d4 tempest-VolumeDependencyTests-1826445949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cd54e365-b397-4625-9a1a-c331a110f554.b4fd5b2c-6967-4bd5-a5f4-8ea2b8d4833c {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:56 devstack sudo[93124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-017e4c2c-4a63-425e-ab6c-c25b1234845e 1073741824
Apr 28 22:17:56 devstack sudo[93124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:57 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-06f7b36d-479b-4754-a4d9-5f8d53d61f76 tempest-SnapshotDependencyTests-1655070008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2e0ee63-1cc2-437e-b1f4-af0016cfd536) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-123a3412-28f5-42ca-9424-50f31049250d', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:57 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-06f7b36d-479b-4754-a4d9-5f8d53d61f76 tempest-SnapshotDependencyTests-1655070008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d098d670-6d2d-468f-a3ba-b6e49fbdbb9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:57 devstack sudo[93126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cd54e365-b397-4625-9a1a-c331a110f554.b4fd5b2c-6967-4bd5-a5f4-8ea2b8d4833c
Apr 28 22:17:57 devstack sudo[93126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:57 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-06f7b36d-479b-4754-a4d9-5f8d53d61f76 tempest-SnapshotDependencyTests-1655070008 None] Volume volume-123a3412-28f5-42ca-9424-50f31049250d (123a3412-28f5-42ca-9424-50f31049250d): created successfully
Apr 28 22:17:57 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-06f7b36d-479b-4754-a4d9-5f8d53d61f76 tempest-SnapshotDependencyTests-1655070008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d098d670-6d2d-468f-a3ba-b6e49fbdbb9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:57 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-06f7b36d-479b-4754-a4d9-5f8d53d61f76 tempest-SnapshotDependencyTests-1655070008 None] Flow 'volume_create_manager' (e7daae7d-c0a9-4fd0-a078-c908ac52b94f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:17:57 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-06f7b36d-479b-4754-a4d9-5f8d53d61f76 tempest-SnapshotDependencyTests-1655070008 None] Created volume successfully.
Apr 28 22:17:57 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b6e75392-6df7-4c52-88cb-5d2d211fa6f3 tempest-SnapshotDependencyTests-1655070008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:17:57 devstack sudo[93126]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:57 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-8e6d8e4d-4737-487c-b0f4-488af0f067d4 tempest-VolumeDependencyTests-1826445949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cd54e365-b397-4625-9a1a-c331a110f554.b4fd5b2c-6967-4bd5-a5f4-8ea2b8d4833c" returned: 0 in 0.600s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:57 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-8e6d8e4d-4737-487c-b0f4-488af0f067d4 tempest-VolumeDependencyTests-1826445949 None] Lock "cinder-quobyte-b4fd5b2c-6967-4bd5-a5f4-8ea2b8d4833c" released by "_delete_snapshot" :: held 2.894s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:17:57 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-8e6d8e4d-4737-487c-b0f4-488af0f067d4 tempest-VolumeDependencyTests-1826445949 None] Lock "cinder-quobyte-cd54e365-b397-4625-9a1a-c331a110f554" released by "delete_snapshot" :: held 2.916s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:17:57 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-8e6d8e4d-4737-487c-b0f4-488af0f067d4 tempest-VolumeDependencyTests-1826445949 None] Created reservations ['c09871e9-169f-4ce8-93af-743c75459da6', '92c037d6-5651-46e8-9cc1-799294219e43', '213d8645-17b6-4bc0-9829-35bd0174db41', '4f9c1af8-a906-403b-a326-265585b4f6fc'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:17:57 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-8e6d8e4d-4737-487c-b0f4-488af0f067d4 tempest-VolumeDependencyTests-1826445949 None] Delete snapshot completed successfully.
Apr 28 22:17:57 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-8e6d8e4d-4737-487c-b0f4-488af0f067d4 tempest-VolumeDependencyTests-1826445949 None] Lock "cinder-b4fd5b2c-6967-4bd5-a5f4-8ea2b8d4833c-delete_snapshot" released by "delete_snapshot" :: held 3.043s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:17:57 devstack sudo[93124]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:57 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c986acc4-0738-4902-a9eb-152277981c33 tempest-CreateVolumesFromSnapshotTest-1887340981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-017e4c2c-4a63-425e-ab6c-c25b1234845e 1073741824" returned: 0 in 0.858s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:57 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c986acc4-0738-4902-a9eb-152277981c33 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-017e4c2c-4a63-425e-ab6c-c25b1234845e {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:57 devstack sudo[93133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-017e4c2c-4a63-425e-ab6c-c25b1234845e
Apr 28 22:17:57 devstack sudo[93133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:57 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-2b9f87a3-c51b-4aec-a2df-154390e57604 tempest-VolumeDependencyTests-1826445949 None] Acquiring lock "cinder-cd54e365-b397-4625-9a1a-c331a110f554-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:17:57 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-2b9f87a3-c51b-4aec-a2df-154390e57604 tempest-VolumeDependencyTests-1826445949 None] Lock "cinder-cd54e365-b397-4625-9a1a-c331a110f554-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:17:57 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-2b9f87a3-c51b-4aec-a2df-154390e57604 tempest-VolumeDependencyTests-1826445949 None] Acquiring lock "cinder-quobyte-cd54e365-b397-4625-9a1a-c331a110f554" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:17:57 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-2b9f87a3-c51b-4aec-a2df-154390e57604 tempest-VolumeDependencyTests-1826445949 None] Lock "cinder-quobyte-cd54e365-b397-4625-9a1a-c331a110f554" acquired by "delete_volume" :: waited 0.018s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:17:58 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[531aaf81-e9e4-4121-aec4-b3ed6d4fe8b2]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:17:58 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-2b9f87a3-c51b-4aec-a2df-154390e57604 tempest-VolumeDependencyTests-1826445949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cd54e365-b397-4625-9a1a-c331a110f554 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:58 devstack sudo[93135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cd54e365-b397-4625-9a1a-c331a110f554
Apr 28 22:17:58 devstack sudo[93135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:58 devstack sudo[93133]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:58 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c986acc4-0738-4902-a9eb-152277981c33 tempest-CreateVolumesFromSnapshotTest-1887340981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-017e4c2c-4a63-425e-ab6c-c25b1234845e" returned: 0 in 0.584s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:58 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-c986acc4-0738-4902-a9eb-152277981c33 tempest-CreateVolumesFromSnapshotTest-1887340981 None] <== create_volume: return (1486ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:17:58 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-c986acc4-0738-4902-a9eb-152277981c33 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.488s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:17:58 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-eb835d52-c1cd-4c31-9fb1-1d34f5c9c053 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.525s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:17:58 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-eb835d52-c1cd-4c31-9fb1-1d34f5c9c053 tempest-CreateVolumesFromSnapshotTest-1887340981 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:17:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-896701638',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f755e5f-329b-46c3-bb71-0968006471b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='609f6249a87f4b5eb1ea4978d34fdb2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:17:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:17:47Z,use_quota=True,user_id='ab1cae9809144a3f925f6115d5ac18d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:17:58 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-eb835d52-c1cd-4c31-9fb1-1d34f5c9c053 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Creating volume 8f755e5f-329b-46c3-bb71-0968006471b7 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:17:58 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-eb835d52-c1cd-4c31-9fb1-1d34f5c9c053 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:17:58 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-eb835d52-c1cd-4c31-9fb1-1d34f5c9c053 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:17:58 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-eb835d52-c1cd-4c31-9fb1-1d34f5c9c053 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:17:58 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-eb835d52-c1cd-4c31-9fb1-1d34f5c9c053 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:17:58 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-eb835d52-c1cd-4c31-9fb1-1d34f5c9c053 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:17:58 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-eb835d52-c1cd-4c31-9fb1-1d34f5c9c053 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:17:58 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-eb835d52-c1cd-4c31-9fb1-1d34f5c9c053 tempest-CreateVolumesFromSnapshotTest-1887340981 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:17:58 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-eb835d52-c1cd-4c31-9fb1-1d34f5c9c053 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8f755e5f-329b-46c3-bb71-0968006471b7 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:58 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-c986acc4-0738-4902-a9eb-152277981c33 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d53c808-afcf-4d4f-ba81-40de1b2875fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-017e4c2c-4a63-425e-ab6c-c25b1234845e', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:58 devstack sudo[93138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8f755e5f-329b-46c3-bb71-0968006471b7 1073741824
Apr 28 22:17:58 devstack sudo[93138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:58 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-c986acc4-0738-4902-a9eb-152277981c33 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf75064a-626a-48e6-9ad1-32ac571a7d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:17:58 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-c986acc4-0738-4902-a9eb-152277981c33 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Volume volume-017e4c2c-4a63-425e-ab6c-c25b1234845e (017e4c2c-4a63-425e-ab6c-c25b1234845e): created successfully
Apr 28 22:17:58 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-c986acc4-0738-4902-a9eb-152277981c33 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf75064a-626a-48e6-9ad1-32ac571a7d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:17:58 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-c986acc4-0738-4902-a9eb-152277981c33 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Flow 'volume_create_manager' (76eef5f4-1dc0-4cc6-8dc1-9bac38c23128) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:17:58 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-c986acc4-0738-4902-a9eb-152277981c33 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Created volume successfully.
Apr 28 22:17:58 devstack sudo[93135]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:58 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-2b9f87a3-c51b-4aec-a2df-154390e57604 tempest-VolumeDependencyTests-1826445949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cd54e365-b397-4625-9a1a-c331a110f554" returned: 0 in 0.731s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:58 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-2b9f87a3-c51b-4aec-a2df-154390e57604 tempest-VolumeDependencyTests-1826445949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cd54e365-b397-4625-9a1a-c331a110f554 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:58 devstack sudo[93143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cd54e365-b397-4625-9a1a-c331a110f554
Apr 28 22:17:58 devstack sudo[93143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:59 devstack sudo[93138]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:59 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-eb835d52-c1cd-4c31-9fb1-1d34f5c9c053 tempest-CreateVolumesFromSnapshotTest-1887340981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8f755e5f-329b-46c3-bb71-0968006471b7 1073741824" returned: 0 in 0.862s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:59 devstack sudo[93143]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:59 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-2b9f87a3-c51b-4aec-a2df-154390e57604 tempest-VolumeDependencyTests-1826445949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-cd54e365-b397-4625-9a1a-c331a110f554" returned: 0 in 0.618s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:59 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-2b9f87a3-c51b-4aec-a2df-154390e57604 tempest-VolumeDependencyTests-1826445949 None] Lock "cinder-quobyte-cd54e365-b397-4625-9a1a-c331a110f554" released by "delete_volume" :: held 1.414s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:17:59 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-eb835d52-c1cd-4c31-9fb1-1d34f5c9c053 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8f755e5f-329b-46c3-bb71-0968006471b7 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:59 devstack sudo[93149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8f755e5f-329b-46c3-bb71-0968006471b7
Apr 28 22:17:59 devstack sudo[93149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:59 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-2b9f87a3-c51b-4aec-a2df-154390e57604 tempest-VolumeDependencyTests-1826445949 None] Created reservations ['f652f580-6ad6-42d7-b101-d1f3013ee830', 'a59676de-e736-4659-9961-5d79bdbe693d', '8171f575-7a35-460f-96ff-b76fa78616d7', '772be51f-8cee-45a6-95a3-bda47e12e312'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:17:59 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-2b9f87a3-c51b-4aec-a2df-154390e57604 tempest-VolumeDependencyTests-1826445949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:17:59 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-2b9f87a3-c51b-4aec-a2df-154390e57604 tempest-VolumeDependencyTests-1826445949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:17:59 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-2b9f87a3-c51b-4aec-a2df-154390e57604 tempest-VolumeDependencyTests-1826445949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:17:59 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-2b9f87a3-c51b-4aec-a2df-154390e57604 tempest-VolumeDependencyTests-1826445949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:17:59 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-2b9f87a3-c51b-4aec-a2df-154390e57604 tempest-VolumeDependencyTests-1826445949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:17:59 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-2b9f87a3-c51b-4aec-a2df-154390e57604 tempest-VolumeDependencyTests-1826445949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:17:59 devstack sudo[93151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:17:59 devstack sudo[93151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:17:59 devstack sudo[93149]: pam_unix(sudo:session): session closed for user root
Apr 28 22:17:59 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-eb835d52-c1cd-4c31-9fb1-1d34f5c9c053 tempest-CreateVolumesFromSnapshotTest-1887340981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8f755e5f-329b-46c3-bb71-0968006471b7" returned: 0 in 0.607s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:17:59 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-eb835d52-c1cd-4c31-9fb1-1d34f5c9c053 tempest-CreateVolumesFromSnapshotTest-1887340981 None] <== create_volume: return (1537ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:17:59 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-eb835d52-c1cd-4c31-9fb1-1d34f5c9c053 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.542s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:17:59 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-5f5d4e79-79ef-4f4c-8eb6-cc10b7be8c72 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.663s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:18:00 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-5f5d4e79-79ef-4f4c-8eb6-cc10b7be8c72 tempest-CreateVolumesFromSnapshotTest-1887340981 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:17:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-410925007',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e972a7a-d05a-4387-8d22-5e5b0c08b9a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='609f6249a87f4b5eb1ea4978d34fdb2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:17:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:17:47Z,use_quota=True,user_id='ab1cae9809144a3f925f6115d5ac18d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:18:00 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-5f5d4e79-79ef-4f4c-8eb6-cc10b7be8c72 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Creating volume 6e972a7a-d05a-4387-8d22-5e5b0c08b9a3 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:18:00 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-5f5d4e79-79ef-4f4c-8eb6-cc10b7be8c72 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:18:00 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-5f5d4e79-79ef-4f4c-8eb6-cc10b7be8c72 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:18:00 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-5f5d4e79-79ef-4f4c-8eb6-cc10b7be8c72 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:18:00 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-5f5d4e79-79ef-4f4c-8eb6-cc10b7be8c72 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:18:00 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-5f5d4e79-79ef-4f4c-8eb6-cc10b7be8c72 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:18:00 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-5f5d4e79-79ef-4f4c-8eb6-cc10b7be8c72 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:18:00 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-5f5d4e79-79ef-4f4c-8eb6-cc10b7be8c72 tempest-CreateVolumesFromSnapshotTest-1887340981 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:18:00 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5f5d4e79-79ef-4f4c-8eb6-cc10b7be8c72 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6e972a7a-d05a-4387-8d22-5e5b0c08b9a3 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:00 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-eb835d52-c1cd-4c31-9fb1-1d34f5c9c053 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d4c5846-52c2-425a-bd7f-7c6cdc6d0496) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f755e5f-329b-46c3-bb71-0968006471b7', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:18:00 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-eb835d52-c1cd-4c31-9fb1-1d34f5c9c053 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c91b6a4d-3b36-4d4e-bb38-93ea5d07cd16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:18:00 devstack sudo[93154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6e972a7a-d05a-4387-8d22-5e5b0c08b9a3 1073741824
Apr 28 22:18:00 devstack sudo[93154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:00 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-eb835d52-c1cd-4c31-9fb1-1d34f5c9c053 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Volume volume-8f755e5f-329b-46c3-bb71-0968006471b7 (8f755e5f-329b-46c3-bb71-0968006471b7): created successfully
Apr 28 22:18:00 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-eb835d52-c1cd-4c31-9fb1-1d34f5c9c053 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c91b6a4d-3b36-4d4e-bb38-93ea5d07cd16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:18:00 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-eb835d52-c1cd-4c31-9fb1-1d34f5c9c053 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Flow 'volume_create_manager' (b04c5d7c-a2a6-429b-b708-2415bfd10893) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:18:00 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-eb835d52-c1cd-4c31-9fb1-1d34f5c9c053 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Created volume successfully.
Apr 28 22:18:00 devstack sudo[93151]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:00 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-2b9f87a3-c51b-4aec-a2df-154390e57604 tempest-VolumeDependencyTests-1826445949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.614s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:00 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-2b9f87a3-c51b-4aec-a2df-154390e57604 tempest-VolumeDependencyTests-1826445949 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:18:00 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-2b9f87a3-c51b-4aec-a2df-154390e57604 tempest-VolumeDependencyTests-1826445949 None] Deleted volume successfully.
Apr 28 22:18:00 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-2b9f87a3-c51b-4aec-a2df-154390e57604 tempest-VolumeDependencyTests-1826445949 None] Lock "cinder-cd54e365-b397-4625-9a1a-c331a110f554-delete_volume" released by "delete_volume" :: held 2.260s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:18:00 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-6172d4bd-4ad5-4a00-9521-9b2d6ad2cbca tempest-VolumeDependencyTests-1826445949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:18:00 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-6172d4bd-4ad5-4a00-9521-9b2d6ad2cbca tempest-VolumeDependencyTests-1826445949 None] Flow 'volume_create_manager' (11c11521-9e95-4f55-b06e-ea9589cf8def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:18:00 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-6172d4bd-4ad5-4a00-9521-9b2d6ad2cbca tempest-VolumeDependencyTests-1826445949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9753324a-69e3-429d-9516-82b91a0803b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:18:00 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-6172d4bd-4ad5-4a00-9521-9b2d6ad2cbca tempest-VolumeDependencyTests-1826445949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9753324a-69e3-429d-9516-82b91a0803b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:18:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-887369490',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f86ea68a-4896-4e7b-8160-d180e358d610,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0a8cf6e955c4797a45097f8aba2542e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:18:01Z,use_quota=True,user_id='8d0c1e1ebfa748e2b733fb77632a8e6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:18:00 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-6172d4bd-4ad5-4a00-9521-9b2d6ad2cbca tempest-VolumeDependencyTests-1826445949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d9f7f9c-de7b-41a6-adfe-5f85628f63d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:18:00 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-6172d4bd-4ad5-4a00-9521-9b2d6ad2cbca tempest-VolumeDependencyTests-1826445949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d9f7f9c-de7b-41a6-adfe-5f85628f63d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:18:00 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-6172d4bd-4ad5-4a00-9521-9b2d6ad2cbca tempest-VolumeDependencyTests-1826445949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc061836-c2fa-4dab-a9db-4c664cbd9996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:18:00 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-6172d4bd-4ad5-4a00-9521-9b2d6ad2cbca tempest-VolumeDependencyTests-1826445949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc061836-c2fa-4dab-a9db-4c664cbd9996) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f86ea68a-4896-4e7b-8160-d180e358d610', 'volume_name': 'volume-f86ea68a-4896-4e7b-8160-d180e358d610', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:18:00 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-6172d4bd-4ad5-4a00-9521-9b2d6ad2cbca tempest-VolumeDependencyTests-1826445949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79e098f0-c802-4ef2-85f9-0939dd7653e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:18:00 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-6172d4bd-4ad5-4a00-9521-9b2d6ad2cbca tempest-VolumeDependencyTests-1826445949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79e098f0-c802-4ef2-85f9-0939dd7653e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:18:00 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-6172d4bd-4ad5-4a00-9521-9b2d6ad2cbca tempest-VolumeDependencyTests-1826445949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (007ee948-4ab6-4947-ac97-c5e4a0e342ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:18:00 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-6172d4bd-4ad5-4a00-9521-9b2d6ad2cbca tempest-VolumeDependencyTests-1826445949 None] Volume f86ea68a-4896-4e7b-8160-d180e358d610: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f86ea68a-4896-4e7b-8160-d180e358d610', 'volume_size': 1}
Apr 28 22:18:00 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-6172d4bd-4ad5-4a00-9521-9b2d6ad2cbca tempest-VolumeDependencyTests-1826445949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:18:00 devstack sudo[93154]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:00 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5f5d4e79-79ef-4f4c-8eb6-cc10b7be8c72 tempest-CreateVolumesFromSnapshotTest-1887340981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6e972a7a-d05a-4387-8d22-5e5b0c08b9a3 1073741824" returned: 0 in 0.840s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:00 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5f5d4e79-79ef-4f4c-8eb6-cc10b7be8c72 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6e972a7a-d05a-4387-8d22-5e5b0c08b9a3 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:00 devstack sudo[93160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6e972a7a-d05a-4387-8d22-5e5b0c08b9a3
Apr 28 22:18:00 devstack sudo[93160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:01 devstack sudo[93160]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:01 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5f5d4e79-79ef-4f4c-8eb6-cc10b7be8c72 tempest-CreateVolumesFromSnapshotTest-1887340981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6e972a7a-d05a-4387-8d22-5e5b0c08b9a3" returned: 0 in 0.574s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:01 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-5f5d4e79-79ef-4f4c-8eb6-cc10b7be8c72 tempest-CreateVolumesFromSnapshotTest-1887340981 None] <== create_volume: return (1461ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:18:01 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-5f5d4e79-79ef-4f4c-8eb6-cc10b7be8c72 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.465s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:18:01 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-a94fbd4e-60af-4f27-8af0-379e82579f5a tempest-CreateVolumesFromSnapshotTest-1887340981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.676s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:18:01 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-a94fbd4e-60af-4f27-8af0-379e82579f5a tempest-CreateVolumesFromSnapshotTest-1887340981 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:17:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1981195330',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d68fa99-49cd-4f79-9601-8c300b594c28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='609f6249a87f4b5eb1ea4978d34fdb2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:17:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:17:48Z,use_quota=True,user_id='ab1cae9809144a3f925f6115d5ac18d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:18:01 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-a94fbd4e-60af-4f27-8af0-379e82579f5a tempest-CreateVolumesFromSnapshotTest-1887340981 None] Creating volume 9d68fa99-49cd-4f79-9601-8c300b594c28 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:18:01 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-a94fbd4e-60af-4f27-8af0-379e82579f5a tempest-CreateVolumesFromSnapshotTest-1887340981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:18:01 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-a94fbd4e-60af-4f27-8af0-379e82579f5a tempest-CreateVolumesFromSnapshotTest-1887340981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:18:01 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-a94fbd4e-60af-4f27-8af0-379e82579f5a tempest-CreateVolumesFromSnapshotTest-1887340981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:18:01 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-a94fbd4e-60af-4f27-8af0-379e82579f5a tempest-CreateVolumesFromSnapshotTest-1887340981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:18:01 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-a94fbd4e-60af-4f27-8af0-379e82579f5a tempest-CreateVolumesFromSnapshotTest-1887340981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:18:01 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-a94fbd4e-60af-4f27-8af0-379e82579f5a tempest-CreateVolumesFromSnapshotTest-1887340981 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:18:01 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-a94fbd4e-60af-4f27-8af0-379e82579f5a tempest-CreateVolumesFromSnapshotTest-1887340981 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:18:01 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a94fbd4e-60af-4f27-8af0-379e82579f5a tempest-CreateVolumesFromSnapshotTest-1887340981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9d68fa99-49cd-4f79-9601-8c300b594c28 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:01 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5f5d4e79-79ef-4f4c-8eb6-cc10b7be8c72 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8258371-58f1-4002-ba1c-3eebd6c4e776) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e972a7a-d05a-4387-8d22-5e5b0c08b9a3', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:18:01 devstack sudo[93163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9d68fa99-49cd-4f79-9601-8c300b594c28 1073741824
Apr 28 22:18:01 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5f5d4e79-79ef-4f4c-8eb6-cc10b7be8c72 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f51dbde0-100e-48db-95cc-0db56ca77702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:18:01 devstack sudo[93163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:01 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-5f5d4e79-79ef-4f4c-8eb6-cc10b7be8c72 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Volume volume-6e972a7a-d05a-4387-8d22-5e5b0c08b9a3 (6e972a7a-d05a-4387-8d22-5e5b0c08b9a3): created successfully
Apr 28 22:18:01 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5f5d4e79-79ef-4f4c-8eb6-cc10b7be8c72 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f51dbde0-100e-48db-95cc-0db56ca77702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:18:01 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5f5d4e79-79ef-4f4c-8eb6-cc10b7be8c72 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Flow 'volume_create_manager' (c6356b1a-80d5-4e98-b825-901188962192) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:18:01 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-5f5d4e79-79ef-4f4c-8eb6-cc10b7be8c72 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Created volume successfully.
Apr 28 22:18:02 devstack sudo[93163]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:02 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a94fbd4e-60af-4f27-8af0-379e82579f5a tempest-CreateVolumesFromSnapshotTest-1887340981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9d68fa99-49cd-4f79-9601-8c300b594c28 1073741824" returned: 0 in 0.851s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:02 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a94fbd4e-60af-4f27-8af0-379e82579f5a tempest-CreateVolumesFromSnapshotTest-1887340981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9d68fa99-49cd-4f79-9601-8c300b594c28 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:02 devstack sudo[93169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9d68fa99-49cd-4f79-9601-8c300b594c28
Apr 28 22:18:02 devstack sudo[93169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:02 devstack sudo[93169]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:02 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a94fbd4e-60af-4f27-8af0-379e82579f5a tempest-CreateVolumesFromSnapshotTest-1887340981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9d68fa99-49cd-4f79-9601-8c300b594c28" returned: 0 in 0.606s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:02 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-a94fbd4e-60af-4f27-8af0-379e82579f5a tempest-CreateVolumesFromSnapshotTest-1887340981 None] <== create_volume: return (1493ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:18:02 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-a94fbd4e-60af-4f27-8af0-379e82579f5a tempest-CreateVolumesFromSnapshotTest-1887340981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.496s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:18:02 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-5052327e-758b-4518-a042-09fe0986a9d9 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.263s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:18:02 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-5052327e-758b-4518-a042-09fe0986a9d9 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-187402997',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa1b7451-775c-4219-859f-637b95dc0880,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2711656dd43e4a739ef5844f8ca2783d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:17:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:17:53Z,use_quota=True,user_id='951162fa6f8243f1b141d4ce1f760b3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:18:02 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-5052327e-758b-4518-a042-09fe0986a9d9 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Creating volume aa1b7451-775c-4219-859f-637b95dc0880 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:18:02 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-5052327e-758b-4518-a042-09fe0986a9d9 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:18:02 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-5052327e-758b-4518-a042-09fe0986a9d9 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:18:02 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-5052327e-758b-4518-a042-09fe0986a9d9 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:18:02 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-5052327e-758b-4518-a042-09fe0986a9d9 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:18:02 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-5052327e-758b-4518-a042-09fe0986a9d9 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:18:02 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-5052327e-758b-4518-a042-09fe0986a9d9 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:18:02 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-5052327e-758b-4518-a042-09fe0986a9d9 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:18:02 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5052327e-758b-4518-a042-09fe0986a9d9 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-aa1b7451-775c-4219-859f-637b95dc0880 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:02 devstack sudo[93172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-aa1b7451-775c-4219-859f-637b95dc0880 1073741824
Apr 28 22:18:02 devstack sudo[93172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:03 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a94fbd4e-60af-4f27-8af0-379e82579f5a tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a8e6ba3-3bae-4736-9111-d314413cae1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d68fa99-49cd-4f79-9601-8c300b594c28', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:18:03 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a94fbd4e-60af-4f27-8af0-379e82579f5a tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28f03adb-7f10-4bf5-bbf2-c7ecf156b6e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:18:03 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-a94fbd4e-60af-4f27-8af0-379e82579f5a tempest-CreateVolumesFromSnapshotTest-1887340981 None] Volume volume-9d68fa99-49cd-4f79-9601-8c300b594c28 (9d68fa99-49cd-4f79-9601-8c300b594c28): created successfully
Apr 28 22:18:03 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a94fbd4e-60af-4f27-8af0-379e82579f5a tempest-CreateVolumesFromSnapshotTest-1887340981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28f03adb-7f10-4bf5-bbf2-c7ecf156b6e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:18:03 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-a94fbd4e-60af-4f27-8af0-379e82579f5a tempest-CreateVolumesFromSnapshotTest-1887340981 None] Flow 'volume_create_manager' (f8fac70a-ecae-401c-8d51-bbcbebfe3fc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:18:03 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-a94fbd4e-60af-4f27-8af0-379e82579f5a tempest-CreateVolumesFromSnapshotTest-1887340981 None] Created volume successfully.
Apr 28 22:18:03 devstack sudo[93172]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:03 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5052327e-758b-4518-a042-09fe0986a9d9 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-aa1b7451-775c-4219-859f-637b95dc0880 1073741824" returned: 0 in 0.734s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:03 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5052327e-758b-4518-a042-09fe0986a9d9 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-aa1b7451-775c-4219-859f-637b95dc0880 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:03 devstack sudo[93179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-aa1b7451-775c-4219-859f-637b95dc0880
Apr 28 22:18:03 devstack sudo[93179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:04 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-203fd40b-adef-43e5-b834-b820cc46058d tempest-CreateVolumesFromSnapshotTest-1887340981 None] Acquiring lock "cinder-9d68fa99-49cd-4f79-9601-8c300b594c28-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:18:04 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-203fd40b-adef-43e5-b834-b820cc46058d tempest-CreateVolumesFromSnapshotTest-1887340981 None] Lock "cinder-9d68fa99-49cd-4f79-9601-8c300b594c28-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:18:04 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-203fd40b-adef-43e5-b834-b820cc46058d tempest-CreateVolumesFromSnapshotTest-1887340981 None] Acquiring lock "cinder-quobyte-9d68fa99-49cd-4f79-9601-8c300b594c28" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:18:04 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-203fd40b-adef-43e5-b834-b820cc46058d tempest-CreateVolumesFromSnapshotTest-1887340981 None] Lock "cinder-quobyte-9d68fa99-49cd-4f79-9601-8c300b594c28" acquired by "delete_volume" :: waited 0.021s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:18:04 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[97066604-1131-42f1-be0c-4985d04aeb34]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:18:04 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-203fd40b-adef-43e5-b834-b820cc46058d tempest-CreateVolumesFromSnapshotTest-1887340981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9d68fa99-49cd-4f79-9601-8c300b594c28 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:04 devstack sudo[93179]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:04 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5052327e-758b-4518-a042-09fe0986a9d9 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-aa1b7451-775c-4219-859f-637b95dc0880" returned: 0 in 0.596s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:04 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-5052327e-758b-4518-a042-09fe0986a9d9 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] <== create_volume: return (1370ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:18:04 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-5052327e-758b-4518-a042-09fe0986a9d9 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.373s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:18:04 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b6e75392-6df7-4c52-88cb-5d2d211fa6f3 tempest-SnapshotDependencyTests-1655070008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.772s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:18:04 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5052327e-758b-4518-a042-09fe0986a9d9 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca1d023d-85fe-4453-a7af-eb23f2ebbf2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa1b7451-775c-4219-859f-637b95dc0880', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:18:04 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5052327e-758b-4518-a042-09fe0986a9d9 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70f3c31e-dcad-47f8-8617-5b619429f665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:18:04 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-b6e75392-6df7-4c52-88cb-5d2d211fa6f3 tempest-SnapshotDependencyTests-1655070008 None] Creating offline snapshot ba907c32-46e1-4cd8-b0cc-00e03f90538d of volume 123a3412-28f5-42ca-9424-50f31049250d {{(pid=83924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 22:18:04 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-5052327e-758b-4518-a042-09fe0986a9d9 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Volume volume-aa1b7451-775c-4219-859f-637b95dc0880 (aa1b7451-775c-4219-859f-637b95dc0880): created successfully
Apr 28 22:18:04 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5052327e-758b-4518-a042-09fe0986a9d9 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70f3c31e-dcad-47f8-8617-5b619429f665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:18:04 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5052327e-758b-4518-a042-09fe0986a9d9 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Flow 'volume_create_manager' (e3b28bad-f487-4f15-ba32-ca419ea16464) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:18:04 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[37acf1a0-78e7-40d0-8939-7aa74e9bd6c8]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:18:04 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b6e75392-6df7-4c52-88cb-5d2d211fa6f3 tempest-SnapshotDependencyTests-1655070008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-123a3412-28f5-42ca-9424-50f31049250d {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:04 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-5052327e-758b-4518-a042-09fe0986a9d9 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Created volume successfully.
Apr 28 22:18:04 devstack sudo[93182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9d68fa99-49cd-4f79-9601-8c300b594c28
Apr 28 22:18:04 devstack sudo[93182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:04 devstack sudo[93183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-123a3412-28f5-42ca-9424-50f31049250d
Apr 28 22:18:04 devstack sudo[93183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:05 devstack sudo[93182]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:05 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-203fd40b-adef-43e5-b834-b820cc46058d tempest-CreateVolumesFromSnapshotTest-1887340981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9d68fa99-49cd-4f79-9601-8c300b594c28" returned: 0 in 0.708s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:05 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-203fd40b-adef-43e5-b834-b820cc46058d tempest-CreateVolumesFromSnapshotTest-1887340981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9d68fa99-49cd-4f79-9601-8c300b594c28 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:05 devstack sudo[93192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9d68fa99-49cd-4f79-9601-8c300b594c28
Apr 28 22:18:05 devstack sudo[93192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:05 devstack sudo[93183]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:05 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b6e75392-6df7-4c52-88cb-5d2d211fa6f3 tempest-SnapshotDependencyTests-1655070008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-123a3412-28f5-42ca-9424-50f31049250d" returned: 0 in 0.679s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:05 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b6e75392-6df7-4c52-88cb-5d2d211fa6f3 tempest-SnapshotDependencyTests-1655070008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-123a3412-28f5-42ca-9424-50f31049250d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-123a3412-28f5-42ca-9424-50f31049250d.ba907c32-46e1-4cd8-b0cc-00e03f90538d 1G {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:05 devstack sudo[93194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-123a3412-28f5-42ca-9424-50f31049250d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-123a3412-28f5-42ca-9424-50f31049250d.ba907c32-46e1-4cd8-b0cc-00e03f90538d 1G
Apr 28 22:18:05 devstack sudo[93194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:05 devstack sudo[93192]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:05 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-203fd40b-adef-43e5-b834-b820cc46058d tempest-CreateVolumesFromSnapshotTest-1887340981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9d68fa99-49cd-4f79-9601-8c300b594c28" returned: 0 in 0.572s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:05 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-203fd40b-adef-43e5-b834-b820cc46058d tempest-CreateVolumesFromSnapshotTest-1887340981 None] Lock "cinder-quobyte-9d68fa99-49cd-4f79-9601-8c300b594c28" released by "delete_volume" :: held 1.322s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:18:05 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-203fd40b-adef-43e5-b834-b820cc46058d tempest-CreateVolumesFromSnapshotTest-1887340981 None] Created reservations ['1caf352d-8239-4941-a5ea-1a72d63d9438', '040ff7b9-6e70-48a9-9079-e50c3f091825', 'e1ad2765-61c7-4732-8a4c-e49e91c67b48', 'ae18dcf8-8754-4e16-9724-62adbea9fcc6'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:18:05 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-203fd40b-adef-43e5-b834-b820cc46058d tempest-CreateVolumesFromSnapshotTest-1887340981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:18:05 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-203fd40b-adef-43e5-b834-b820cc46058d tempest-CreateVolumesFromSnapshotTest-1887340981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:18:05 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-203fd40b-adef-43e5-b834-b820cc46058d tempest-CreateVolumesFromSnapshotTest-1887340981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:18:05 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-203fd40b-adef-43e5-b834-b820cc46058d tempest-CreateVolumesFromSnapshotTest-1887340981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:18:05 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-203fd40b-adef-43e5-b834-b820cc46058d tempest-CreateVolumesFromSnapshotTest-1887340981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:18:05 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-203fd40b-adef-43e5-b834-b820cc46058d tempest-CreateVolumesFromSnapshotTest-1887340981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:05 devstack sudo[93200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:18:05 devstack sudo[93200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:05 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-82edc0c3-5000-4110-9959-bed3bdd07a6a tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:18:05 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-82edc0c3-5000-4110-9959-bed3bdd07a6a tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Flow 'volume_create_manager' (caad4ab9-42a4-4cde-b166-26f7c7af750e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:18:05 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-82edc0c3-5000-4110-9959-bed3bdd07a6a tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c5d1a2a-ef73-426a-9688-b010d11ccfec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:18:05 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-82edc0c3-5000-4110-9959-bed3bdd07a6a tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c5d1a2a-ef73-426a-9688-b010d11ccfec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:18:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-116467957',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da4d9bf6-66e3-484b-9fdd-09e8641ba342,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2711656dd43e4a739ef5844f8ca2783d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:18:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:18:06Z,use_quota=True,user_id='951162fa6f8243f1b141d4ce1f760b3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:18:05 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-82edc0c3-5000-4110-9959-bed3bdd07a6a tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92af4e35-f397-41a2-a6a9-57ff9d7d7403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:18:05 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-82edc0c3-5000-4110-9959-bed3bdd07a6a tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92af4e35-f397-41a2-a6a9-57ff9d7d7403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:18:05 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-82edc0c3-5000-4110-9959-bed3bdd07a6a tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ac1eb02-7a8b-442f-aee2-1340989a2334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:18:05 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-82edc0c3-5000-4110-9959-bed3bdd07a6a tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ac1eb02-7a8b-442f-aee2-1340989a2334) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da4d9bf6-66e3-484b-9fdd-09e8641ba342', 'volume_name': 'volume-da4d9bf6-66e3-484b-9fdd-09e8641ba342', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:18:05 devstack sudo[93194]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:05 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-82edc0c3-5000-4110-9959-bed3bdd07a6a tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee4689b2-1ef5-469c-b7ef-fca0ba42eadd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:18:06 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-82edc0c3-5000-4110-9959-bed3bdd07a6a tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee4689b2-1ef5-469c-b7ef-fca0ba42eadd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:18:06 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-82edc0c3-5000-4110-9959-bed3bdd07a6a tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3de51d0-fa7b-4c7e-b152-ff378e1b13f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:18:06 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-82edc0c3-5000-4110-9959-bed3bdd07a6a tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Volume da4d9bf6-66e3-484b-9fdd-09e8641ba342: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da4d9bf6-66e3-484b-9fdd-09e8641ba342', 'volume_size': 1}
Apr 28 22:18:06 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-82edc0c3-5000-4110-9959-bed3bdd07a6a tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:18:06 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b6e75392-6df7-4c52-88cb-5d2d211fa6f3 tempest-SnapshotDependencyTests-1655070008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-123a3412-28f5-42ca-9424-50f31049250d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-123a3412-28f5-42ca-9424-50f31049250d.ba907c32-46e1-4cd8-b0cc-00e03f90538d 1G" returned: 0 in 0.919s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:06 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b6e75392-6df7-4c52-88cb-5d2d211fa6f3 tempest-SnapshotDependencyTests-1655070008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-123a3412-28f5-42ca-9424-50f31049250d -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-123a3412-28f5-42ca-9424-50f31049250d.ba907c32-46e1-4cd8-b0cc-00e03f90538d {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:06 devstack sudo[93203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-123a3412-28f5-42ca-9424-50f31049250d -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-123a3412-28f5-42ca-9424-50f31049250d.ba907c32-46e1-4cd8-b0cc-00e03f90538d
Apr 28 22:18:06 devstack sudo[93203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:06 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ffc3a3c-7221-4bf9-95b6-b9ad3d453d2b tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:18:06 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5ffc3a3c-7221-4bf9-95b6-b9ad3d453d2b tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Flow 'volume_create_manager' (3af54ba8-db5c-4725-9a47-695d73d8d01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:18:06 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5ffc3a3c-7221-4bf9-95b6-b9ad3d453d2b tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f42aab62-200f-4a56-80cd-847063e0d9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:18:06 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5ffc3a3c-7221-4bf9-95b6-b9ad3d453d2b tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f42aab62-200f-4a56-80cd-847063e0d9f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:18:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1518744979',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7c0a4d8-61b9-407b-93b2-82a6ff31befc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2711656dd43e4a739ef5844f8ca2783d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:18:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:18:06Z,use_quota=True,user_id='951162fa6f8243f1b141d4ce1f760b3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:18:06 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5ffc3a3c-7221-4bf9-95b6-b9ad3d453d2b tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (675b7a59-9e48-46d3-a532-1fb9de008ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:18:06 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5ffc3a3c-7221-4bf9-95b6-b9ad3d453d2b tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (675b7a59-9e48-46d3-a532-1fb9de008ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:18:06 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5ffc3a3c-7221-4bf9-95b6-b9ad3d453d2b tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c4188d6-7e0f-464a-86ea-397bf3d3a086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:18:06 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5ffc3a3c-7221-4bf9-95b6-b9ad3d453d2b tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c4188d6-7e0f-464a-86ea-397bf3d3a086) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7c0a4d8-61b9-407b-93b2-82a6ff31befc', 'volume_name': 'volume-c7c0a4d8-61b9-407b-93b2-82a6ff31befc', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:18:06 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5ffc3a3c-7221-4bf9-95b6-b9ad3d453d2b tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (768c8ebb-4f1a-4771-b5e9-a45eaaa6fa85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:18:06 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5ffc3a3c-7221-4bf9-95b6-b9ad3d453d2b tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (768c8ebb-4f1a-4771-b5e9-a45eaaa6fa85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:18:06 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5ffc3a3c-7221-4bf9-95b6-b9ad3d453d2b tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc45e754-4e1a-43de-845b-a8881ff8bb61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:18:06 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-5ffc3a3c-7221-4bf9-95b6-b9ad3d453d2b tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Volume c7c0a4d8-61b9-407b-93b2-82a6ff31befc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7c0a4d8-61b9-407b-93b2-82a6ff31befc', 'volume_size': 1}
Apr 28 22:18:06 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-5ffc3a3c-7221-4bf9-95b6-b9ad3d453d2b tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:18:06 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-7529553c-7248-48fa-a8b3-aa5e50fca6ea tempest-CreateVolumesFromSnapshotTest-1887340981 None] Acquiring lock "cinder-6e972a7a-d05a-4387-8d22-5e5b0c08b9a3-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:18:06 devstack sudo[93200]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:06 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-203fd40b-adef-43e5-b834-b820cc46058d tempest-CreateVolumesFromSnapshotTest-1887340981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.750s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:06 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-203fd40b-adef-43e5-b834-b820cc46058d tempest-CreateVolumesFromSnapshotTest-1887340981 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:18:06 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-7529553c-7248-48fa-a8b3-aa5e50fca6ea tempest-CreateVolumesFromSnapshotTest-1887340981 None] Lock "cinder-6e972a7a-d05a-4387-8d22-5e5b0c08b9a3-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:18:06 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-203fd40b-adef-43e5-b834-b820cc46058d tempest-CreateVolumesFromSnapshotTest-1887340981 None] Deleted volume successfully.
Apr 28 22:18:06 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-203fd40b-adef-43e5-b834-b820cc46058d tempest-CreateVolumesFromSnapshotTest-1887340981 None] Lock "cinder-9d68fa99-49cd-4f79-9601-8c300b594c28-delete_volume" released by "delete_volume" :: held 2.358s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:18:06 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-7529553c-7248-48fa-a8b3-aa5e50fca6ea tempest-CreateVolumesFromSnapshotTest-1887340981 None] Acquiring lock "cinder-quobyte-6e972a7a-d05a-4387-8d22-5e5b0c08b9a3" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:18:06 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-7529553c-7248-48fa-a8b3-aa5e50fca6ea tempest-CreateVolumesFromSnapshotTest-1887340981 None] Lock "cinder-quobyte-6e972a7a-d05a-4387-8d22-5e5b0c08b9a3" acquired by "delete_volume" :: waited 0.028s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:18:06 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0580a1b7-9829-4dd7-a381-c3d7ddb13460]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:18:06 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7529553c-7248-48fa-a8b3-aa5e50fca6ea tempest-CreateVolumesFromSnapshotTest-1887340981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6e972a7a-d05a-4387-8d22-5e5b0c08b9a3 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:06 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-385372f0-0d85-4fcd-8cba-885966d55186 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:18:06 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-385372f0-0d85-4fcd-8cba-885966d55186 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Flow 'volume_create_manager' (4c3c4acd-4c9b-40eb-af04-10b04fee465d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:18:06 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-385372f0-0d85-4fcd-8cba-885966d55186 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16bce144-c957-419a-b0ab-6c32f1468cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:18:06 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-385372f0-0d85-4fcd-8cba-885966d55186 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16bce144-c957-419a-b0ab-6c32f1468cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:18:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-803170565',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e559b32a-872a-4d11-9e86-966fb3c88d0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2711656dd43e4a739ef5844f8ca2783d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:18:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:18:07Z,use_quota=True,user_id='951162fa6f8243f1b141d4ce1f760b3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:18:06 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-385372f0-0d85-4fcd-8cba-885966d55186 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a6ae1bf-91a5-473b-aef3-8f2a25004ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:18:06 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-385372f0-0d85-4fcd-8cba-885966d55186 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a6ae1bf-91a5-473b-aef3-8f2a25004ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:18:06 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-385372f0-0d85-4fcd-8cba-885966d55186 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10e0bcfe-bf9b-4a4f-9a64-efdc80a48502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:18:06 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-385372f0-0d85-4fcd-8cba-885966d55186 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10e0bcfe-bf9b-4a4f-9a64-efdc80a48502) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e559b32a-872a-4d11-9e86-966fb3c88d0d', 'volume_name': 'volume-e559b32a-872a-4d11-9e86-966fb3c88d0d', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:18:06 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-385372f0-0d85-4fcd-8cba-885966d55186 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e3c4d95-b4ed-4332-9ceb-a8f03fb90ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:18:06 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-385372f0-0d85-4fcd-8cba-885966d55186 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e3c4d95-b4ed-4332-9ceb-a8f03fb90ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:18:06 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-385372f0-0d85-4fcd-8cba-885966d55186 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5dbf67c-e19f-4f22-bf64-c6c4d4c6af95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:18:06 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-385372f0-0d85-4fcd-8cba-885966d55186 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Volume e559b32a-872a-4d11-9e86-966fb3c88d0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e559b32a-872a-4d11-9e86-966fb3c88d0d', 'volume_size': 1}
Apr 28 22:18:06 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-385372f0-0d85-4fcd-8cba-885966d55186 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:18:06 devstack sudo[93210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6e972a7a-d05a-4387-8d22-5e5b0c08b9a3
Apr 28 22:18:06 devstack sudo[93210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:06 devstack sudo[93203]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:06 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b6e75392-6df7-4c52-88cb-5d2d211fa6f3 tempest-SnapshotDependencyTests-1655070008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-123a3412-28f5-42ca-9424-50f31049250d -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-123a3412-28f5-42ca-9424-50f31049250d.ba907c32-46e1-4cd8-b0cc-00e03f90538d" returned: 0 in 0.824s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:06 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-b6e75392-6df7-4c52-88cb-5d2d211fa6f3 tempest-SnapshotDependencyTests-1655070008 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-123a3412-28f5-42ca-9424-50f31049250d.ba907c32-46e1-4cd8-b0cc-00e03f90538d is being set with open permissions: ugo+rw
Apr 28 22:18:06 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b6e75392-6df7-4c52-88cb-5d2d211fa6f3 tempest-SnapshotDependencyTests-1655070008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-123a3412-28f5-42ca-9424-50f31049250d.ba907c32-46e1-4cd8-b0cc-00e03f90538d {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:06 devstack sudo[93212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-123a3412-28f5-42ca-9424-50f31049250d.ba907c32-46e1-4cd8-b0cc-00e03f90538d
Apr 28 22:18:06 devstack sudo[93212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:07 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-f210eb1b-34bd-4c15-b061-64ad965b8ac4 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:18:07 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f210eb1b-34bd-4c15-b061-64ad965b8ac4 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Flow 'volume_create_manager' (7bd1c6d3-46e3-4e79-8a4b-f8e9b7e162f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:18:07 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f210eb1b-34bd-4c15-b061-64ad965b8ac4 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80c7ab0b-d6a2-4f68-8219-3b94b6637b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:18:07 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f210eb1b-34bd-4c15-b061-64ad965b8ac4 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80c7ab0b-d6a2-4f68-8219-3b94b6637b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:18:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1005086921',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=398ea35d-aedc-4af3-b17a-51b42a813c97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2711656dd43e4a739ef5844f8ca2783d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:18:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:18:07Z,use_quota=True,user_id='951162fa6f8243f1b141d4ce1f760b3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:18:07 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f210eb1b-34bd-4c15-b061-64ad965b8ac4 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c02046c-723f-4eaa-a452-bb78df8301b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:18:07 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f210eb1b-34bd-4c15-b061-64ad965b8ac4 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c02046c-723f-4eaa-a452-bb78df8301b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:18:07 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f210eb1b-34bd-4c15-b061-64ad965b8ac4 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d781a77-12f0-43c3-97ac-bdf8e9892783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:18:07 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f210eb1b-34bd-4c15-b061-64ad965b8ac4 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d781a77-12f0-43c3-97ac-bdf8e9892783) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '398ea35d-aedc-4af3-b17a-51b42a813c97', 'volume_name': 'volume-398ea35d-aedc-4af3-b17a-51b42a813c97', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:18:07 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f210eb1b-34bd-4c15-b061-64ad965b8ac4 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8b37ac4-276b-413e-8f54-e97b725310d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:18:07 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f210eb1b-34bd-4c15-b061-64ad965b8ac4 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8b37ac4-276b-413e-8f54-e97b725310d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:18:07 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f210eb1b-34bd-4c15-b061-64ad965b8ac4 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8fd2edc-265c-4245-9a2e-1ac83caf029d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:18:07 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-f210eb1b-34bd-4c15-b061-64ad965b8ac4 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Volume 398ea35d-aedc-4af3-b17a-51b42a813c97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-398ea35d-aedc-4af3-b17a-51b42a813c97', 'volume_size': 1}
Apr 28 22:18:07 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f210eb1b-34bd-4c15-b061-64ad965b8ac4 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:18:07 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-3042bdc1-b775-4442-9fcd-ddd86e06e89f tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:18:07 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3042bdc1-b775-4442-9fcd-ddd86e06e89f tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Flow 'volume_create_manager' (ea34a47e-8224-437b-9578-f7e4e2af1ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:18:07 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3042bdc1-b775-4442-9fcd-ddd86e06e89f tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7964f5d-a7d4-41c2-b4d4-9f71ed7d6701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:18:07 devstack sudo[93210]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:07 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3042bdc1-b775-4442-9fcd-ddd86e06e89f tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7964f5d-a7d4-41c2-b4d4-9f71ed7d6701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:18:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-120706333',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b54da303-6fda-43d7-89b6-18a66f1f9408,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2711656dd43e4a739ef5844f8ca2783d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:18:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:18:07Z,use_quota=True,user_id='951162fa6f8243f1b141d4ce1f760b3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:18:07 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3042bdc1-b775-4442-9fcd-ddd86e06e89f tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (702f44e8-b5d4-4cbb-adc4-4cb75661437e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:18:07 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3042bdc1-b775-4442-9fcd-ddd86e06e89f tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (702f44e8-b5d4-4cbb-adc4-4cb75661437e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:18:07 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3042bdc1-b775-4442-9fcd-ddd86e06e89f tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b9b28bb-16ff-4895-8352-46e61d2ccd73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:18:07 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3042bdc1-b775-4442-9fcd-ddd86e06e89f tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b9b28bb-16ff-4895-8352-46e61d2ccd73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b54da303-6fda-43d7-89b6-18a66f1f9408', 'volume_name': 'volume-b54da303-6fda-43d7-89b6-18a66f1f9408', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:18:07 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3042bdc1-b775-4442-9fcd-ddd86e06e89f tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48fbc547-c46a-46f0-b848-deba0f1a4b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:18:07 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3042bdc1-b775-4442-9fcd-ddd86e06e89f tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48fbc547-c46a-46f0-b848-deba0f1a4b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:18:07 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3042bdc1-b775-4442-9fcd-ddd86e06e89f tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8ee4d34-3c7a-446b-834f-3acb06b14a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:18:07 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-3042bdc1-b775-4442-9fcd-ddd86e06e89f tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Volume b54da303-6fda-43d7-89b6-18a66f1f9408: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b54da303-6fda-43d7-89b6-18a66f1f9408', 'volume_size': 1}
Apr 28 22:18:07 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-3042bdc1-b775-4442-9fcd-ddd86e06e89f tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:18:07 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7529553c-7248-48fa-a8b3-aa5e50fca6ea tempest-CreateVolumesFromSnapshotTest-1887340981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6e972a7a-d05a-4387-8d22-5e5b0c08b9a3" returned: 0 in 0.857s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:07 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7529553c-7248-48fa-a8b3-aa5e50fca6ea tempest-CreateVolumesFromSnapshotTest-1887340981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6e972a7a-d05a-4387-8d22-5e5b0c08b9a3 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:07 devstack sudo[93218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6e972a7a-d05a-4387-8d22-5e5b0c08b9a3
Apr 28 22:18:07 devstack sudo[93218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:07 devstack sudo[93212]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:07 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b6e75392-6df7-4c52-88cb-5d2d211fa6f3 tempest-SnapshotDependencyTests-1655070008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-123a3412-28f5-42ca-9424-50f31049250d.ba907c32-46e1-4cd8-b0cc-00e03f90538d" returned: 0 in 0.769s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:07 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b6e75392-6df7-4c52-88cb-5d2d211fa6f3 tempest-SnapshotDependencyTests-1655070008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-123a3412-28f5-42ca-9424-50f31049250d.info {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:07 devstack sudo[93220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-123a3412-28f5-42ca-9424-50f31049250d.info
Apr 28 22:18:07 devstack sudo[93220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:08 devstack sudo[93218]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:08 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7529553c-7248-48fa-a8b3-aa5e50fca6ea tempest-CreateVolumesFromSnapshotTest-1887340981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-6e972a7a-d05a-4387-8d22-5e5b0c08b9a3" returned: 0 in 0.623s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:08 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-7529553c-7248-48fa-a8b3-aa5e50fca6ea tempest-CreateVolumesFromSnapshotTest-1887340981 None] Lock "cinder-quobyte-6e972a7a-d05a-4387-8d22-5e5b0c08b9a3" released by "delete_volume" :: held 1.542s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:18:08 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-7529553c-7248-48fa-a8b3-aa5e50fca6ea tempest-CreateVolumesFromSnapshotTest-1887340981 None] Created reservations ['99007549-19b2-4f2c-b793-4801c7f1725e', '58a51443-5c55-41f9-9203-fead2cc5adc4', '2f18196c-a2e6-4a42-ae3b-eb3afbea3fef', 'b72c3d9a-77a6-48fb-9d51-37a6394a3c7a'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:18:08 devstack sudo[93220]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:08 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-7529553c-7248-48fa-a8b3-aa5e50fca6ea tempest-CreateVolumesFromSnapshotTest-1887340981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:18:08 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-7529553c-7248-48fa-a8b3-aa5e50fca6ea tempest-CreateVolumesFromSnapshotTest-1887340981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:18:08 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-7529553c-7248-48fa-a8b3-aa5e50fca6ea tempest-CreateVolumesFromSnapshotTest-1887340981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:18:08 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-7529553c-7248-48fa-a8b3-aa5e50fca6ea tempest-CreateVolumesFromSnapshotTest-1887340981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:18:08 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-7529553c-7248-48fa-a8b3-aa5e50fca6ea tempest-CreateVolumesFromSnapshotTest-1887340981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:18:08 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7529553c-7248-48fa-a8b3-aa5e50fca6ea tempest-CreateVolumesFromSnapshotTest-1887340981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:08 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b6e75392-6df7-4c52-88cb-5d2d211fa6f3 tempest-SnapshotDependencyTests-1655070008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-123a3412-28f5-42ca-9424-50f31049250d.info" returned: 0 in 0.648s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:08 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-b6e75392-6df7-4c52-88cb-5d2d211fa6f3 tempest-SnapshotDependencyTests-1655070008 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-123a3412-28f5-42ca-9424-50f31049250d.info is being set with open permissions: ugo+rw
Apr 28 22:18:08 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b6e75392-6df7-4c52-88cb-5d2d211fa6f3 tempest-SnapshotDependencyTests-1655070008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-123a3412-28f5-42ca-9424-50f31049250d.info {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:08 devstack sudo[93224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:18:08 devstack sudo[93224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:08 devstack sudo[93225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-123a3412-28f5-42ca-9424-50f31049250d.info
Apr 28 22:18:08 devstack sudo[93225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:08 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-d3870ef1-0d06-4015-a685-e9b93c8799d4 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Acquiring lock "cinder-8f755e5f-329b-46c3-bb71-0968006471b7-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:18:08 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-d3870ef1-0d06-4015-a685-e9b93c8799d4 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Lock "cinder-8f755e5f-329b-46c3-bb71-0968006471b7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:18:08 devstack sudo[93224]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:08 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-d3870ef1-0d06-4015-a685-e9b93c8799d4 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Acquiring lock "cinder-quobyte-8f755e5f-329b-46c3-bb71-0968006471b7" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:18:08 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-7529553c-7248-48fa-a8b3-aa5e50fca6ea tempest-CreateVolumesFromSnapshotTest-1887340981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.577s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:08 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-7529553c-7248-48fa-a8b3-aa5e50fca6ea tempest-CreateVolumesFromSnapshotTest-1887340981 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:18:08 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-7529553c-7248-48fa-a8b3-aa5e50fca6ea tempest-CreateVolumesFromSnapshotTest-1887340981 None] Deleted volume successfully.
Apr 28 22:18:08 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-d3870ef1-0d06-4015-a685-e9b93c8799d4 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Lock "cinder-quobyte-8f755e5f-329b-46c3-bb71-0968006471b7" acquired by "delete_volume" :: waited 0.035s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:18:08 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-7529553c-7248-48fa-a8b3-aa5e50fca6ea tempest-CreateVolumesFromSnapshotTest-1887340981 None] Lock "cinder-6e972a7a-d05a-4387-8d22-5e5b0c08b9a3-delete_volume" released by "delete_volume" :: held 2.369s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:18:08 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d50385-326e-4886-b727-3c201c06f9a3]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:18:08 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-d3870ef1-0d06-4015-a685-e9b93c8799d4 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8f755e5f-329b-46c3-bb71-0968006471b7 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:08 devstack sudo[93225]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:08 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b6e75392-6df7-4c52-88cb-5d2d211fa6f3 tempest-SnapshotDependencyTests-1655070008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-123a3412-28f5-42ca-9424-50f31049250d.info" returned: 0 in 0.647s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:08 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b6e75392-6df7-4c52-88cb-5d2d211fa6f3 tempest-SnapshotDependencyTests-1655070008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.607s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:18:08 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-6172d4bd-4ad5-4a00-9521-9b2d6ad2cbca tempest-VolumeDependencyTests-1826445949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.336s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:18:08 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-6172d4bd-4ad5-4a00-9521-9b2d6ad2cbca tempest-VolumeDependencyTests-1826445949 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:18:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-887369490',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f86ea68a-4896-4e7b-8160-d180e358d610,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0a8cf6e955c4797a45097f8aba2542e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:18:01Z,use_quota=True,user_id='8d0c1e1ebfa748e2b733fb77632a8e6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:18:08 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-6172d4bd-4ad5-4a00-9521-9b2d6ad2cbca tempest-VolumeDependencyTests-1826445949 None] Creating volume f86ea68a-4896-4e7b-8160-d180e358d610 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:18:08 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-6172d4bd-4ad5-4a00-9521-9b2d6ad2cbca tempest-VolumeDependencyTests-1826445949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:18:08 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-6172d4bd-4ad5-4a00-9521-9b2d6ad2cbca tempest-VolumeDependencyTests-1826445949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:18:08 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-6172d4bd-4ad5-4a00-9521-9b2d6ad2cbca tempest-VolumeDependencyTests-1826445949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:18:08 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-6172d4bd-4ad5-4a00-9521-9b2d6ad2cbca tempest-VolumeDependencyTests-1826445949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:18:08 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-6172d4bd-4ad5-4a00-9521-9b2d6ad2cbca tempest-VolumeDependencyTests-1826445949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:18:08 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-6172d4bd-4ad5-4a00-9521-9b2d6ad2cbca tempest-VolumeDependencyTests-1826445949 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:18:08 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-6172d4bd-4ad5-4a00-9521-9b2d6ad2cbca tempest-VolumeDependencyTests-1826445949 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:18:08 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-6172d4bd-4ad5-4a00-9521-9b2d6ad2cbca tempest-VolumeDependencyTests-1826445949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f86ea68a-4896-4e7b-8160-d180e358d610 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:08 devstack sudo[93231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f86ea68a-4896-4e7b-8160-d180e358d610 1073741824
Apr 28 22:18:08 devstack sudo[93231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:09 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-b6e75392-6df7-4c52-88cb-5d2d211fa6f3 tempest-SnapshotDependencyTests-1655070008 None] Create snapshot completed successfully
Apr 28 22:18:09 devstack sudo[93230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8f755e5f-329b-46c3-bb71-0968006471b7
Apr 28 22:18:09 devstack sudo[93230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:09 devstack sudo[93230]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:09 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-d3870ef1-0d06-4015-a685-e9b93c8799d4 tempest-CreateVolumesFromSnapshotTest-1887340981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8f755e5f-329b-46c3-bb71-0968006471b7" returned: 0 in 0.720s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:09 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-d3870ef1-0d06-4015-a685-e9b93c8799d4 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8f755e5f-329b-46c3-bb71-0968006471b7 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:09 devstack sudo[93240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8f755e5f-329b-46c3-bb71-0968006471b7
Apr 28 22:18:09 devstack sudo[93240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:09 devstack sudo[93231]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:09 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-6172d4bd-4ad5-4a00-9521-9b2d6ad2cbca tempest-VolumeDependencyTests-1826445949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f86ea68a-4896-4e7b-8160-d180e358d610 1073741824" returned: 0 in 0.823s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:09 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-6172d4bd-4ad5-4a00-9521-9b2d6ad2cbca tempest-VolumeDependencyTests-1826445949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f86ea68a-4896-4e7b-8160-d180e358d610 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:09 devstack sudo[93242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f86ea68a-4896-4e7b-8160-d180e358d610
Apr 28 22:18:09 devstack sudo[93242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:10 devstack sudo[93240]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:10 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-d3870ef1-0d06-4015-a685-e9b93c8799d4 tempest-CreateVolumesFromSnapshotTest-1887340981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-8f755e5f-329b-46c3-bb71-0968006471b7" returned: 0 in 0.591s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:10 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-d3870ef1-0d06-4015-a685-e9b93c8799d4 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Lock "cinder-quobyte-8f755e5f-329b-46c3-bb71-0968006471b7" released by "delete_volume" :: held 1.371s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:18:10 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-d3870ef1-0d06-4015-a685-e9b93c8799d4 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Created reservations ['4e2f13af-f5d8-4595-8220-3e373a0301a3', 'c59fac62-9d2f-4719-a005-0091e2374821', 'e7917818-6b56-4d6c-9ad3-2b3f00b54020', '15ec790d-b9cf-40a4-bcc0-16e204b7fdaa'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:18:10 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-d3870ef1-0d06-4015-a685-e9b93c8799d4 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:18:10 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-d3870ef1-0d06-4015-a685-e9b93c8799d4 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:18:10 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-d3870ef1-0d06-4015-a685-e9b93c8799d4 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:18:10 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-d3870ef1-0d06-4015-a685-e9b93c8799d4 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:18:10 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-d3870ef1-0d06-4015-a685-e9b93c8799d4 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:18:10 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-d3870ef1-0d06-4015-a685-e9b93c8799d4 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:10 devstack sudo[93248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:18:10 devstack sudo[93248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:10 devstack sudo[93242]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:10 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-6172d4bd-4ad5-4a00-9521-9b2d6ad2cbca tempest-VolumeDependencyTests-1826445949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f86ea68a-4896-4e7b-8160-d180e358d610" returned: 0 in 0.740s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:10 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-6172d4bd-4ad5-4a00-9521-9b2d6ad2cbca tempest-VolumeDependencyTests-1826445949 None] <== create_volume: return (1606ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:18:10 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-6172d4bd-4ad5-4a00-9521-9b2d6ad2cbca tempest-VolumeDependencyTests-1826445949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.609s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:18:10 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-82edc0c3-5000-4110-9959-bed3bdd07a6a tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.564s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:18:10 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-82edc0c3-5000-4110-9959-bed3bdd07a6a tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:18:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-116467957',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da4d9bf6-66e3-484b-9fdd-09e8641ba342,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2711656dd43e4a739ef5844f8ca2783d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:18:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:18:06Z,use_quota=True,user_id='951162fa6f8243f1b141d4ce1f760b3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:18:10 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-82edc0c3-5000-4110-9959-bed3bdd07a6a tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Creating volume da4d9bf6-66e3-484b-9fdd-09e8641ba342 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:18:10 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-82edc0c3-5000-4110-9959-bed3bdd07a6a tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:18:10 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-82edc0c3-5000-4110-9959-bed3bdd07a6a tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:18:10 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-82edc0c3-5000-4110-9959-bed3bdd07a6a tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:18:10 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-82edc0c3-5000-4110-9959-bed3bdd07a6a tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:18:10 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-82edc0c3-5000-4110-9959-bed3bdd07a6a tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:18:10 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-82edc0c3-5000-4110-9959-bed3bdd07a6a tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:18:10 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-82edc0c3-5000-4110-9959-bed3bdd07a6a tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:18:10 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-82edc0c3-5000-4110-9959-bed3bdd07a6a tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-da4d9bf6-66e3-484b-9fdd-09e8641ba342 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:10 devstack sudo[93250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-da4d9bf6-66e3-484b-9fdd-09e8641ba342 1073741824
Apr 28 22:18:10 devstack sudo[93250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:10 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-6172d4bd-4ad5-4a00-9521-9b2d6ad2cbca tempest-VolumeDependencyTests-1826445949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (007ee948-4ab6-4947-ac97-c5e4a0e342ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f86ea68a-4896-4e7b-8160-d180e358d610', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:18:10 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-6172d4bd-4ad5-4a00-9521-9b2d6ad2cbca tempest-VolumeDependencyTests-1826445949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4426121e-589a-4da5-8094-baa08a251eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:18:10 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-6172d4bd-4ad5-4a00-9521-9b2d6ad2cbca tempest-VolumeDependencyTests-1826445949 None] Volume volume-f86ea68a-4896-4e7b-8160-d180e358d610 (f86ea68a-4896-4e7b-8160-d180e358d610): created successfully
Apr 28 22:18:10 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-6172d4bd-4ad5-4a00-9521-9b2d6ad2cbca tempest-VolumeDependencyTests-1826445949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4426121e-589a-4da5-8094-baa08a251eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:18:10 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-6172d4bd-4ad5-4a00-9521-9b2d6ad2cbca tempest-VolumeDependencyTests-1826445949 None] Flow 'volume_create_manager' (11c11521-9e95-4f55-b06e-ea9589cf8def) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:18:10 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-6172d4bd-4ad5-4a00-9521-9b2d6ad2cbca tempest-VolumeDependencyTests-1826445949 None] Created volume successfully.
Apr 28 22:18:10 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-46fafcf6-ea49-4bc4-b189-7b8794f8287c tempest-SnapshotDependencyTests-1655070008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:18:10 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-46fafcf6-ea49-4bc4-b189-7b8794f8287c tempest-SnapshotDependencyTests-1655070008 None] Flow 'volume_create_manager' (d91dd677-1e53-4241-bc75-a03e4d2d52de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:18:10 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-46fafcf6-ea49-4bc4-b189-7b8794f8287c tempest-SnapshotDependencyTests-1655070008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f31c642e-c32c-4cca-9b24-3eadc85c016d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:18:10 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-46fafcf6-ea49-4bc4-b189-7b8794f8287c tempest-SnapshotDependencyTests-1655070008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f31c642e-c32c-4cca-9b24-3eadc85c016d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cd8af09-59bf-4e9c-884f-cdf4314c5fea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89e9a04687ff4a78be01c3f97445761b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ba907c32-46e1-4cd8-b0cc-00e03f90538d,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:18:11Z,use_quota=True,user_id='ee59c99401914f22a5a8072c96203521',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:18:10 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-46fafcf6-ea49-4bc4-b189-7b8794f8287c tempest-SnapshotDependencyTests-1655070008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (156841a6-88ba-40d7-83bf-aeab3491a7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:18:10 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-46fafcf6-ea49-4bc4-b189-7b8794f8287c tempest-SnapshotDependencyTests-1655070008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (156841a6-88ba-40d7-83bf-aeab3491a7eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:18:10 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-46fafcf6-ea49-4bc4-b189-7b8794f8287c tempest-SnapshotDependencyTests-1655070008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f787374-c131-4d73-ac01-7251864d94dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:18:10 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-46fafcf6-ea49-4bc4-b189-7b8794f8287c tempest-SnapshotDependencyTests-1655070008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f787374-c131-4d73-ac01-7251864d94dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9cd8af09-59bf-4e9c-884f-cdf4314c5fea', 'volume_name': 'volume-9cd8af09-59bf-4e9c-884f-cdf4314c5fea', 'volume_size': 1, 'snapshot_id': 'ba907c32-46e1-4cd8-b0cc-00e03f90538d'}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:18:10 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-46fafcf6-ea49-4bc4-b189-7b8794f8287c tempest-SnapshotDependencyTests-1655070008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40773977-91d0-455c-864c-35f5fee8daa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:18:10 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-46fafcf6-ea49-4bc4-b189-7b8794f8287c tempest-SnapshotDependencyTests-1655070008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40773977-91d0-455c-864c-35f5fee8daa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:18:10 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-46fafcf6-ea49-4bc4-b189-7b8794f8287c tempest-SnapshotDependencyTests-1655070008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f9a0717-49f7-462e-bd9d-86260ccb9c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:18:10 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-46fafcf6-ea49-4bc4-b189-7b8794f8287c tempest-SnapshotDependencyTests-1655070008 None] Volume 9cd8af09-59bf-4e9c-884f-cdf4314c5fea: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9cd8af09-59bf-4e9c-884f-cdf4314c5fea', 'volume_size': 1, 'snapshot_id': 'ba907c32-46e1-4cd8-b0cc-00e03f90538d'}
Apr 28 22:18:10 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-46fafcf6-ea49-4bc4-b189-7b8794f8287c tempest-SnapshotDependencyTests-1655070008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:18:11 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-dfb7e2b8-dcdf-4bec-9ee5-56540d36902b tempest-CreateVolumesFromSnapshotTest-1887340981 None] Acquiring lock "cinder-017e4c2c-4a63-425e-ab6c-c25b1234845e-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:18:11 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-dfb7e2b8-dcdf-4bec-9ee5-56540d36902b tempest-CreateVolumesFromSnapshotTest-1887340981 None] Lock "cinder-017e4c2c-4a63-425e-ab6c-c25b1234845e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:18:11 devstack sudo[93248]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:11 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-d3870ef1-0d06-4015-a685-e9b93c8799d4 tempest-CreateVolumesFromSnapshotTest-1887340981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.659s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:11 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-d3870ef1-0d06-4015-a685-e9b93c8799d4 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:18:11 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-d3870ef1-0d06-4015-a685-e9b93c8799d4 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Deleted volume successfully.
Apr 28 22:18:11 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-dfb7e2b8-dcdf-4bec-9ee5-56540d36902b tempest-CreateVolumesFromSnapshotTest-1887340981 None] Acquiring lock "cinder-quobyte-017e4c2c-4a63-425e-ab6c-c25b1234845e" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:18:11 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-d3870ef1-0d06-4015-a685-e9b93c8799d4 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Lock "cinder-8f755e5f-329b-46c3-bb71-0968006471b7-delete_volume" released by "delete_volume" :: held 2.320s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:18:11 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-dfb7e2b8-dcdf-4bec-9ee5-56540d36902b tempest-CreateVolumesFromSnapshotTest-1887340981 None] Lock "cinder-quobyte-017e4c2c-4a63-425e-ab6c-c25b1234845e" acquired by "delete_volume" :: waited 0.026s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:18:11 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[857c625f-e55c-468c-a536-baa504c8960f]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:18:11 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-dfb7e2b8-dcdf-4bec-9ee5-56540d36902b tempest-CreateVolumesFromSnapshotTest-1887340981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-017e4c2c-4a63-425e-ab6c-c25b1234845e {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:11 devstack sudo[93254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-017e4c2c-4a63-425e-ab6c-c25b1234845e
Apr 28 22:18:11 devstack sudo[93254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:11 devstack sudo[93250]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:11 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-82edc0c3-5000-4110-9959-bed3bdd07a6a tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-da4d9bf6-66e3-484b-9fdd-09e8641ba342 1073741824" returned: 0 in 0.918s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:11 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-82edc0c3-5000-4110-9959-bed3bdd07a6a tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-da4d9bf6-66e3-484b-9fdd-09e8641ba342 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:11 devstack sudo[93259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-da4d9bf6-66e3-484b-9fdd-09e8641ba342
Apr 28 22:18:11 devstack sudo[93259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:11 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:18:11 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] Flow 'volume_create_manager' (c0efc716-445e-4ed4-baec-08bc61c8ff9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:18:11 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e808e7b3-e536-48d3-bfca-b8a6d4ff4e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:18:11 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e808e7b3-e536-48d3-bfca-b8a6d4ff4e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-97998832',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=393c2e15-d39c-4500-9c9c-b256c87bb969,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0a8cf6e955c4797a45097f8aba2542e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=f86ea68a-4896-4e7b-8160-d180e358d610,status='creating',terminated_at=None,updated_at=2026-04-28T20:18:12Z,use_quota=True,user_id='8d0c1e1ebfa748e2b733fb77632a8e6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:18:11 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c0d25ce-81c2-4c8c-819d-e6dc657c0ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:18:11 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c0d25ce-81c2-4c8c-819d-e6dc657c0ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:18:11 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02e31662-86be-4c9f-9ed8-63bea2ae4577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:18:11 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02e31662-86be-4c9f-9ed8-63bea2ae4577) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '393c2e15-d39c-4500-9c9c-b256c87bb969', 'volume_name': 'volume-393c2e15-d39c-4500-9c9c-b256c87bb969', 'volume_size': 1, 'source_volid': 'f86ea68a-4896-4e7b-8160-d180e358d610', 'source_volstatus': 'available'}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:18:11 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbf3e003-2859-4dd9-b134-4af20ca5c825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:18:11 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbf3e003-2859-4dd9-b134-4af20ca5c825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:18:11 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4220b806-2a7b-490d-9605-8bad9727198a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:18:11 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] Volume 393c2e15-d39c-4500-9c9c-b256c87bb969: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-393c2e15-d39c-4500-9c9c-b256c87bb969', 'volume_size': 1, 'source_volid': 'f86ea68a-4896-4e7b-8160-d180e358d610', 'source_volstatus': 'available'}
Apr 28 22:18:11 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:18:11 devstack sudo[93254]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:11 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-dfb7e2b8-dcdf-4bec-9ee5-56540d36902b tempest-CreateVolumesFromSnapshotTest-1887340981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-017e4c2c-4a63-425e-ab6c-c25b1234845e" returned: 0 in 0.830s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:11 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-dfb7e2b8-dcdf-4bec-9ee5-56540d36902b tempest-CreateVolumesFromSnapshotTest-1887340981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-017e4c2c-4a63-425e-ab6c-c25b1234845e {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:12 devstack sudo[93264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-017e4c2c-4a63-425e-ab6c-c25b1234845e
Apr 28 22:18:12 devstack sudo[93264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:12 devstack sudo[93259]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:12 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-82edc0c3-5000-4110-9959-bed3bdd07a6a tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-da4d9bf6-66e3-484b-9fdd-09e8641ba342" returned: 0 in 0.692s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:12 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-82edc0c3-5000-4110-9959-bed3bdd07a6a tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] <== create_volume: return (1667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:18:12 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-82edc0c3-5000-4110-9959-bed3bdd07a6a tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.671s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:18:12 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-5ffc3a3c-7221-4bf9-95b6-b9ad3d453d2b tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.920s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:18:12 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-5ffc3a3c-7221-4bf9-95b6-b9ad3d453d2b tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:18:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1518744979',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7c0a4d8-61b9-407b-93b2-82a6ff31befc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2711656dd43e4a739ef5844f8ca2783d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:18:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:18:06Z,use_quota=True,user_id='951162fa6f8243f1b141d4ce1f760b3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:18:12 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-5ffc3a3c-7221-4bf9-95b6-b9ad3d453d2b tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Creating volume c7c0a4d8-61b9-407b-93b2-82a6ff31befc {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:18:12 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-5ffc3a3c-7221-4bf9-95b6-b9ad3d453d2b tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:18:12 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-5ffc3a3c-7221-4bf9-95b6-b9ad3d453d2b tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:18:12 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-5ffc3a3c-7221-4bf9-95b6-b9ad3d453d2b tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:18:12 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-5ffc3a3c-7221-4bf9-95b6-b9ad3d453d2b tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:18:12 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-5ffc3a3c-7221-4bf9-95b6-b9ad3d453d2b tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:18:12 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-5ffc3a3c-7221-4bf9-95b6-b9ad3d453d2b tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:18:12 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-5ffc3a3c-7221-4bf9-95b6-b9ad3d453d2b tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:18:12 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5ffc3a3c-7221-4bf9-95b6-b9ad3d453d2b tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-c7c0a4d8-61b9-407b-93b2-82a6ff31befc 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:12 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-82edc0c3-5000-4110-9959-bed3bdd07a6a tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3de51d0-fa7b-4c7e-b152-ff378e1b13f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da4d9bf6-66e3-484b-9fdd-09e8641ba342', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:18:12 devstack sudo[93267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-c7c0a4d8-61b9-407b-93b2-82a6ff31befc 1073741824
Apr 28 22:18:12 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-82edc0c3-5000-4110-9959-bed3bdd07a6a tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a94c083b-0a8c-4f43-bf9c-a59bf5e5666c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:18:12 devstack sudo[93267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:12 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-82edc0c3-5000-4110-9959-bed3bdd07a6a tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Volume volume-da4d9bf6-66e3-484b-9fdd-09e8641ba342 (da4d9bf6-66e3-484b-9fdd-09e8641ba342): created successfully
Apr 28 22:18:12 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-82edc0c3-5000-4110-9959-bed3bdd07a6a tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a94c083b-0a8c-4f43-bf9c-a59bf5e5666c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:18:12 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-82edc0c3-5000-4110-9959-bed3bdd07a6a tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Flow 'volume_create_manager' (caad4ab9-42a4-4cde-b166-26f7c7af750e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:18:12 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-82edc0c3-5000-4110-9959-bed3bdd07a6a tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Created volume successfully.
Apr 28 22:18:12 devstack sudo[93264]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:12 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-dfb7e2b8-dcdf-4bec-9ee5-56540d36902b tempest-CreateVolumesFromSnapshotTest-1887340981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-017e4c2c-4a63-425e-ab6c-c25b1234845e" returned: 0 in 0.579s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:12 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-dfb7e2b8-dcdf-4bec-9ee5-56540d36902b tempest-CreateVolumesFromSnapshotTest-1887340981 None] Lock "cinder-quobyte-017e4c2c-4a63-425e-ab6c-c25b1234845e" released by "delete_volume" :: held 1.450s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:18:12 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-dfb7e2b8-dcdf-4bec-9ee5-56540d36902b tempest-CreateVolumesFromSnapshotTest-1887340981 None] Created reservations ['1c6a99ce-3b48-4b13-8ef6-919aeaaf9394', '5e35922c-acdd-4f5a-b031-bc36940c533e', 'bd857495-c40a-45c8-a7bd-5a425245afb3', '00739f23-7a10-47fe-addc-5f2681ca888d'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:18:12 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-dfb7e2b8-dcdf-4bec-9ee5-56540d36902b tempest-CreateVolumesFromSnapshotTest-1887340981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:18:12 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-dfb7e2b8-dcdf-4bec-9ee5-56540d36902b tempest-CreateVolumesFromSnapshotTest-1887340981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:18:12 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-dfb7e2b8-dcdf-4bec-9ee5-56540d36902b tempest-CreateVolumesFromSnapshotTest-1887340981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:18:12 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-dfb7e2b8-dcdf-4bec-9ee5-56540d36902b tempest-CreateVolumesFromSnapshotTest-1887340981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:18:12 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-dfb7e2b8-dcdf-4bec-9ee5-56540d36902b tempest-CreateVolumesFromSnapshotTest-1887340981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:18:12 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-dfb7e2b8-dcdf-4bec-9ee5-56540d36902b tempest-CreateVolumesFromSnapshotTest-1887340981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:12 devstack sudo[93270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:18:12 devstack sudo[93270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:13 devstack sudo[93267]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:13 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5ffc3a3c-7221-4bf9-95b6-b9ad3d453d2b tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-c7c0a4d8-61b9-407b-93b2-82a6ff31befc 1073741824" returned: 0 in 0.799s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:13 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5ffc3a3c-7221-4bf9-95b6-b9ad3d453d2b tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-c7c0a4d8-61b9-407b-93b2-82a6ff31befc {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:13 devstack sudo[93276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-c7c0a4d8-61b9-407b-93b2-82a6ff31befc
Apr 28 22:18:13 devstack sudo[93276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:13 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-52a95fa0-ca8b-4e4a-91c7-947a809dae14 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Acquiring lock "cinder-dcf4d76d-4aae-4420-b048-579a08017922-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:18:13 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-52a95fa0-ca8b-4e4a-91c7-947a809dae14 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Lock "cinder-dcf4d76d-4aae-4420-b048-579a08017922-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:18:13 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-52a95fa0-ca8b-4e4a-91c7-947a809dae14 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Acquiring lock "cinder-quobyte-dcf4d76d-4aae-4420-b048-579a08017922" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:18:13 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-52a95fa0-ca8b-4e4a-91c7-947a809dae14 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Lock "cinder-quobyte-dcf4d76d-4aae-4420-b048-579a08017922" acquired by "delete_volume" :: waited 0.014s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:18:13 devstack sudo[93270]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:13 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-dfb7e2b8-dcdf-4bec-9ee5-56540d36902b tempest-CreateVolumesFromSnapshotTest-1887340981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.659s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:13 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-dfb7e2b8-dcdf-4bec-9ee5-56540d36902b tempest-CreateVolumesFromSnapshotTest-1887340981 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:18:13 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-dfb7e2b8-dcdf-4bec-9ee5-56540d36902b tempest-CreateVolumesFromSnapshotTest-1887340981 None] Deleted volume successfully.
Apr 28 22:18:13 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[7436128f-c839-4ef0-bc23-913509c3e32f]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:18:13 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-52a95fa0-ca8b-4e4a-91c7-947a809dae14 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-dcf4d76d-4aae-4420-b048-579a08017922 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:13 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-dfb7e2b8-dcdf-4bec-9ee5-56540d36902b tempest-CreateVolumesFromSnapshotTest-1887340981 None] Lock "cinder-017e4c2c-4a63-425e-ab6c-c25b1234845e-delete_volume" released by "delete_volume" :: held 2.341s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:18:13 devstack sudo[93280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-dcf4d76d-4aae-4420-b048-579a08017922
Apr 28 22:18:13 devstack sudo[93280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:13 devstack sudo[93276]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:13 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5ffc3a3c-7221-4bf9-95b6-b9ad3d453d2b tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-c7c0a4d8-61b9-407b-93b2-82a6ff31befc" returned: 0 in 0.619s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:13 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-5ffc3a3c-7221-4bf9-95b6-b9ad3d453d2b tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] <== create_volume: return (1466ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:18:13 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-5ffc3a3c-7221-4bf9-95b6-b9ad3d453d2b tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.469s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:18:13 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-385372f0-0d85-4fcd-8cba-885966d55186 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.924s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:18:13 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-385372f0-0d85-4fcd-8cba-885966d55186 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:18:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-803170565',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e559b32a-872a-4d11-9e86-966fb3c88d0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2711656dd43e4a739ef5844f8ca2783d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:18:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:18:07Z,use_quota=True,user_id='951162fa6f8243f1b141d4ce1f760b3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:18:13 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-385372f0-0d85-4fcd-8cba-885966d55186 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Creating volume e559b32a-872a-4d11-9e86-966fb3c88d0d {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:18:13 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-385372f0-0d85-4fcd-8cba-885966d55186 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:18:13 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-385372f0-0d85-4fcd-8cba-885966d55186 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:18:13 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-385372f0-0d85-4fcd-8cba-885966d55186 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:18:13 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-385372f0-0d85-4fcd-8cba-885966d55186 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:18:13 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-385372f0-0d85-4fcd-8cba-885966d55186 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:18:13 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-385372f0-0d85-4fcd-8cba-885966d55186 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:18:13 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-385372f0-0d85-4fcd-8cba-885966d55186 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:18:13 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-385372f0-0d85-4fcd-8cba-885966d55186 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-e559b32a-872a-4d11-9e86-966fb3c88d0d 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:13 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5ffc3a3c-7221-4bf9-95b6-b9ad3d453d2b tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc45e754-4e1a-43de-845b-a8881ff8bb61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7c0a4d8-61b9-407b-93b2-82a6ff31befc', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:18:13 devstack sudo[93283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-e559b32a-872a-4d11-9e86-966fb3c88d0d 1073741824
Apr 28 22:18:13 devstack sudo[93283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:13 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5ffc3a3c-7221-4bf9-95b6-b9ad3d453d2b tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b6206d9-c5a1-4f4a-9e25-7685b4af0754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:18:13 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-5ffc3a3c-7221-4bf9-95b6-b9ad3d453d2b tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Volume volume-c7c0a4d8-61b9-407b-93b2-82a6ff31befc (c7c0a4d8-61b9-407b-93b2-82a6ff31befc): created successfully
Apr 28 22:18:13 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5ffc3a3c-7221-4bf9-95b6-b9ad3d453d2b tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b6206d9-c5a1-4f4a-9e25-7685b4af0754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:18:13 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-5ffc3a3c-7221-4bf9-95b6-b9ad3d453d2b tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Flow 'volume_create_manager' (3af54ba8-db5c-4725-9a47-695d73d8d01d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:18:13 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-5ffc3a3c-7221-4bf9-95b6-b9ad3d453d2b tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Created volume successfully.
Apr 28 22:18:14 devstack sudo[93280]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:14 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-52a95fa0-ca8b-4e4a-91c7-947a809dae14 tempest-CreateVolumesFromSnapshotTest-1887340981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-dcf4d76d-4aae-4420-b048-579a08017922" returned: 0 in 0.714s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:14 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-52a95fa0-ca8b-4e4a-91c7-947a809dae14 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-dcf4d76d-4aae-4420-b048-579a08017922 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:14 devstack sudo[93288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-dcf4d76d-4aae-4420-b048-579a08017922
Apr 28 22:18:14 devstack sudo[93288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:14 devstack sudo[93283]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:14 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-385372f0-0d85-4fcd-8cba-885966d55186 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-e559b32a-872a-4d11-9e86-966fb3c88d0d 1073741824" returned: 0 in 0.828s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:14 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-385372f0-0d85-4fcd-8cba-885966d55186 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-e559b32a-872a-4d11-9e86-966fb3c88d0d {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:14 devstack sudo[93294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-e559b32a-872a-4d11-9e86-966fb3c88d0d
Apr 28 22:18:14 devstack sudo[93294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:14 devstack sudo[93288]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:14 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-52a95fa0-ca8b-4e4a-91c7-947a809dae14 tempest-CreateVolumesFromSnapshotTest-1887340981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-dcf4d76d-4aae-4420-b048-579a08017922" returned: 0 in 0.599s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:14 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-52a95fa0-ca8b-4e4a-91c7-947a809dae14 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Lock "cinder-quobyte-dcf4d76d-4aae-4420-b048-579a08017922" released by "delete_volume" :: held 1.371s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:18:14 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-52a95fa0-ca8b-4e4a-91c7-947a809dae14 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Created reservations ['80b93451-9eaf-4e12-b6ca-bdfee07fef14', 'f8bd92bb-f975-4984-b61c-1be6809efbfd', '9a4af4ae-c527-4cf0-98d1-b067e01f512b', '1be88703-cfda-4051-9b47-97d2564271a1'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:18:14 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-52a95fa0-ca8b-4e4a-91c7-947a809dae14 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:18:14 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-52a95fa0-ca8b-4e4a-91c7-947a809dae14 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:18:14 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-52a95fa0-ca8b-4e4a-91c7-947a809dae14 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:18:14 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-52a95fa0-ca8b-4e4a-91c7-947a809dae14 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:18:14 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-52a95fa0-ca8b-4e4a-91c7-947a809dae14 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:18:14 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-52a95fa0-ca8b-4e4a-91c7-947a809dae14 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:14 devstack sudo[93296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:18:14 devstack sudo[93296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:15 devstack sudo[93294]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:15 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-385372f0-0d85-4fcd-8cba-885966d55186 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-e559b32a-872a-4d11-9e86-966fb3c88d0d" returned: 0 in 0.597s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:15 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-385372f0-0d85-4fcd-8cba-885966d55186 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] <== create_volume: return (1469ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:18:15 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-385372f0-0d85-4fcd-8cba-885966d55186 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.473s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:18:15 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f210eb1b-34bd-4c15-b061-64ad965b8ac4 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.975s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:18:15 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-f210eb1b-34bd-4c15-b061-64ad965b8ac4 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:18:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1005086921',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=398ea35d-aedc-4af3-b17a-51b42a813c97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2711656dd43e4a739ef5844f8ca2783d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:18:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:18:07Z,use_quota=True,user_id='951162fa6f8243f1b141d4ce1f760b3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:18:15 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-f210eb1b-34bd-4c15-b061-64ad965b8ac4 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Creating volume 398ea35d-aedc-4af3-b17a-51b42a813c97 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:18:15 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f210eb1b-34bd-4c15-b061-64ad965b8ac4 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:18:15 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f210eb1b-34bd-4c15-b061-64ad965b8ac4 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:18:15 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-f210eb1b-34bd-4c15-b061-64ad965b8ac4 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:18:15 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-f210eb1b-34bd-4c15-b061-64ad965b8ac4 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:18:15 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f210eb1b-34bd-4c15-b061-64ad965b8ac4 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:18:15 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-f210eb1b-34bd-4c15-b061-64ad965b8ac4 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:18:15 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-f210eb1b-34bd-4c15-b061-64ad965b8ac4 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:18:15 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f210eb1b-34bd-4c15-b061-64ad965b8ac4 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-398ea35d-aedc-4af3-b17a-51b42a813c97 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:15 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-385372f0-0d85-4fcd-8cba-885966d55186 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5dbf67c-e19f-4f22-bf64-c6c4d4c6af95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e559b32a-872a-4d11-9e86-966fb3c88d0d', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:18:15 devstack sudo[93299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-398ea35d-aedc-4af3-b17a-51b42a813c97 1073741824
Apr 28 22:18:15 devstack sudo[93299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:15 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-385372f0-0d85-4fcd-8cba-885966d55186 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17481872-61dc-456d-b815-4288f123afcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:18:15 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-385372f0-0d85-4fcd-8cba-885966d55186 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Volume volume-e559b32a-872a-4d11-9e86-966fb3c88d0d (e559b32a-872a-4d11-9e86-966fb3c88d0d): created successfully
Apr 28 22:18:15 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-385372f0-0d85-4fcd-8cba-885966d55186 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17481872-61dc-456d-b815-4288f123afcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:18:15 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-385372f0-0d85-4fcd-8cba-885966d55186 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Flow 'volume_create_manager' (4c3c4acd-4c9b-40eb-af04-10b04fee465d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:18:15 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-385372f0-0d85-4fcd-8cba-885966d55186 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Created volume successfully.
Apr 28 22:18:15 devstack sudo[93296]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:15 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-52a95fa0-ca8b-4e4a-91c7-947a809dae14 tempest-CreateVolumesFromSnapshotTest-1887340981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.642s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:15 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-52a95fa0-ca8b-4e4a-91c7-947a809dae14 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:18:15 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-52a95fa0-ca8b-4e4a-91c7-947a809dae14 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Deleted volume successfully.
Apr 28 22:18:15 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-754c34e4-8933-4305-b44f-92902ce05215 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Acquiring lock "cinder-619be5e7-1ec3-4662-8ae8-8fc2d83057f5-delete_snapshot" by "delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:18:15 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-52a95fa0-ca8b-4e4a-91c7-947a809dae14 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Lock "cinder-dcf4d76d-4aae-4420-b048-579a08017922-delete_volume" released by "delete_volume" :: held 2.240s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:18:15 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-754c34e4-8933-4305-b44f-92902ce05215 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Lock "cinder-619be5e7-1ec3-4662-8ae8-8fc2d83057f5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:18:15 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-754c34e4-8933-4305-b44f-92902ce05215 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Acquiring lock "cinder-quobyte-b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b" by "delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:18:15 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-754c34e4-8933-4305-b44f-92902ce05215 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Lock "cinder-quobyte-b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:18:15 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-754c34e4-8933-4305-b44f-92902ce05215 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Acquiring lock "cinder-quobyte-619be5e7-1ec3-4662-8ae8-8fc2d83057f5" by "_delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:18:15 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-754c34e4-8933-4305-b44f-92902ce05215 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Lock "cinder-quobyte-619be5e7-1ec3-4662-8ae8-8fc2d83057f5" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:18:15 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-754c34e4-8933-4305-b44f-92902ce05215 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Deleting offline snapshot 619be5e7-1ec3-4662-8ae8-8fc2d83057f5 of volume b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 22:18:15 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-754c34e4-8933-4305-b44f-92902ce05215 tempest-CreateVolumesFromSnapshotTest-1887340981 None] snapshot_file for this snap is: volume-b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b.619be5e7-1ec3-4662-8ae8-8fc2d83057f5 {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 22:18:15 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0c5521-4691-4b42-9447-1d6fed0d14d8]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:18:15 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-754c34e4-8933-4305-b44f-92902ce05215 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b.619be5e7-1ec3-4662-8ae8-8fc2d83057f5 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:15 devstack sudo[93302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b.619be5e7-1ec3-4662-8ae8-8fc2d83057f5
Apr 28 22:18:15 devstack sudo[93302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:15 devstack sudo[93299]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:15 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f210eb1b-34bd-4c15-b061-64ad965b8ac4 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-398ea35d-aedc-4af3-b17a-51b42a813c97 1073741824" returned: 0 in 0.746s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:16 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f210eb1b-34bd-4c15-b061-64ad965b8ac4 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-398ea35d-aedc-4af3-b17a-51b42a813c97 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:16 devstack sudo[93307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-398ea35d-aedc-4af3-b17a-51b42a813c97
Apr 28 22:18:16 devstack sudo[93307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:16 devstack sudo[93302]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:16 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-754c34e4-8933-4305-b44f-92902ce05215 tempest-CreateVolumesFromSnapshotTest-1887340981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b.619be5e7-1ec3-4662-8ae8-8fc2d83057f5" returned: 0 in 0.715s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:16 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-754c34e4-8933-4305-b44f-92902ce05215 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 22:18:16 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[4585ffdf-cbcd-4db6-bd9c-9ea6095adb01]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:18:16 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-754c34e4-8933-4305-b44f-92902ce05215 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:16 devstack sudo[93312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b
Apr 28 22:18:16 devstack sudo[93312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:16 devstack sudo[93307]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:16 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f210eb1b-34bd-4c15-b061-64ad965b8ac4 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-398ea35d-aedc-4af3-b17a-51b42a813c97" returned: 0 in 0.584s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:16 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-f210eb1b-34bd-4c15-b061-64ad965b8ac4 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] <== create_volume: return (1396ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:18:16 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-f210eb1b-34bd-4c15-b061-64ad965b8ac4 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.400s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:18:16 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-3042bdc1-b775-4442-9fcd-ddd86e06e89f tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.070s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:18:16 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-3042bdc1-b775-4442-9fcd-ddd86e06e89f tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:18:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-120706333',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b54da303-6fda-43d7-89b6-18a66f1f9408,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2711656dd43e4a739ef5844f8ca2783d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:18:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:18:07Z,use_quota=True,user_id='951162fa6f8243f1b141d4ce1f760b3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:18:16 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-3042bdc1-b775-4442-9fcd-ddd86e06e89f tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Creating volume b54da303-6fda-43d7-89b6-18a66f1f9408 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:18:16 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-3042bdc1-b775-4442-9fcd-ddd86e06e89f tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:18:16 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-3042bdc1-b775-4442-9fcd-ddd86e06e89f tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:18:16 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-3042bdc1-b775-4442-9fcd-ddd86e06e89f tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:18:16 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-3042bdc1-b775-4442-9fcd-ddd86e06e89f tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:18:16 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-3042bdc1-b775-4442-9fcd-ddd86e06e89f tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:18:16 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-3042bdc1-b775-4442-9fcd-ddd86e06e89f tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:18:16 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-3042bdc1-b775-4442-9fcd-ddd86e06e89f tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:18:16 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-3042bdc1-b775-4442-9fcd-ddd86e06e89f tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b54da303-6fda-43d7-89b6-18a66f1f9408 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:16 devstack sudo[93315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b54da303-6fda-43d7-89b6-18a66f1f9408 1073741824
Apr 28 22:18:16 devstack sudo[93315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:16 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f210eb1b-34bd-4c15-b061-64ad965b8ac4 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8fd2edc-265c-4245-9a2e-1ac83caf029d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-398ea35d-aedc-4af3-b17a-51b42a813c97', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:18:16 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f210eb1b-34bd-4c15-b061-64ad965b8ac4 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3831438a-0f1c-4973-959c-63279a27d2bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:18:16 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-f210eb1b-34bd-4c15-b061-64ad965b8ac4 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Volume volume-398ea35d-aedc-4af3-b17a-51b42a813c97 (398ea35d-aedc-4af3-b17a-51b42a813c97): created successfully
Apr 28 22:18:16 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f210eb1b-34bd-4c15-b061-64ad965b8ac4 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3831438a-0f1c-4973-959c-63279a27d2bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:18:16 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-f210eb1b-34bd-4c15-b061-64ad965b8ac4 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Flow 'volume_create_manager' (7bd1c6d3-46e3-4e79-8a4b-f8e9b7e162f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:18:16 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-f210eb1b-34bd-4c15-b061-64ad965b8ac4 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Created volume successfully.
Apr 28 22:18:17 devstack sudo[93312]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:17 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-754c34e4-8933-4305-b44f-92902ce05215 tempest-CreateVolumesFromSnapshotTest-1887340981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b" returned: 0 in 0.673s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:17 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-754c34e4-8933-4305-b44f-92902ce05215 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b.619be5e7-1ec3-4662-8ae8-8fc2d83057f5 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:17 devstack sudo[93320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b.619be5e7-1ec3-4662-8ae8-8fc2d83057f5
Apr 28 22:18:17 devstack sudo[93320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:17 devstack sudo[93315]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:17 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-3042bdc1-b775-4442-9fcd-ddd86e06e89f tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b54da303-6fda-43d7-89b6-18a66f1f9408 1073741824" returned: 0 in 0.815s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:17 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-3042bdc1-b775-4442-9fcd-ddd86e06e89f tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b54da303-6fda-43d7-89b6-18a66f1f9408 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:17 devstack sudo[93326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b54da303-6fda-43d7-89b6-18a66f1f9408
Apr 28 22:18:17 devstack sudo[93326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:17 devstack sudo[93320]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:17 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-754c34e4-8933-4305-b44f-92902ce05215 tempest-CreateVolumesFromSnapshotTest-1887340981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b.619be5e7-1ec3-4662-8ae8-8fc2d83057f5" returned: 0 in 0.686s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:17 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-754c34e4-8933-4305-b44f-92902ce05215 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b.619be5e7-1ec3-4662-8ae8-8fc2d83057f5 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:17 devstack sudo[93331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b.619be5e7-1ec3-4662-8ae8-8fc2d83057f5
Apr 28 22:18:17 devstack sudo[93331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:18 devstack sudo[93326]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:18 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-3042bdc1-b775-4442-9fcd-ddd86e06e89f tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b54da303-6fda-43d7-89b6-18a66f1f9408" returned: 0 in 0.574s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:18 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-3042bdc1-b775-4442-9fcd-ddd86e06e89f tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] <== create_volume: return (1437ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:18:18 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-3042bdc1-b775-4442-9fcd-ddd86e06e89f tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.442s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:18:18 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-46fafcf6-ea49-4bc4-b189-7b8794f8287c tempest-SnapshotDependencyTests-1655070008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 7.227s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:18:18 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-46fafcf6-ea49-4bc4-b189-7b8794f8287c tempest-SnapshotDependencyTests-1655070008 None] Acquiring lock "cinder-quobyte-ba907c32-46e1-4cd8-b0cc-00e03f90538d-9cd8af09-59bf-4e9c-884f-cdf4314c5fea" by "_create_volume_from_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:18:18 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3042bdc1-b775-4442-9fcd-ddd86e06e89f tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8ee4d34-3c7a-446b-834f-3acb06b14a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b54da303-6fda-43d7-89b6-18a66f1f9408', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:18:18 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3042bdc1-b775-4442-9fcd-ddd86e06e89f tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (549a06d2-7530-4659-893d-b17b1ed501c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:18:18 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-46fafcf6-ea49-4bc4-b189-7b8794f8287c tempest-SnapshotDependencyTests-1655070008 None] Lock "cinder-quobyte-ba907c32-46e1-4cd8-b0cc-00e03f90538d-9cd8af09-59bf-4e9c-884f-cdf4314c5fea" acquired by "_create_volume_from_snapshot" :: waited 0.044s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:18:18 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-46fafcf6-ea49-4bc4-b189-7b8794f8287c tempest-SnapshotDependencyTests-1655070008 None] Creating volume 9cd8af09-59bf-4e9c-884f-cdf4314c5fea from snapshot ba907c32-46e1-4cd8-b0cc-00e03f90538d {{(pid=83924) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 28 22:18:18 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-46fafcf6-ea49-4bc4-b189-7b8794f8287c tempest-SnapshotDependencyTests-1655070008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:18:18 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-46fafcf6-ea49-4bc4-b189-7b8794f8287c tempest-SnapshotDependencyTests-1655070008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:18:18 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-46fafcf6-ea49-4bc4-b189-7b8794f8287c tempest-SnapshotDependencyTests-1655070008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:18:18 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-46fafcf6-ea49-4bc4-b189-7b8794f8287c tempest-SnapshotDependencyTests-1655070008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:18:18 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-46fafcf6-ea49-4bc4-b189-7b8794f8287c tempest-SnapshotDependencyTests-1655070008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:18:18 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-46fafcf6-ea49-4bc4-b189-7b8794f8287c tempest-SnapshotDependencyTests-1655070008 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:18:18 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-46fafcf6-ea49-4bc4-b189-7b8794f8287c tempest-SnapshotDependencyTests-1655070008 None] Acquiring lock "cinder-quobyte-9cd8af09-59bf-4e9c-884f-cdf4314c5fea" by "_copy_volume_from_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:18:18 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-3042bdc1-b775-4442-9fcd-ddd86e06e89f tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Volume volume-b54da303-6fda-43d7-89b6-18a66f1f9408 (b54da303-6fda-43d7-89b6-18a66f1f9408): created successfully
Apr 28 22:18:18 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3042bdc1-b775-4442-9fcd-ddd86e06e89f tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (549a06d2-7530-4659-893d-b17b1ed501c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:18:18 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-3042bdc1-b775-4442-9fcd-ddd86e06e89f tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Flow 'volume_create_manager' (ea34a47e-8224-437b-9578-f7e4e2af1ecc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:18:18 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-46fafcf6-ea49-4bc4-b189-7b8794f8287c tempest-SnapshotDependencyTests-1655070008 None] Lock "cinder-quobyte-9cd8af09-59bf-4e9c-884f-cdf4314c5fea" acquired by "_copy_volume_from_snapshot" :: waited 0.041s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:18:18 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-46fafcf6-ea49-4bc4-b189-7b8794f8287c tempest-SnapshotDependencyTests-1655070008 None] snapshot: ba907c32-46e1-4cd8-b0cc-00e03f90538d, volume: 9cd8af09-59bf-4e9c-884f-cdf4314c5fea,  {{(pid=83924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 28 22:18:18 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-46fafcf6-ea49-4bc4-b189-7b8794f8287c tempest-SnapshotDependencyTests-1655070008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:18:18 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-46fafcf6-ea49-4bc4-b189-7b8794f8287c tempest-SnapshotDependencyTests-1655070008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:18:18 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-46fafcf6-ea49-4bc4-b189-7b8794f8287c tempest-SnapshotDependencyTests-1655070008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:18:18 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-46fafcf6-ea49-4bc4-b189-7b8794f8287c tempest-SnapshotDependencyTests-1655070008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:18:18 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-46fafcf6-ea49-4bc4-b189-7b8794f8287c tempest-SnapshotDependencyTests-1655070008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:18:18 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-3042bdc1-b775-4442-9fcd-ddd86e06e89f tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Created volume successfully.
Apr 28 22:18:18 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[021c5a2c-cc4c-4610-88a4-13eaab1f0964]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:18:18 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-46fafcf6-ea49-4bc4-b189-7b8794f8287c tempest-SnapshotDependencyTests-1655070008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-123a3412-28f5-42ca-9424-50f31049250d.ba907c32-46e1-4cd8-b0cc-00e03f90538d {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:18 devstack sudo[93331]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:18 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-754c34e4-8933-4305-b44f-92902ce05215 tempest-CreateVolumesFromSnapshotTest-1887340981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b.619be5e7-1ec3-4662-8ae8-8fc2d83057f5" returned: 0 in 0.586s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:18 devstack sudo[93335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-123a3412-28f5-42ca-9424-50f31049250d.ba907c32-46e1-4cd8-b0cc-00e03f90538d
Apr 28 22:18:18 devstack sudo[93335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:18 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-754c34e4-8933-4305-b44f-92902ce05215 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Lock "cinder-quobyte-619be5e7-1ec3-4662-8ae8-8fc2d83057f5" released by "_delete_snapshot" :: held 2.768s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:18:18 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-754c34e4-8933-4305-b44f-92902ce05215 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Lock "cinder-quobyte-b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b" released by "delete_snapshot" :: held 2.789s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:18:18 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-754c34e4-8933-4305-b44f-92902ce05215 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Created reservations ['0a2bf2f2-8714-4419-886f-d896d83f0c3d', '2e6434b6-4491-48a9-ae29-d34c8047b17e', 'd1b274b0-24e3-4799-86d4-e0a3b5a7cc81', '6c30b247-8e84-48f9-8694-b6039690d840'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:18:18 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-734b7ae3-e8ee-4cd1-a2c5-64e4a84fc7e9 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Acquiring lock "cinder-b54da303-6fda-43d7-89b6-18a66f1f9408-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:18:18 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-754c34e4-8933-4305-b44f-92902ce05215 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Delete snapshot completed successfully.
Apr 28 22:18:18 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-754c34e4-8933-4305-b44f-92902ce05215 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Lock "cinder-619be5e7-1ec3-4662-8ae8-8fc2d83057f5-delete_snapshot" released by "delete_snapshot" :: held 2.941s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:18:18 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-734b7ae3-e8ee-4cd1-a2c5-64e4a84fc7e9 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Lock "cinder-b54da303-6fda-43d7-89b6-18a66f1f9408-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:18:18 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-734b7ae3-e8ee-4cd1-a2c5-64e4a84fc7e9 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Acquiring lock "cinder-quobyte-b54da303-6fda-43d7-89b6-18a66f1f9408" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:18:18 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-734b7ae3-e8ee-4cd1-a2c5-64e4a84fc7e9 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Lock "cinder-quobyte-b54da303-6fda-43d7-89b6-18a66f1f9408" acquired by "delete_volume" :: waited 0.016s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:18:18 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e0719f-89f1-4497-b62c-3827069bd2d3]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:18:18 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-734b7ae3-e8ee-4cd1-a2c5-64e4a84fc7e9 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b54da303-6fda-43d7-89b6-18a66f1f9408 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:18 devstack sudo[93337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b54da303-6fda-43d7-89b6-18a66f1f9408
Apr 28 22:18:18 devstack sudo[93337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:18 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-4cc4f561-652d-4c45-9f86-db8cb5eda072 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Acquiring lock "cinder-b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:18:18 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-4cc4f561-652d-4c45-9f86-db8cb5eda072 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Lock "cinder-b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:18:18 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-4cc4f561-652d-4c45-9f86-db8cb5eda072 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Acquiring lock "cinder-quobyte-b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:18:18 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-4cc4f561-652d-4c45-9f86-db8cb5eda072 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Lock "cinder-quobyte-b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b" acquired by "delete_volume" :: waited 0.017s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:18:18 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[e867f037-f8a5-4614-9c53-ca08e7b7851f]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:18:18 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4cc4f561-652d-4c45-9f86-db8cb5eda072 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:18 devstack sudo[93341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b
Apr 28 22:18:18 devstack sudo[93341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:18 devstack sudo[93335]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:18 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-46fafcf6-ea49-4bc4-b189-7b8794f8287c tempest-SnapshotDependencyTests-1655070008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-123a3412-28f5-42ca-9424-50f31049250d.ba907c32-46e1-4cd8-b0cc-00e03f90538d" returned: 0 in 0.702s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:18 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-46fafcf6-ea49-4bc4-b189-7b8794f8287c tempest-SnapshotDependencyTests-1655070008 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-123a3412-28f5-42ca-9424-50f31049250d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 22:18:18 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-46fafcf6-ea49-4bc4-b189-7b8794f8287c tempest-SnapshotDependencyTests-1655070008 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-123a3412-28f5-42ca-9424-50f31049250d {{(pid=83924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 28 22:18:18 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-46fafcf6-ea49-4bc4-b189-7b8794f8287c tempest-SnapshotDependencyTests-1655070008 None] Creating direct copy from snapshot {{(pid=83924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 28 22:18:18 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c16bebb-b507-4ba3-a615-3844d06d52e7]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:18:18 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-46fafcf6-ea49-4bc4-b189-7b8794f8287c tempest-SnapshotDependencyTests-1655070008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-123a3412-28f5-42ca-9424-50f31049250d {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:19 devstack sudo[93344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-123a3412-28f5-42ca-9424-50f31049250d
Apr 28 22:18:19 devstack sudo[93344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:19 devstack sudo[93337]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:19 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-734b7ae3-e8ee-4cd1-a2c5-64e4a84fc7e9 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b54da303-6fda-43d7-89b6-18a66f1f9408" returned: 0 in 0.765s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:19 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-734b7ae3-e8ee-4cd1-a2c5-64e4a84fc7e9 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b54da303-6fda-43d7-89b6-18a66f1f9408 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:19 devstack sudo[93349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b54da303-6fda-43d7-89b6-18a66f1f9408
Apr 28 22:18:19 devstack sudo[93349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:19 devstack sudo[93341]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:19 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4cc4f561-652d-4c45-9f86-db8cb5eda072 tempest-CreateVolumesFromSnapshotTest-1887340981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b" returned: 0 in 0.726s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:19 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4cc4f561-652d-4c45-9f86-db8cb5eda072 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:19 devstack sudo[93354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b
Apr 28 22:18:19 devstack sudo[93354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:19 devstack sudo[93344]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:19 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-46fafcf6-ea49-4bc4-b189-7b8794f8287c tempest-SnapshotDependencyTests-1655070008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-123a3412-28f5-42ca-9424-50f31049250d" returned: 0 in 0.767s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:19 devstack cinder-volume[83924]: DEBUG cinder.utils [None req-46fafcf6-ea49-4bc4-b189-7b8794f8287c tempest-SnapshotDependencyTests-1655070008 None] Path /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9cd8af09-59bf-4e9c-884f-cdf4314c5fea not found in is_blk_device check {{(pid=83924) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 28 22:18:19 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-46fafcf6-ea49-4bc4-b189-7b8794f8287c tempest-SnapshotDependencyTests-1655070008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-123a3412-28f5-42ca-9424-50f31049250d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9cd8af09-59bf-4e9c-884f-cdf4314c5fea {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:19 devstack sudo[93359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-123a3412-28f5-42ca-9424-50f31049250d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9cd8af09-59bf-4e9c-884f-cdf4314c5fea
Apr 28 22:18:19 devstack sudo[93359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:19 devstack sudo[93349]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:19 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-734b7ae3-e8ee-4cd1-a2c5-64e4a84fc7e9 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b54da303-6fda-43d7-89b6-18a66f1f9408" returned: 0 in 0.624s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:19 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-734b7ae3-e8ee-4cd1-a2c5-64e4a84fc7e9 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Lock "cinder-quobyte-b54da303-6fda-43d7-89b6-18a66f1f9408" released by "delete_volume" :: held 1.430s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:18:20 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-734b7ae3-e8ee-4cd1-a2c5-64e4a84fc7e9 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Created reservations ['2b5259f0-9619-4366-ba18-3e13e5db0aef', '44bc0ef0-f0bc-4729-9edb-da7a19dc2877', 'abbdc79b-3544-4e2c-92c5-eacbc98295cf', '6f8c12c1-6dfb-425d-b9c5-b693dfc8612a'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:18:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-734b7ae3-e8ee-4cd1-a2c5-64e4a84fc7e9 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:18:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-734b7ae3-e8ee-4cd1-a2c5-64e4a84fc7e9 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:18:20 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-734b7ae3-e8ee-4cd1-a2c5-64e4a84fc7e9 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:18:20 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-734b7ae3-e8ee-4cd1-a2c5-64e4a84fc7e9 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:18:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-734b7ae3-e8ee-4cd1-a2c5-64e4a84fc7e9 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:18:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-734b7ae3-e8ee-4cd1-a2c5-64e4a84fc7e9 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:20 devstack sudo[93363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:18:20 devstack sudo[93363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:20 devstack sudo[93354]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4cc4f561-652d-4c45-9f86-db8cb5eda072 tempest-CreateVolumesFromSnapshotTest-1887340981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b" returned: 0 in 0.602s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:20 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-4cc4f561-652d-4c45-9f86-db8cb5eda072 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Lock "cinder-quobyte-b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b" released by "delete_volume" :: held 1.399s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:18:20 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-4cc4f561-652d-4c45-9f86-db8cb5eda072 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Created reservations ['3befb4e2-6c1b-4318-a90b-2370f005bebe', 'e409c78f-9e0d-43a1-a037-a0a0a4f79b1d', 'ed505a3f-38c3-4f77-95fb-3f013fce4ccc', '83c36b10-53bd-49ec-bcda-9d0a0d0a0fc3'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:18:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-4cc4f561-652d-4c45-9f86-db8cb5eda072 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:18:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-4cc4f561-652d-4c45-9f86-db8cb5eda072 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:18:20 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-4cc4f561-652d-4c45-9f86-db8cb5eda072 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:18:20 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-4cc4f561-652d-4c45-9f86-db8cb5eda072 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:18:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-4cc4f561-652d-4c45-9f86-db8cb5eda072 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:18:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4cc4f561-652d-4c45-9f86-db8cb5eda072 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:20 devstack sudo[93369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:18:20 devstack sudo[93369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:20 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-5d28a7a0-01c2-4d62-b765-02080ca06360 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Acquiring lock "cinder-398ea35d-aedc-4af3-b17a-51b42a813c97-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:18:20 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-5d28a7a0-01c2-4d62-b765-02080ca06360 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Lock "cinder-398ea35d-aedc-4af3-b17a-51b42a813c97-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:18:20 devstack sudo[93363]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:20 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-734b7ae3-e8ee-4cd1-a2c5-64e4a84fc7e9 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.904s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:20 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-734b7ae3-e8ee-4cd1-a2c5-64e4a84fc7e9 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:18:21 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-734b7ae3-e8ee-4cd1-a2c5-64e4a84fc7e9 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Deleted volume successfully.
Apr 28 22:18:21 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-5d28a7a0-01c2-4d62-b765-02080ca06360 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Acquiring lock "cinder-quobyte-398ea35d-aedc-4af3-b17a-51b42a813c97" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:18:21 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-5d28a7a0-01c2-4d62-b765-02080ca06360 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Lock "cinder-quobyte-398ea35d-aedc-4af3-b17a-51b42a813c97" acquired by "delete_volume" :: waited 0.045s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:18:21 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-734b7ae3-e8ee-4cd1-a2c5-64e4a84fc7e9 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Lock "cinder-b54da303-6fda-43d7-89b6-18a66f1f9408-delete_volume" released by "delete_volume" :: held 2.685s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:18:21 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dab1b98-e7cc-4210-acbc-34584ee3ad30]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:18:21 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5d28a7a0-01c2-4d62-b765-02080ca06360 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-398ea35d-aedc-4af3-b17a-51b42a813c97 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:21 devstack sudo[93369]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:21 devstack sudo[93380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-398ea35d-aedc-4af3-b17a-51b42a813c97
Apr 28 22:18:21 devstack sudo[93380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:21 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4cc4f561-652d-4c45-9f86-db8cb5eda072 tempest-CreateVolumesFromSnapshotTest-1887340981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 1.105s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:21 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-4cc4f561-652d-4c45-9f86-db8cb5eda072 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:18:21 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-4cc4f561-652d-4c45-9f86-db8cb5eda072 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Deleted volume successfully.
Apr 28 22:18:21 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-4cc4f561-652d-4c45-9f86-db8cb5eda072 tempest-CreateVolumesFromSnapshotTest-1887340981 None] Lock "cinder-b7765f0f-79e9-4df3-a593-d6e4cbfd1b0b-delete_volume" released by "delete_volume" :: held 2.812s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:18:21 devstack cinder-volume[83924]: DEBUG dbcounter [-] [83924] Writing DB stats cinder:UPDATE=183,cinder:SELECT=129,cinder:INSERT=41,cinder:DELETE=16 {{(pid=83924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 28 22:18:22 devstack sudo[93380]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:22 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5d28a7a0-01c2-4d62-b765-02080ca06360 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-398ea35d-aedc-4af3-b17a-51b42a813c97" returned: 0 in 1.140s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:22 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5d28a7a0-01c2-4d62-b765-02080ca06360 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-398ea35d-aedc-4af3-b17a-51b42a813c97 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:22 devstack sudo[93385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-398ea35d-aedc-4af3-b17a-51b42a813c97
Apr 28 22:18:22 devstack sudo[93385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:23 devstack sudo[93385]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:23 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5d28a7a0-01c2-4d62-b765-02080ca06360 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-398ea35d-aedc-4af3-b17a-51b42a813c97" returned: 0 in 1.532s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:23 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-5d28a7a0-01c2-4d62-b765-02080ca06360 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Lock "cinder-quobyte-398ea35d-aedc-4af3-b17a-51b42a813c97" released by "delete_volume" :: held 2.802s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:18:23 devstack cinder-volume[83924]: DEBUG dbcounter [-] [83924] Writing DB stats cinder:SELECT=141,cinder:UPDATE=184,cinder:INSERT=42,cinder:DELETE=21 {{(pid=83924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 28 22:18:24 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-5d28a7a0-01c2-4d62-b765-02080ca06360 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Created reservations ['cd431149-6c41-4c3c-b3c4-ca3db991a3a1', 'aa97df30-5b29-48f9-8d14-4b6f3a7fc355', '9f405797-945c-40ec-9745-3298679d8f84', '78f2c756-9ee5-43f1-bb4b-feacf35ef557'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:18:24 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-5d28a7a0-01c2-4d62-b765-02080ca06360 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:18:24 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-5d28a7a0-01c2-4d62-b765-02080ca06360 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:18:24 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-5d28a7a0-01c2-4d62-b765-02080ca06360 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:18:24 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-5d28a7a0-01c2-4d62-b765-02080ca06360 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:18:24 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-5d28a7a0-01c2-4d62-b765-02080ca06360 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:18:24 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5d28a7a0-01c2-4d62-b765-02080ca06360 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:24 devstack sudo[93424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:18:24 devstack sudo[93424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:24 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-a6d938f8-c83f-4436-9dbb-a9e0a0f6c7cf tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Acquiring lock "cinder-e559b32a-872a-4d11-9e86-966fb3c88d0d-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:18:24 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-a6d938f8-c83f-4436-9dbb-a9e0a0f6c7cf tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Lock "cinder-e559b32a-872a-4d11-9e86-966fb3c88d0d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:18:24 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-a6d938f8-c83f-4436-9dbb-a9e0a0f6c7cf tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Acquiring lock "cinder-quobyte-e559b32a-872a-4d11-9e86-966fb3c88d0d" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:18:24 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-a6d938f8-c83f-4436-9dbb-a9e0a0f6c7cf tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Lock "cinder-quobyte-e559b32a-872a-4d11-9e86-966fb3c88d0d" acquired by "delete_volume" :: waited 0.040s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:18:24 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6bf6547-272a-4afd-9cf3-3c63d0d5bfc8]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:18:24 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a6d938f8-c83f-4436-9dbb-a9e0a0f6c7cf tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-e559b32a-872a-4d11-9e86-966fb3c88d0d {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:25 devstack sudo[93426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-e559b32a-872a-4d11-9e86-966fb3c88d0d
Apr 28 22:18:25 devstack sudo[93426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:26 devstack sudo[93424]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:26 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5d28a7a0-01c2-4d62-b765-02080ca06360 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 1.730s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:26 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-5d28a7a0-01c2-4d62-b765-02080ca06360 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:18:26 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-5d28a7a0-01c2-4d62-b765-02080ca06360 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Deleted volume successfully.
Apr 28 22:18:26 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-5d28a7a0-01c2-4d62-b765-02080ca06360 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Lock "cinder-398ea35d-aedc-4af3-b17a-51b42a813c97-delete_volume" released by "delete_volume" :: held 5.214s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:18:26 devstack sudo[93359]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:26 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-46fafcf6-ea49-4bc4-b189-7b8794f8287c tempest-SnapshotDependencyTests-1655070008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-123a3412-28f5-42ca-9424-50f31049250d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9cd8af09-59bf-4e9c-884f-cdf4314c5fea" returned: 0 in 6.541s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:26 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0625284-f2b1-43c6-8791-23fecc7f204f]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:18:26 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-46fafcf6-ea49-4bc4-b189-7b8794f8287c tempest-SnapshotDependencyTests-1655070008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-123a3412-28f5-42ca-9424-50f31049250d {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:26 devstack sudo[93437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-123a3412-28f5-42ca-9424-50f31049250d
Apr 28 22:18:26 devstack sudo[93437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:26 devstack sudo[93426]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:26 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a6d938f8-c83f-4436-9dbb-a9e0a0f6c7cf tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-e559b32a-872a-4d11-9e86-966fb3c88d0d" returned: 0 in 1.462s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:26 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a6d938f8-c83f-4436-9dbb-a9e0a0f6c7cf tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-e559b32a-872a-4d11-9e86-966fb3c88d0d {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:26 devstack sudo[93442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-e559b32a-872a-4d11-9e86-966fb3c88d0d
Apr 28 22:18:26 devstack sudo[93442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:27 devstack sudo[93442]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:27 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a6d938f8-c83f-4436-9dbb-a9e0a0f6c7cf tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-e559b32a-872a-4d11-9e86-966fb3c88d0d" returned: 0 in 0.644s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:27 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-a6d938f8-c83f-4436-9dbb-a9e0a0f6c7cf tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Lock "cinder-quobyte-e559b32a-872a-4d11-9e86-966fb3c88d0d" released by "delete_volume" :: held 2.234s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:18:27 devstack sudo[93437]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:27 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-46fafcf6-ea49-4bc4-b189-7b8794f8287c tempest-SnapshotDependencyTests-1655070008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-123a3412-28f5-42ca-9424-50f31049250d" returned: 0 in 0.883s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:27 devstack cinder-volume[83924]: DEBUG cinder.image.image_utils [None req-46fafcf6-ea49-4bc4-b189-7b8794f8287c tempest-SnapshotDependencyTests-1655070008 None] Image conversion details: src /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-123a3412-28f5-42ca-9424-50f31049250d, size 1024.00 MB, duration 6.54 sec, destination /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9cd8af09-59bf-4e9c-884f-cdf4314c5fea {{(pid=83924) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 28 22:18:27 devstack cinder-volume[83924]: INFO cinder.image.image_utils [None req-46fafcf6-ea49-4bc4-b189-7b8794f8287c tempest-SnapshotDependencyTests-1655070008 None] Converted 1024.00 MB image at 156.53 MB/s
Apr 28 22:18:27 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-46fafcf6-ea49-4bc4-b189-7b8794f8287c tempest-SnapshotDependencyTests-1655070008 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9cd8af09-59bf-4e9c-884f-cdf4314c5fea is being set with open permissions: ugo+rw
Apr 28 22:18:27 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-46fafcf6-ea49-4bc4-b189-7b8794f8287c tempest-SnapshotDependencyTests-1655070008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9cd8af09-59bf-4e9c-884f-cdf4314c5fea {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:27 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-a6d938f8-c83f-4436-9dbb-a9e0a0f6c7cf tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Created reservations ['a94a70c7-2aac-434c-9e1b-ed10dfd7f359', '3501b54e-904f-4fe7-9df6-997e43ca4d38', 'a48feab4-090b-4a95-9e7d-f0519a807226', 'a3e10903-708a-472c-9690-cbe98057270b'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:18:27 devstack sudo[93449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9cd8af09-59bf-4e9c-884f-cdf4314c5fea
Apr 28 22:18:27 devstack sudo[93449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:27 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-a6d938f8-c83f-4436-9dbb-a9e0a0f6c7cf tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:18:27 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-a6d938f8-c83f-4436-9dbb-a9e0a0f6c7cf tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:18:27 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-a6d938f8-c83f-4436-9dbb-a9e0a0f6c7cf tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:18:27 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-a6d938f8-c83f-4436-9dbb-a9e0a0f6c7cf tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:18:27 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-a6d938f8-c83f-4436-9dbb-a9e0a0f6c7cf tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:18:27 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a6d938f8-c83f-4436-9dbb-a9e0a0f6c7cf tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:27 devstack sudo[93451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:18:27 devstack sudo[93451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:27 devstack sudo[93449]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:27 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-46fafcf6-ea49-4bc4-b189-7b8794f8287c tempest-SnapshotDependencyTests-1655070008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9cd8af09-59bf-4e9c-884f-cdf4314c5fea" returned: 0 in 0.613s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:27 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-46fafcf6-ea49-4bc4-b189-7b8794f8287c tempest-SnapshotDependencyTests-1655070008 None] Lock "cinder-quobyte-9cd8af09-59bf-4e9c-884f-cdf4314c5fea" released by "_copy_volume_from_snapshot" :: held 9.625s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:18:27 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-46fafcf6-ea49-4bc4-b189-7b8794f8287c tempest-SnapshotDependencyTests-1655070008 None] Lock "cinder-quobyte-ba907c32-46e1-4cd8-b0cc-00e03f90538d-9cd8af09-59bf-4e9c-884f-cdf4314c5fea" released by "_create_volume_from_snapshot" :: held 9.685s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:18:27 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-46fafcf6-ea49-4bc4-b189-7b8794f8287c tempest-SnapshotDependencyTests-1655070008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.730s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:18:27 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 15.898s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:18:27 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] Cloning volume f86ea68a-4896-4e7b-8160-d180e358d610 to volume 393c2e15-d39c-4500-9c9c-b256c87bb969
Apr 28 22:18:27 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-46fafcf6-ea49-4bc4-b189-7b8794f8287c tempest-SnapshotDependencyTests-1655070008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f9a0717-49f7-462e-bd9d-86260ccb9c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cd8af09-59bf-4e9c-884f-cdf4314c5fea', 'volume_size': 1, 'snapshot_id': 'ba907c32-46e1-4cd8-b0cc-00e03f90538d'}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:18:27 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-46fafcf6-ea49-4bc4-b189-7b8794f8287c tempest-SnapshotDependencyTests-1655070008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14207f2d-a7d4-45ea-8b36-5503b58efd03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:18:27 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] Creating offline snapshot 82536a97-f81e-4035-a0ec-11e080b0ab3b of volume f86ea68a-4896-4e7b-8160-d180e358d610 {{(pid=83924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 22:18:27 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-46fafcf6-ea49-4bc4-b189-7b8794f8287c tempest-SnapshotDependencyTests-1655070008 None] Volume volume-9cd8af09-59bf-4e9c-884f-cdf4314c5fea (9cd8af09-59bf-4e9c-884f-cdf4314c5fea): created successfully
Apr 28 22:18:27 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-46fafcf6-ea49-4bc4-b189-7b8794f8287c tempest-SnapshotDependencyTests-1655070008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14207f2d-a7d4-45ea-8b36-5503b58efd03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:18:27 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-46fafcf6-ea49-4bc4-b189-7b8794f8287c tempest-SnapshotDependencyTests-1655070008 None] Flow 'volume_create_manager' (d91dd677-1e53-4241-bc75-a03e4d2d52de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:18:27 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a49ea0-dd87-4b5e-9ac7-9f9b89aea2d8]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:18:27 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f86ea68a-4896-4e7b-8160-d180e358d610 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:27 devstack sudo[93451]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:27 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-a6d938f8-c83f-4436-9dbb-a9e0a0f6c7cf tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.618s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:27 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-a6d938f8-c83f-4436-9dbb-a9e0a0f6c7cf tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:18:27 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-a6d938f8-c83f-4436-9dbb-a9e0a0f6c7cf tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Deleted volume successfully.
Apr 28 22:18:27 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-46fafcf6-ea49-4bc4-b189-7b8794f8287c tempest-SnapshotDependencyTests-1655070008 None] Created volume successfully.
Apr 28 22:18:27 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-a6d938f8-c83f-4436-9dbb-a9e0a0f6c7cf tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Lock "cinder-e559b32a-872a-4d11-9e86-966fb3c88d0d-delete_volume" released by "delete_volume" :: held 3.173s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:18:28 devstack sudo[93455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f86ea68a-4896-4e7b-8160-d180e358d610
Apr 28 22:18:28 devstack sudo[93455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:28 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-c95bc0bd-e223-480a-ac88-1bdb5a90df23 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Acquiring lock "cinder-c7c0a4d8-61b9-407b-93b2-82a6ff31befc-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:18:28 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-c95bc0bd-e223-480a-ac88-1bdb5a90df23 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Lock "cinder-c7c0a4d8-61b9-407b-93b2-82a6ff31befc-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:18:28 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-c95bc0bd-e223-480a-ac88-1bdb5a90df23 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Acquiring lock "cinder-quobyte-c7c0a4d8-61b9-407b-93b2-82a6ff31befc" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:18:28 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-c95bc0bd-e223-480a-ac88-1bdb5a90df23 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Lock "cinder-quobyte-c7c0a4d8-61b9-407b-93b2-82a6ff31befc" acquired by "delete_volume" :: waited 0.017s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:18:28 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[130ebd54-510c-41a5-9da6-b71ef8bbf66f]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:18:28 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c95bc0bd-e223-480a-ac88-1bdb5a90df23 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-c7c0a4d8-61b9-407b-93b2-82a6ff31befc {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:28 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-f3c107cd-cc81-4c64-ab41-ca215eaea8b1 tempest-SnapshotDependencyTests-1655070008 None] Acquiring lock "cinder-ba907c32-46e1-4cd8-b0cc-00e03f90538d-delete_snapshot" by "delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:18:28 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-f3c107cd-cc81-4c64-ab41-ca215eaea8b1 tempest-SnapshotDependencyTests-1655070008 None] Lock "cinder-ba907c32-46e1-4cd8-b0cc-00e03f90538d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:18:28 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-f3c107cd-cc81-4c64-ab41-ca215eaea8b1 tempest-SnapshotDependencyTests-1655070008 None] Acquiring lock "cinder-quobyte-123a3412-28f5-42ca-9424-50f31049250d" by "delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:18:28 devstack sudo[93457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-c7c0a4d8-61b9-407b-93b2-82a6ff31befc
Apr 28 22:18:28 devstack sudo[93457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:28 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-f3c107cd-cc81-4c64-ab41-ca215eaea8b1 tempest-SnapshotDependencyTests-1655070008 None] Lock "cinder-quobyte-123a3412-28f5-42ca-9424-50f31049250d" acquired by "delete_snapshot" :: waited 0.027s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:18:28 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-f3c107cd-cc81-4c64-ab41-ca215eaea8b1 tempest-SnapshotDependencyTests-1655070008 None] Acquiring lock "cinder-quobyte-ba907c32-46e1-4cd8-b0cc-00e03f90538d" by "_delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:18:28 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-f3c107cd-cc81-4c64-ab41-ca215eaea8b1 tempest-SnapshotDependencyTests-1655070008 None] Lock "cinder-quobyte-ba907c32-46e1-4cd8-b0cc-00e03f90538d" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:18:28 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-f3c107cd-cc81-4c64-ab41-ca215eaea8b1 tempest-SnapshotDependencyTests-1655070008 None] Deleting offline snapshot ba907c32-46e1-4cd8-b0cc-00e03f90538d of volume 123a3412-28f5-42ca-9424-50f31049250d {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 22:18:28 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-f3c107cd-cc81-4c64-ab41-ca215eaea8b1 tempest-SnapshotDependencyTests-1655070008 None] snapshot_file for this snap is: volume-123a3412-28f5-42ca-9424-50f31049250d.ba907c32-46e1-4cd8-b0cc-00e03f90538d {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 22:18:28 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aaa5e3e-86b7-4b05-9a06-6c428c738627]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:18:28 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f3c107cd-cc81-4c64-ab41-ca215eaea8b1 tempest-SnapshotDependencyTests-1655070008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-123a3412-28f5-42ca-9424-50f31049250d.ba907c32-46e1-4cd8-b0cc-00e03f90538d {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:28 devstack sudo[93455]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:28 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f86ea68a-4896-4e7b-8160-d180e358d610" returned: 0 in 0.815s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:28 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f86ea68a-4896-4e7b-8160-d180e358d610,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f86ea68a-4896-4e7b-8160-d180e358d610.82536a97-f81e-4035-a0ec-11e080b0ab3b 1G {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:28 devstack sudo[93463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f86ea68a-4896-4e7b-8160-d180e358d610,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f86ea68a-4896-4e7b-8160-d180e358d610.82536a97-f81e-4035-a0ec-11e080b0ab3b 1G
Apr 28 22:18:28 devstack sudo[93463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:28 devstack sudo[93462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-123a3412-28f5-42ca-9424-50f31049250d.ba907c32-46e1-4cd8-b0cc-00e03f90538d
Apr 28 22:18:28 devstack sudo[93462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:29 devstack sudo[93457]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c95bc0bd-e223-480a-ac88-1bdb5a90df23 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-c7c0a4d8-61b9-407b-93b2-82a6ff31befc" returned: 0 in 0.782s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c95bc0bd-e223-480a-ac88-1bdb5a90df23 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-c7c0a4d8-61b9-407b-93b2-82a6ff31befc {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:29 devstack sudo[93475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-c7c0a4d8-61b9-407b-93b2-82a6ff31befc
Apr 28 22:18:29 devstack sudo[93475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:29 devstack sudo[93462]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f3c107cd-cc81-4c64-ab41-ca215eaea8b1 tempest-SnapshotDependencyTests-1655070008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-123a3412-28f5-42ca-9424-50f31049250d.ba907c32-46e1-4cd8-b0cc-00e03f90538d" returned: 0 in 0.702s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:29 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-f3c107cd-cc81-4c64-ab41-ca215eaea8b1 tempest-SnapshotDependencyTests-1655070008 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-123a3412-28f5-42ca-9424-50f31049250d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 22:18:29 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bfe327c-39f7-40eb-a7df-34595fc295ba]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:18:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f3c107cd-cc81-4c64-ab41-ca215eaea8b1 tempest-SnapshotDependencyTests-1655070008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-123a3412-28f5-42ca-9424-50f31049250d {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:29 devstack sudo[93478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-123a3412-28f5-42ca-9424-50f31049250d
Apr 28 22:18:29 devstack sudo[93463]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:29 devstack sudo[93478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f86ea68a-4896-4e7b-8160-d180e358d610,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f86ea68a-4896-4e7b-8160-d180e358d610.82536a97-f81e-4035-a0ec-11e080b0ab3b 1G" returned: 0 in 0.828s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f86ea68a-4896-4e7b-8160-d180e358d610 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f86ea68a-4896-4e7b-8160-d180e358d610.82536a97-f81e-4035-a0ec-11e080b0ab3b {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:29 devstack sudo[93480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f86ea68a-4896-4e7b-8160-d180e358d610 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f86ea68a-4896-4e7b-8160-d180e358d610.82536a97-f81e-4035-a0ec-11e080b0ab3b
Apr 28 22:18:29 devstack sudo[93480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:29 devstack sudo[93475]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:29 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c95bc0bd-e223-480a-ac88-1bdb5a90df23 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-c7c0a4d8-61b9-407b-93b2-82a6ff31befc" returned: 0 in 0.682s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:29 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-c95bc0bd-e223-480a-ac88-1bdb5a90df23 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Lock "cinder-quobyte-c7c0a4d8-61b9-407b-93b2-82a6ff31befc" released by "delete_volume" :: held 1.515s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:18:29 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-c95bc0bd-e223-480a-ac88-1bdb5a90df23 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Created reservations ['dcb6a120-3818-4cb3-9e68-8853ae8d83c8', '58256981-4046-4679-b90d-748887977e6d', 'a37c8d75-b1ab-48eb-a5ad-436b0375567b', '36f641f8-8f2a-43d3-ad24-e30a26097836'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:18:30 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-c95bc0bd-e223-480a-ac88-1bdb5a90df23 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:18:30 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-c95bc0bd-e223-480a-ac88-1bdb5a90df23 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:18:30 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-c95bc0bd-e223-480a-ac88-1bdb5a90df23 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:18:30 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-c95bc0bd-e223-480a-ac88-1bdb5a90df23 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:18:30 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-c95bc0bd-e223-480a-ac88-1bdb5a90df23 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:18:30 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c95bc0bd-e223-480a-ac88-1bdb5a90df23 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:30 devstack sudo[93488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:18:30 devstack sudo[93488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:30 devstack sudo[93478]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:30 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f3c107cd-cc81-4c64-ab41-ca215eaea8b1 tempest-SnapshotDependencyTests-1655070008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-123a3412-28f5-42ca-9424-50f31049250d" returned: 0 in 0.751s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:30 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f3c107cd-cc81-4c64-ab41-ca215eaea8b1 tempest-SnapshotDependencyTests-1655070008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-123a3412-28f5-42ca-9424-50f31049250d.ba907c32-46e1-4cd8-b0cc-00e03f90538d {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:30 devstack sudo[93492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-123a3412-28f5-42ca-9424-50f31049250d.ba907c32-46e1-4cd8-b0cc-00e03f90538d
Apr 28 22:18:30 devstack sudo[93492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:30 devstack sudo[93480]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:30 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f86ea68a-4896-4e7b-8160-d180e358d610 -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f86ea68a-4896-4e7b-8160-d180e358d610.82536a97-f81e-4035-a0ec-11e080b0ab3b" returned: 0 in 0.701s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:30 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f86ea68a-4896-4e7b-8160-d180e358d610.82536a97-f81e-4035-a0ec-11e080b0ab3b is being set with open permissions: ugo+rw
Apr 28 22:18:30 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f86ea68a-4896-4e7b-8160-d180e358d610.82536a97-f81e-4035-a0ec-11e080b0ab3b {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:30 devstack sudo[93494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f86ea68a-4896-4e7b-8160-d180e358d610.82536a97-f81e-4035-a0ec-11e080b0ab3b
Apr 28 22:18:30 devstack sudo[93494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:30 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-49f7957c-4071-4161-b75b-a4f521caee8f tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Acquiring lock "cinder-da4d9bf6-66e3-484b-9fdd-09e8641ba342-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:18:30 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-49f7957c-4071-4161-b75b-a4f521caee8f tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Lock "cinder-da4d9bf6-66e3-484b-9fdd-09e8641ba342-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:18:30 devstack sudo[93488]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:30 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-49f7957c-4071-4161-b75b-a4f521caee8f tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Acquiring lock "cinder-quobyte-da4d9bf6-66e3-484b-9fdd-09e8641ba342" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:18:30 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-c95bc0bd-e223-480a-ac88-1bdb5a90df23 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.653s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:30 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-c95bc0bd-e223-480a-ac88-1bdb5a90df23 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:18:30 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-49f7957c-4071-4161-b75b-a4f521caee8f tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Lock "cinder-quobyte-da4d9bf6-66e3-484b-9fdd-09e8641ba342" acquired by "delete_volume" :: waited 0.021s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:18:30 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-c95bc0bd-e223-480a-ac88-1bdb5a90df23 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Deleted volume successfully.
Apr 28 22:18:30 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e919421-c769-4e6e-84b2-3384d3fb5574]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:18:30 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-49f7957c-4071-4161-b75b-a4f521caee8f tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-da4d9bf6-66e3-484b-9fdd-09e8641ba342 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:30 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-c95bc0bd-e223-480a-ac88-1bdb5a90df23 tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Lock "cinder-c7c0a4d8-61b9-407b-93b2-82a6ff31befc-delete_volume" released by "delete_volume" :: held 2.438s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:18:30 devstack sudo[93500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-da4d9bf6-66e3-484b-9fdd-09e8641ba342
Apr 28 22:18:30 devstack sudo[93494]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:30 devstack sudo[93500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:30 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f86ea68a-4896-4e7b-8160-d180e358d610.82536a97-f81e-4035-a0ec-11e080b0ab3b" returned: 0 in 0.678s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:30 devstack sudo[93492]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:30 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f86ea68a-4896-4e7b-8160-d180e358d610.info {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:30 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f3c107cd-cc81-4c64-ab41-ca215eaea8b1 tempest-SnapshotDependencyTests-1655070008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-123a3412-28f5-42ca-9424-50f31049250d.ba907c32-46e1-4cd8-b0cc-00e03f90538d" returned: 0 in 0.811s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:30 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f3c107cd-cc81-4c64-ab41-ca215eaea8b1 tempest-SnapshotDependencyTests-1655070008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-123a3412-28f5-42ca-9424-50f31049250d.ba907c32-46e1-4cd8-b0cc-00e03f90538d {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:30 devstack sudo[93503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f86ea68a-4896-4e7b-8160-d180e358d610.info
Apr 28 22:18:30 devstack sudo[93503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:30 devstack sudo[93504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-123a3412-28f5-42ca-9424-50f31049250d.ba907c32-46e1-4cd8-b0cc-00e03f90538d
Apr 28 22:18:30 devstack sudo[93504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:31 devstack sudo[93500]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-49f7957c-4071-4161-b75b-a4f521caee8f tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-da4d9bf6-66e3-484b-9fdd-09e8641ba342" returned: 0 in 0.757s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-49f7957c-4071-4161-b75b-a4f521caee8f tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-da4d9bf6-66e3-484b-9fdd-09e8641ba342 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:31 devstack sudo[93512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-da4d9bf6-66e3-484b-9fdd-09e8641ba342
Apr 28 22:18:31 devstack sudo[93512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:31 devstack sudo[93503]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f86ea68a-4896-4e7b-8160-d180e358d610.info" returned: 0 in 0.626s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:31 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f86ea68a-4896-4e7b-8160-d180e358d610.info is being set with open permissions: ugo+rw
Apr 28 22:18:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f86ea68a-4896-4e7b-8160-d180e358d610.info {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:31 devstack sudo[93504]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:31 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-f3c107cd-cc81-4c64-ab41-ca215eaea8b1 tempest-SnapshotDependencyTests-1655070008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-123a3412-28f5-42ca-9424-50f31049250d.ba907c32-46e1-4cd8-b0cc-00e03f90538d" returned: 0 in 0.634s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:31 devstack sudo[93514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f86ea68a-4896-4e7b-8160-d180e358d610.info
Apr 28 22:18:31 devstack sudo[93514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:31 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-f3c107cd-cc81-4c64-ab41-ca215eaea8b1 tempest-SnapshotDependencyTests-1655070008 None] Lock "cinder-quobyte-ba907c32-46e1-4cd8-b0cc-00e03f90538d" released by "_delete_snapshot" :: held 3.016s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:18:31 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-f3c107cd-cc81-4c64-ab41-ca215eaea8b1 tempest-SnapshotDependencyTests-1655070008 None] Lock "cinder-quobyte-123a3412-28f5-42ca-9424-50f31049250d" released by "delete_snapshot" :: held 3.048s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:18:31 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-f3c107cd-cc81-4c64-ab41-ca215eaea8b1 tempest-SnapshotDependencyTests-1655070008 None] Created reservations ['cdcb7af9-aadd-4272-a91b-79829a5c790c', 'f250fb7d-f9c7-4fd3-b41a-1b852a893c7f', '052c9cd3-da50-46f9-b334-96793421c134', 'be609d8d-d768-43de-a4d4-fa934bb14bb2'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:18:31 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-f3c107cd-cc81-4c64-ab41-ca215eaea8b1 tempest-SnapshotDependencyTests-1655070008 None] Delete snapshot completed successfully.
Apr 28 22:18:31 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-f3c107cd-cc81-4c64-ab41-ca215eaea8b1 tempest-SnapshotDependencyTests-1655070008 None] Lock "cinder-ba907c32-46e1-4cd8-b0cc-00e03f90538d-delete_snapshot" released by "delete_snapshot" :: held 3.221s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:18:32 devstack sudo[93512]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:32 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-49f7957c-4071-4161-b75b-a4f521caee8f tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-da4d9bf6-66e3-484b-9fdd-09e8641ba342" returned: 0 in 0.611s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:32 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-49f7957c-4071-4161-b75b-a4f521caee8f tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Lock "cinder-quobyte-da4d9bf6-66e3-484b-9fdd-09e8641ba342" released by "delete_volume" :: held 1.416s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:18:32 devstack sudo[93514]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:32 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f86ea68a-4896-4e7b-8160-d180e358d610.info" returned: 0 in 0.622s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:32 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] Acquiring lock "cinder-quobyte-393c2e15-d39c-4500-9c9c-b256c87bb969" by "_copy_volume_from_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:18:32 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-49f7957c-4071-4161-b75b-a4f521caee8f tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Created reservations ['a2a7aa72-7981-4645-9fdf-0612a62671fb', '041d83bf-f6c6-4654-b79b-ed4ca34baf81', 'a62f9864-1987-48c4-8714-5bc3dfab99f2', '64997aeb-a64f-4932-9e7c-91d2b04b2477'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:18:32 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] Lock "cinder-quobyte-393c2e15-d39c-4500-9c9c-b256c87bb969" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:18:32 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] snapshot: 82536a97-f81e-4035-a0ec-11e080b0ab3b, volume: 393c2e15-d39c-4500-9c9c-b256c87bb969,  {{(pid=83924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 28 22:18:32 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:18:32 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:18:32 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:18:32 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:18:32 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:18:32 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3e0460-34bc-4391-b370-b8f308e0ab06]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:18:32 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f86ea68a-4896-4e7b-8160-d180e358d610.82536a97-f81e-4035-a0ec-11e080b0ab3b {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:32 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-49f7957c-4071-4161-b75b-a4f521caee8f tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:18:32 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-49f7957c-4071-4161-b75b-a4f521caee8f tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:18:32 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-49f7957c-4071-4161-b75b-a4f521caee8f tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:18:32 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-49f7957c-4071-4161-b75b-a4f521caee8f tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:18:32 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-49f7957c-4071-4161-b75b-a4f521caee8f tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:18:32 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-49f7957c-4071-4161-b75b-a4f521caee8f tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:32 devstack sudo[93520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:18:32 devstack sudo[93520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:32 devstack sudo[93519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f86ea68a-4896-4e7b-8160-d180e358d610.82536a97-f81e-4035-a0ec-11e080b0ab3b
Apr 28 22:18:32 devstack sudo[93519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:32 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-9dd68681-687c-4ca3-a98e-afabbcf3afd2 tempest-SnapshotDependencyTests-1655070008 None] Acquiring lock "cinder-123a3412-28f5-42ca-9424-50f31049250d-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:18:32 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-9dd68681-687c-4ca3-a98e-afabbcf3afd2 tempest-SnapshotDependencyTests-1655070008 None] Lock "cinder-123a3412-28f5-42ca-9424-50f31049250d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:18:32 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-9dd68681-687c-4ca3-a98e-afabbcf3afd2 tempest-SnapshotDependencyTests-1655070008 None] Acquiring lock "cinder-quobyte-123a3412-28f5-42ca-9424-50f31049250d" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:18:32 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-9dd68681-687c-4ca3-a98e-afabbcf3afd2 tempest-SnapshotDependencyTests-1655070008 None] Lock "cinder-quobyte-123a3412-28f5-42ca-9424-50f31049250d" acquired by "delete_volume" :: waited 0.028s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:18:32 devstack sudo[93520]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:32 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-67aa7b23-a0b9-4c32-9201-d992ebb901ce tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Acquiring lock "cinder-aa1b7451-775c-4219-859f-637b95dc0880-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:18:32 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-49f7957c-4071-4161-b75b-a4f521caee8f tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.644s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:32 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-49f7957c-4071-4161-b75b-a4f521caee8f tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:18:32 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-49f7957c-4071-4161-b75b-a4f521caee8f tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Deleted volume successfully.
Apr 28 22:18:32 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-67aa7b23-a0b9-4c32-9201-d992ebb901ce tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Lock "cinder-aa1b7451-775c-4219-859f-637b95dc0880-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:18:32 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[556737a0-ef4c-4fdf-b0c7-b067c9a85a93]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:18:32 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-9dd68681-687c-4ca3-a98e-afabbcf3afd2 tempest-SnapshotDependencyTests-1655070008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-123a3412-28f5-42ca-9424-50f31049250d {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:33 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-49f7957c-4071-4161-b75b-a4f521caee8f tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Lock "cinder-da4d9bf6-66e3-484b-9fdd-09e8641ba342-delete_volume" released by "delete_volume" :: held 2.369s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:18:33 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-67aa7b23-a0b9-4c32-9201-d992ebb901ce tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Acquiring lock "cinder-quobyte-aa1b7451-775c-4219-859f-637b95dc0880" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:18:33 devstack sudo[93519]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:33 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f86ea68a-4896-4e7b-8160-d180e358d610.82536a97-f81e-4035-a0ec-11e080b0ab3b" returned: 0 in 0.805s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:33 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f86ea68a-4896-4e7b-8160-d180e358d610(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 22:18:33 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f86ea68a-4896-4e7b-8160-d180e358d610 {{(pid=83924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 28 22:18:33 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] Creating direct copy from snapshot {{(pid=83924) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 28 22:18:33 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-67aa7b23-a0b9-4c32-9201-d992ebb901ce tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Lock "cinder-quobyte-aa1b7451-775c-4219-859f-637b95dc0880" acquired by "delete_volume" :: waited 0.018s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:18:33 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3cfe509-83b5-441a-92c0-8efc701abc9b]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:18:33 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f86ea68a-4896-4e7b-8160-d180e358d610 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:33 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f9a7e2-486b-4681-8379-4a798737146c]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:18:33 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-67aa7b23-a0b9-4c32-9201-d992ebb901ce tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-aa1b7451-775c-4219-859f-637b95dc0880 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:33 devstack sudo[93527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-123a3412-28f5-42ca-9424-50f31049250d
Apr 28 22:18:33 devstack sudo[93527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:33 devstack sudo[93528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f86ea68a-4896-4e7b-8160-d180e358d610
Apr 28 22:18:33 devstack sudo[93528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:33 devstack sudo[93529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-aa1b7451-775c-4219-859f-637b95dc0880
Apr 28 22:18:33 devstack sudo[93529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:33 devstack sudo[93527]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:33 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-9dd68681-687c-4ca3-a98e-afabbcf3afd2 tempest-SnapshotDependencyTests-1655070008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-123a3412-28f5-42ca-9424-50f31049250d" returned: 0 in 0.775s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:33 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-9dd68681-687c-4ca3-a98e-afabbcf3afd2 tempest-SnapshotDependencyTests-1655070008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-123a3412-28f5-42ca-9424-50f31049250d {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:33 devstack sudo[93529]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:33 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-67aa7b23-a0b9-4c32-9201-d992ebb901ce tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-aa1b7451-775c-4219-859f-637b95dc0880" returned: 0 in 0.705s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:33 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-67aa7b23-a0b9-4c32-9201-d992ebb901ce tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-aa1b7451-775c-4219-859f-637b95dc0880 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:33 devstack sudo[93544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-123a3412-28f5-42ca-9424-50f31049250d
Apr 28 22:18:33 devstack sudo[93544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:33 devstack sudo[93528]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:33 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f86ea68a-4896-4e7b-8160-d180e358d610" returned: 0 in 0.744s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:33 devstack sudo[93546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-aa1b7451-775c-4219-859f-637b95dc0880
Apr 28 22:18:33 devstack sudo[93546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:33 devstack cinder-volume[83924]: DEBUG cinder.utils [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] Path /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-393c2e15-d39c-4500-9c9c-b256c87bb969 not found in is_blk_device check {{(pid=83924) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 28 22:18:33 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f86ea68a-4896-4e7b-8160-d180e358d610 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-393c2e15-d39c-4500-9c9c-b256c87bb969 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:33 devstack sudo[93548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f86ea68a-4896-4e7b-8160-d180e358d610 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-393c2e15-d39c-4500-9c9c-b256c87bb969
Apr 28 22:18:33 devstack sudo[93548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:34 devstack sudo[93544]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:34 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-9dd68681-687c-4ca3-a98e-afabbcf3afd2 tempest-SnapshotDependencyTests-1655070008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-123a3412-28f5-42ca-9424-50f31049250d" returned: 0 in 0.572s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:34 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-9dd68681-687c-4ca3-a98e-afabbcf3afd2 tempest-SnapshotDependencyTests-1655070008 None] Lock "cinder-quobyte-123a3412-28f5-42ca-9424-50f31049250d" released by "delete_volume" :: held 1.439s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:18:34 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-9dd68681-687c-4ca3-a98e-afabbcf3afd2 tempest-SnapshotDependencyTests-1655070008 None] Created reservations ['623f25d4-6dc2-446c-8d4e-3464903e42ab', '48d794d8-cf66-41bf-9c75-b47fa72e6747', '962c5f1c-156f-4399-acd0-7c3bc7ee0e3d', '83ca7f6d-ea33-4534-ade1-2fc84962e14c'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:18:34 devstack sudo[93546]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:34 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-67aa7b23-a0b9-4c32-9201-d992ebb901ce tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-aa1b7451-775c-4219-859f-637b95dc0880" returned: 0 in 0.640s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:34 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-67aa7b23-a0b9-4c32-9201-d992ebb901ce tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Lock "cinder-quobyte-aa1b7451-775c-4219-859f-637b95dc0880" released by "delete_volume" :: held 1.393s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:18:34 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-9dd68681-687c-4ca3-a98e-afabbcf3afd2 tempest-SnapshotDependencyTests-1655070008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:18:34 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-9dd68681-687c-4ca3-a98e-afabbcf3afd2 tempest-SnapshotDependencyTests-1655070008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:18:34 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-9dd68681-687c-4ca3-a98e-afabbcf3afd2 tempest-SnapshotDependencyTests-1655070008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:18:34 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-9dd68681-687c-4ca3-a98e-afabbcf3afd2 tempest-SnapshotDependencyTests-1655070008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:18:34 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-9dd68681-687c-4ca3-a98e-afabbcf3afd2 tempest-SnapshotDependencyTests-1655070008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:18:34 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-9dd68681-687c-4ca3-a98e-afabbcf3afd2 tempest-SnapshotDependencyTests-1655070008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:34 devstack sudo[93555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:18:34 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-67aa7b23-a0b9-4c32-9201-d992ebb901ce tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Created reservations ['7db49665-24fc-42d7-98ea-1259272ecd4d', 'a8ba07c8-a2c1-4183-a2e6-5f1c5f7de2fe', '04d7d007-b124-4851-ae17-9ec1a2cbba7f', 'ff338865-54c0-4230-8a58-dbab8785b59d'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:18:34 devstack sudo[93555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:34 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-67aa7b23-a0b9-4c32-9201-d992ebb901ce tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:18:34 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-67aa7b23-a0b9-4c32-9201-d992ebb901ce tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:18:34 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-67aa7b23-a0b9-4c32-9201-d992ebb901ce tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:18:34 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-67aa7b23-a0b9-4c32-9201-d992ebb901ce tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:18:34 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-67aa7b23-a0b9-4c32-9201-d992ebb901ce tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:18:34 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-67aa7b23-a0b9-4c32-9201-d992ebb901ce tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:34 devstack sudo[93558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:18:34 devstack sudo[93558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:35 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-4ea42ca6-ae18-49cf-9958-67088459cf5e tempest-SnapshotDependencyTests-1655070008 None] Acquiring lock "cinder-9cd8af09-59bf-4e9c-884f-cdf4314c5fea-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:18:35 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-4ea42ca6-ae18-49cf-9958-67088459cf5e tempest-SnapshotDependencyTests-1655070008 None] Lock "cinder-9cd8af09-59bf-4e9c-884f-cdf4314c5fea-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:18:35 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-4ea42ca6-ae18-49cf-9958-67088459cf5e tempest-SnapshotDependencyTests-1655070008 None] Acquiring lock "cinder-quobyte-9cd8af09-59bf-4e9c-884f-cdf4314c5fea" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:18:35 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-4ea42ca6-ae18-49cf-9958-67088459cf5e tempest-SnapshotDependencyTests-1655070008 None] Lock "cinder-quobyte-9cd8af09-59bf-4e9c-884f-cdf4314c5fea" acquired by "delete_volume" :: waited 0.037s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:18:35 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[534640d3-58fc-42cc-bf5e-02f1d598ade8]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:18:35 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4ea42ca6-ae18-49cf-9958-67088459cf5e tempest-SnapshotDependencyTests-1655070008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9cd8af09-59bf-4e9c-884f-cdf4314c5fea {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:35 devstack sudo[93558]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:35 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-67aa7b23-a0b9-4c32-9201-d992ebb901ce tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 1.351s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:35 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-67aa7b23-a0b9-4c32-9201-d992ebb901ce tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:18:35 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-67aa7b23-a0b9-4c32-9201-d992ebb901ce tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Deleted volume successfully.
Apr 28 22:18:35 devstack sudo[93569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9cd8af09-59bf-4e9c-884f-cdf4314c5fea
Apr 28 22:18:35 devstack sudo[93569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:36 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-67aa7b23-a0b9-4c32-9201-d992ebb901ce tempest-CreateVolumesFromSourceVolumeTest-1267407124 None] Lock "cinder-aa1b7451-775c-4219-859f-637b95dc0880-delete_volume" released by "delete_volume" :: held 3.035s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:18:36 devstack sudo[93555]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:36 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-9dd68681-687c-4ca3-a98e-afabbcf3afd2 tempest-SnapshotDependencyTests-1655070008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 1.593s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:36 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-9dd68681-687c-4ca3-a98e-afabbcf3afd2 tempest-SnapshotDependencyTests-1655070008 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:18:36 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-9dd68681-687c-4ca3-a98e-afabbcf3afd2 tempest-SnapshotDependencyTests-1655070008 None] Deleted volume successfully.
Apr 28 22:18:36 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-9dd68681-687c-4ca3-a98e-afabbcf3afd2 tempest-SnapshotDependencyTests-1655070008 None] Lock "cinder-123a3412-28f5-42ca-9424-50f31049250d-delete_volume" released by "delete_volume" :: held 3.328s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:18:37 devstack sudo[93569]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:37 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4ea42ca6-ae18-49cf-9958-67088459cf5e tempest-SnapshotDependencyTests-1655070008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9cd8af09-59bf-4e9c-884f-cdf4314c5fea" returned: 0 in 1.841s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:37 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4ea42ca6-ae18-49cf-9958-67088459cf5e tempest-SnapshotDependencyTests-1655070008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9cd8af09-59bf-4e9c-884f-cdf4314c5fea {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:37 devstack sudo[93577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9cd8af09-59bf-4e9c-884f-cdf4314c5fea
Apr 28 22:18:37 devstack sudo[93577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:38 devstack sudo[93577]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:38 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4ea42ca6-ae18-49cf-9958-67088459cf5e tempest-SnapshotDependencyTests-1655070008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-9cd8af09-59bf-4e9c-884f-cdf4314c5fea" returned: 0 in 1.352s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:38 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-4ea42ca6-ae18-49cf-9958-67088459cf5e tempest-SnapshotDependencyTests-1655070008 None] Lock "cinder-quobyte-9cd8af09-59bf-4e9c-884f-cdf4314c5fea" released by "delete_volume" :: held 3.321s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:18:39 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-4ea42ca6-ae18-49cf-9958-67088459cf5e tempest-SnapshotDependencyTests-1655070008 None] Created reservations ['6957252d-dea3-42cb-b4e7-ff205d6030a9', '46d43642-1884-41f6-814f-27a6a14d2a5b', '82646e91-8154-441e-9c04-06507dd1a8e5', '9bd782a5-9a02-4946-9a98-4975c7953c1f'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:18:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-4ea42ca6-ae18-49cf-9958-67088459cf5e tempest-SnapshotDependencyTests-1655070008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:18:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-4ea42ca6-ae18-49cf-9958-67088459cf5e tempest-SnapshotDependencyTests-1655070008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:18:39 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-4ea42ca6-ae18-49cf-9958-67088459cf5e tempest-SnapshotDependencyTests-1655070008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:18:39 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-4ea42ca6-ae18-49cf-9958-67088459cf5e tempest-SnapshotDependencyTests-1655070008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:18:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-4ea42ca6-ae18-49cf-9958-67088459cf5e tempest-SnapshotDependencyTests-1655070008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:18:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4ea42ca6-ae18-49cf-9958-67088459cf5e tempest-SnapshotDependencyTests-1655070008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:39 devstack sudo[93580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:18:39 devstack sudo[93580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:39 devstack cinder-volume[83924]: DEBUG oslo_service.periodic_task [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83924) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 28 22:18:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:18:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:18:39 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:18:39 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:18:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:18:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:39 devstack sudo[93582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:18:39 devstack sudo[93582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:39 devstack sudo[93548]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f86ea68a-4896-4e7b-8160-d180e358d610 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-393c2e15-d39c-4500-9c9c-b256c87bb969" returned: 0 in 6.066s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:39 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7681a4-e1db-458a-8ca6-b197246226f8]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:18:39 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f86ea68a-4896-4e7b-8160-d180e358d610 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:40 devstack sudo[93584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f86ea68a-4896-4e7b-8160-d180e358d610
Apr 28 22:18:40 devstack sudo[93584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:40 devstack sudo[93580]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:40 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-4ea42ca6-ae18-49cf-9958-67088459cf5e tempest-SnapshotDependencyTests-1655070008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 1.034s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:40 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-4ea42ca6-ae18-49cf-9958-67088459cf5e tempest-SnapshotDependencyTests-1655070008 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:18:40 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-4ea42ca6-ae18-49cf-9958-67088459cf5e tempest-SnapshotDependencyTests-1655070008 None] Deleted volume successfully.
Apr 28 22:18:40 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-4ea42ca6-ae18-49cf-9958-67088459cf5e tempest-SnapshotDependencyTests-1655070008 None] Lock "cinder-9cd8af09-59bf-4e9c-884f-cdf4314c5fea-delete_volume" released by "delete_volume" :: held 4.937s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:18:40 devstack sudo[93582]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:40 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.773s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:40 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-89847cdb-d80b-4bdc-a11f-607899a11296 None None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:18:41 devstack sudo[93584]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:41 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f86ea68a-4896-4e7b-8160-d180e358d610" returned: 0 in 1.163s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:41 devstack cinder-volume[83924]: DEBUG cinder.image.image_utils [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] Image conversion details: src /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f86ea68a-4896-4e7b-8160-d180e358d610, size 1024.00 MB, duration 6.07 sec, destination /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-393c2e15-d39c-4500-9c9c-b256c87bb969 {{(pid=83924) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 28 22:18:41 devstack cinder-volume[83924]: INFO cinder.image.image_utils [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] Converted 1024.00 MB image at 168.75 MB/s
Apr 28 22:18:41 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-393c2e15-d39c-4500-9c9c-b256c87bb969 is being set with open permissions: ugo+rw
Apr 28 22:18:41 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-393c2e15-d39c-4500-9c9c-b256c87bb969 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:41 devstack sudo[93591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-393c2e15-d39c-4500-9c9c-b256c87bb969
Apr 28 22:18:41 devstack sudo[93591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:41 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6cac174-4cfe-49b1-b472-0cc4a5084494 tempest-CinderUnicodeTest-1374334805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:18:41 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b6cac174-4cfe-49b1-b472-0cc4a5084494 tempest-CinderUnicodeTest-1374334805 None] Flow 'volume_create_manager' (6dd1a72a-568c-4b81-8f10-9235208ba4a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:18:41 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b6cac174-4cfe-49b1-b472-0cc4a5084494 tempest-CinderUnicodeTest-1374334805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ebc0e74-38df-40b2-a4d8-26756ec189a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:18:41 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b6cac174-4cfe-49b1-b472-0cc4a5084494 tempest-CinderUnicodeTest-1374334805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ebc0e74-38df-40b2-a4d8-26756ec189a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:18:41Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10113798-bd25-4cf7-a058-603a02799831,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bd93a301605473f97960a09f762b376',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:18:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:18:41Z,use_quota=True,user_id='9377d4e386fb4d039185592206faab46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:18:41 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b6cac174-4cfe-49b1-b472-0cc4a5084494 tempest-CinderUnicodeTest-1374334805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02fbc358-fcc1-4aad-85de-219e0de70c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:18:41 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b6cac174-4cfe-49b1-b472-0cc4a5084494 tempest-CinderUnicodeTest-1374334805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02fbc358-fcc1-4aad-85de-219e0de70c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:18:41 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b6cac174-4cfe-49b1-b472-0cc4a5084494 tempest-CinderUnicodeTest-1374334805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (249e8cec-8fa7-4264-9c2d-df15189da791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:18:41 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b6cac174-4cfe-49b1-b472-0cc4a5084494 tempest-CinderUnicodeTest-1374334805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (249e8cec-8fa7-4264-9c2d-df15189da791) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10113798-bd25-4cf7-a058-603a02799831', 'volume_name': 'volume-10113798-bd25-4cf7-a058-603a02799831', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:18:41 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b6cac174-4cfe-49b1-b472-0cc4a5084494 tempest-CinderUnicodeTest-1374334805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e86646b1-8044-4c70-ac8c-316432263401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:18:41 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b6cac174-4cfe-49b1-b472-0cc4a5084494 tempest-CinderUnicodeTest-1374334805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e86646b1-8044-4c70-ac8c-316432263401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:18:41 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b6cac174-4cfe-49b1-b472-0cc4a5084494 tempest-CinderUnicodeTest-1374334805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43cb0bfa-4d34-4546-af93-e8fcefbbab6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:18:41 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-b6cac174-4cfe-49b1-b472-0cc4a5084494 tempest-CinderUnicodeTest-1374334805 None] Volume 10113798-bd25-4cf7-a058-603a02799831: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10113798-bd25-4cf7-a058-603a02799831', 'volume_size': 1}
Apr 28 22:18:41 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b6cac174-4cfe-49b1-b472-0cc4a5084494 tempest-CinderUnicodeTest-1374334805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:18:41 devstack sudo[93591]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:41 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-393c2e15-d39c-4500-9c9c-b256c87bb969" returned: 0 in 0.589s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:41 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] Lock "cinder-quobyte-393c2e15-d39c-4500-9c9c-b256c87bb969" released by "_copy_volume_from_snapshot" :: held 9.474s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:18:41 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] Acquiring lock "cinder-quobyte-82536a97-f81e-4035-a0ec-11e080b0ab3b" by "_delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:18:41 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] Lock "cinder-quobyte-82536a97-f81e-4035-a0ec-11e080b0ab3b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:18:41 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] Deleting offline snapshot 82536a97-f81e-4035-a0ec-11e080b0ab3b of volume f86ea68a-4896-4e7b-8160-d180e358d610 {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 22:18:41 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] snapshot_file for this snap is: volume-f86ea68a-4896-4e7b-8160-d180e358d610.82536a97-f81e-4035-a0ec-11e080b0ab3b {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 22:18:41 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab3a527-84db-4b89-a01e-53b7427f82f9]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:18:41 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f86ea68a-4896-4e7b-8160-d180e358d610.82536a97-f81e-4035-a0ec-11e080b0ab3b {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:41 devstack sudo[93595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f86ea68a-4896-4e7b-8160-d180e358d610.82536a97-f81e-4035-a0ec-11e080b0ab3b
Apr 28 22:18:41 devstack sudo[93595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:42 devstack sudo[93595]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:42 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f86ea68a-4896-4e7b-8160-d180e358d610.82536a97-f81e-4035-a0ec-11e080b0ab3b" returned: 0 in 0.670s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:42 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f86ea68a-4896-4e7b-8160-d180e358d610(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 22:18:42 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[292d5e74-f812-4c02-a2ad-5085b29cdcc3]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:18:42 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f86ea68a-4896-4e7b-8160-d180e358d610 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:42 devstack sudo[93600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f86ea68a-4896-4e7b-8160-d180e358d610
Apr 28 22:18:42 devstack sudo[93600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:43 devstack sudo[93600]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:43 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f86ea68a-4896-4e7b-8160-d180e358d610" returned: 0 in 0.745s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:43 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f86ea68a-4896-4e7b-8160-d180e358d610.82536a97-f81e-4035-a0ec-11e080b0ab3b {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:43 devstack sudo[93607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f86ea68a-4896-4e7b-8160-d180e358d610.82536a97-f81e-4035-a0ec-11e080b0ab3b
Apr 28 22:18:43 devstack sudo[93607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:44 devstack sudo[93607]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:44 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f86ea68a-4896-4e7b-8160-d180e358d610.82536a97-f81e-4035-a0ec-11e080b0ab3b" returned: 0 in 0.867s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:44 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f86ea68a-4896-4e7b-8160-d180e358d610.82536a97-f81e-4035-a0ec-11e080b0ab3b {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:44 devstack sudo[93613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f86ea68a-4896-4e7b-8160-d180e358d610.82536a97-f81e-4035-a0ec-11e080b0ab3b
Apr 28 22:18:44 devstack sudo[93613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:44 devstack sudo[93613]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:44 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f86ea68a-4896-4e7b-8160-d180e358d610.82536a97-f81e-4035-a0ec-11e080b0ab3b" returned: 0 in 0.580s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:44 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] Lock "cinder-quobyte-82536a97-f81e-4035-a0ec-11e080b0ab3b" released by "_delete_snapshot" :: held 2.984s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:18:44 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.973s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:18:44 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b6cac174-4cfe-49b1-b472-0cc4a5084494 tempest-CinderUnicodeTest-1374334805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.443s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:18:44 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-b6cac174-4cfe-49b1-b472-0cc4a5084494 tempest-CinderUnicodeTest-1374334805 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:18:41Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10113798-bd25-4cf7-a058-603a02799831,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bd93a301605473f97960a09f762b376',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:18:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:18:41Z,use_quota=True,user_id='9377d4e386fb4d039185592206faab46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:18:44 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-b6cac174-4cfe-49b1-b472-0cc4a5084494 tempest-CinderUnicodeTest-1374334805 None] Creating volume 10113798-bd25-4cf7-a058-603a02799831 {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:18:44 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b6cac174-4cfe-49b1-b472-0cc4a5084494 tempest-CinderUnicodeTest-1374334805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:18:44 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b6cac174-4cfe-49b1-b472-0cc4a5084494 tempest-CinderUnicodeTest-1374334805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:18:44 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-b6cac174-4cfe-49b1-b472-0cc4a5084494 tempest-CinderUnicodeTest-1374334805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:18:44 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-b6cac174-4cfe-49b1-b472-0cc4a5084494 tempest-CinderUnicodeTest-1374334805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:18:44 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b6cac174-4cfe-49b1-b472-0cc4a5084494 tempest-CinderUnicodeTest-1374334805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:18:44 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-b6cac174-4cfe-49b1-b472-0cc4a5084494 tempest-CinderUnicodeTest-1374334805 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:18:44 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-b6cac174-4cfe-49b1-b472-0cc4a5084494 tempest-CinderUnicodeTest-1374334805 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:18:44 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b6cac174-4cfe-49b1-b472-0cc4a5084494 tempest-CinderUnicodeTest-1374334805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10113798-bd25-4cf7-a058-603a02799831 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:44 devstack sudo[93616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10113798-bd25-4cf7-a058-603a02799831 1073741824
Apr 28 22:18:44 devstack sudo[93616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:44 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4220b806-2a7b-490d-9605-8bad9727198a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-393c2e15-d39c-4500-9c9c-b256c87bb969', 'volume_size': 1, 'source_volid': 'f86ea68a-4896-4e7b-8160-d180e358d610', 'source_volstatus': 'available'}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:18:44 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08393928-2480-43cd-a015-4dab4fbca17f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:18:44 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] Volume volume-393c2e15-d39c-4500-9c9c-b256c87bb969 (393c2e15-d39c-4500-9c9c-b256c87bb969): created successfully
Apr 28 22:18:44 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08393928-2480-43cd-a015-4dab4fbca17f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:18:44 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] Flow 'volume_create_manager' (c0efc716-445e-4ed4-baec-08bc61c8ff9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:18:44 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-59e754b0-6d70-4a5a-9b67-0bf2f0a42d29 tempest-VolumeDependencyTests-1826445949 None] Created volume successfully.
Apr 28 22:18:45 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-5ab70950-1043-49af-a26b-f88b5bfa17bf tempest-VolumeDependencyTests-1826445949 None] Acquiring lock "cinder-f86ea68a-4896-4e7b-8160-d180e358d610-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:18:45 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-5ab70950-1043-49af-a26b-f88b5bfa17bf tempest-VolumeDependencyTests-1826445949 None] Lock "cinder-f86ea68a-4896-4e7b-8160-d180e358d610-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:18:45 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-5ab70950-1043-49af-a26b-f88b5bfa17bf tempest-VolumeDependencyTests-1826445949 None] Acquiring lock "cinder-quobyte-f86ea68a-4896-4e7b-8160-d180e358d610" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:18:45 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-5ab70950-1043-49af-a26b-f88b5bfa17bf tempest-VolumeDependencyTests-1826445949 None] Lock "cinder-quobyte-f86ea68a-4896-4e7b-8160-d180e358d610" acquired by "delete_volume" :: waited 0.024s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:18:45 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[7837c97c-af47-4f33-8a3d-504532bd298e]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:18:45 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5ab70950-1043-49af-a26b-f88b5bfa17bf tempest-VolumeDependencyTests-1826445949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f86ea68a-4896-4e7b-8160-d180e358d610 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:45 devstack sudo[93620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f86ea68a-4896-4e7b-8160-d180e358d610
Apr 28 22:18:45 devstack sudo[93620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:45 devstack sudo[93616]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:45 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b6cac174-4cfe-49b1-b472-0cc4a5084494 tempest-CinderUnicodeTest-1374334805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10113798-bd25-4cf7-a058-603a02799831 1073741824" returned: 0 in 0.933s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:45 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b6cac174-4cfe-49b1-b472-0cc4a5084494 tempest-CinderUnicodeTest-1374334805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10113798-bd25-4cf7-a058-603a02799831 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:45 devstack sudo[93624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10113798-bd25-4cf7-a058-603a02799831
Apr 28 22:18:45 devstack sudo[93624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:46 devstack sudo[93620]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5ab70950-1043-49af-a26b-f88b5bfa17bf tempest-VolumeDependencyTests-1826445949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f86ea68a-4896-4e7b-8160-d180e358d610" returned: 0 in 0.773s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5ab70950-1043-49af-a26b-f88b5bfa17bf tempest-VolumeDependencyTests-1826445949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f86ea68a-4896-4e7b-8160-d180e358d610 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:46 devstack sudo[93629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f86ea68a-4896-4e7b-8160-d180e358d610
Apr 28 22:18:46 devstack sudo[93629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:46 devstack sudo[93624]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b6cac174-4cfe-49b1-b472-0cc4a5084494 tempest-CinderUnicodeTest-1374334805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10113798-bd25-4cf7-a058-603a02799831" returned: 0 in 0.659s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:46 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-b6cac174-4cfe-49b1-b472-0cc4a5084494 tempest-CinderUnicodeTest-1374334805 None] <== create_volume: return (1644ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:18:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b6cac174-4cfe-49b1-b472-0cc4a5084494 tempest-CinderUnicodeTest-1374334805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.658s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:18:46 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b6cac174-4cfe-49b1-b472-0cc4a5084494 tempest-CinderUnicodeTest-1374334805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43cb0bfa-4d34-4546-af93-e8fcefbbab6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10113798-bd25-4cf7-a058-603a02799831', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:18:46 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b6cac174-4cfe-49b1-b472-0cc4a5084494 tempest-CinderUnicodeTest-1374334805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0030d6d-2fad-4b4d-8022-599e6598cf6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:18:46 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-b6cac174-4cfe-49b1-b472-0cc4a5084494 tempest-CinderUnicodeTest-1374334805 None] Volume volume-10113798-bd25-4cf7-a058-603a02799831 (10113798-bd25-4cf7-a058-603a02799831): created successfully
Apr 28 22:18:46 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b6cac174-4cfe-49b1-b472-0cc4a5084494 tempest-CinderUnicodeTest-1374334805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0030d6d-2fad-4b4d-8022-599e6598cf6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:18:46 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-b6cac174-4cfe-49b1-b472-0cc4a5084494 tempest-CinderUnicodeTest-1374334805 None] Flow 'volume_create_manager' (6dd1a72a-568c-4b81-8f10-9235208ba4a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:18:46 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-b6cac174-4cfe-49b1-b472-0cc4a5084494 tempest-CinderUnicodeTest-1374334805 None] Created volume successfully.
Apr 28 22:18:46 devstack sudo[93629]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5ab70950-1043-49af-a26b-f88b5bfa17bf tempest-VolumeDependencyTests-1826445949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f86ea68a-4896-4e7b-8160-d180e358d610" returned: 0 in 0.653s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:46 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-5ab70950-1043-49af-a26b-f88b5bfa17bf tempest-VolumeDependencyTests-1826445949 None] Lock "cinder-quobyte-f86ea68a-4896-4e7b-8160-d180e358d610" released by "delete_volume" :: held 1.521s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:18:46 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-5ab70950-1043-49af-a26b-f88b5bfa17bf tempest-VolumeDependencyTests-1826445949 None] Created reservations ['fa686617-3bc3-4d9c-8047-c23eb4d385b3', 'a39e36e9-fc8e-4ce7-84ec-cd74e661fe13', '803e2df9-10d3-4733-8b80-e2c00593b713', '50fffe49-b91b-403c-ad68-4add577ee37c'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:18:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-5ab70950-1043-49af-a26b-f88b5bfa17bf tempest-VolumeDependencyTests-1826445949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:18:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-5ab70950-1043-49af-a26b-f88b5bfa17bf tempest-VolumeDependencyTests-1826445949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:18:46 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-5ab70950-1043-49af-a26b-f88b5bfa17bf tempest-VolumeDependencyTests-1826445949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:18:46 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-5ab70950-1043-49af-a26b-f88b5bfa17bf tempest-VolumeDependencyTests-1826445949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:18:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-5ab70950-1043-49af-a26b-f88b5bfa17bf tempest-VolumeDependencyTests-1826445949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:18:46 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5ab70950-1043-49af-a26b-f88b5bfa17bf tempest-VolumeDependencyTests-1826445949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:47 devstack sudo[93633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:18:47 devstack sudo[93633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:47 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-45e26b08-9aa9-40ac-96f8-f47adc88f72c tempest-VolumeDependencyTests-1826445949 None] Acquiring lock "cinder-393c2e15-d39c-4500-9c9c-b256c87bb969-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:18:47 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-45e26b08-9aa9-40ac-96f8-f47adc88f72c tempest-VolumeDependencyTests-1826445949 None] Lock "cinder-393c2e15-d39c-4500-9c9c-b256c87bb969-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:18:47 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-45e26b08-9aa9-40ac-96f8-f47adc88f72c tempest-VolumeDependencyTests-1826445949 None] Acquiring lock "cinder-quobyte-393c2e15-d39c-4500-9c9c-b256c87bb969" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:18:47 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-45e26b08-9aa9-40ac-96f8-f47adc88f72c tempest-VolumeDependencyTests-1826445949 None] Lock "cinder-quobyte-393c2e15-d39c-4500-9c9c-b256c87bb969" acquired by "delete_volume" :: waited 0.017s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:18:47 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[6998d5db-7274-40ae-8926-a2c7e42e35c9]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:18:47 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-45e26b08-9aa9-40ac-96f8-f47adc88f72c tempest-VolumeDependencyTests-1826445949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-393c2e15-d39c-4500-9c9c-b256c87bb969 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:47 devstack sudo[93633]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:47 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-5ab70950-1043-49af-a26b-f88b5bfa17bf tempest-VolumeDependencyTests-1826445949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.667s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:47 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-5ab70950-1043-49af-a26b-f88b5bfa17bf tempest-VolumeDependencyTests-1826445949 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:18:47 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-5ab70950-1043-49af-a26b-f88b5bfa17bf tempest-VolumeDependencyTests-1826445949 None] Deleted volume successfully.
Apr 28 22:18:47 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-5ab70950-1043-49af-a26b-f88b5bfa17bf tempest-VolumeDependencyTests-1826445949 None] Lock "cinder-f86ea68a-4896-4e7b-8160-d180e358d610-delete_volume" released by "delete_volume" :: held 2.493s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:18:47 devstack sudo[93636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-393c2e15-d39c-4500-9c9c-b256c87bb969
Apr 28 22:18:47 devstack sudo[93636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:48 devstack cinder-volume[83924]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a0ee5fa-91f9-448e-acd1-2a02a1e2b2da tempest-CinderUnicodeTest-1374334805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83924) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 22:18:48 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-2a0ee5fa-91f9-448e-acd1-2a02a1e2b2da tempest-CinderUnicodeTest-1374334805 None] Flow 'volume_create_manager' (8d5f6317-0c3b-4682-91dd-a6e917b18153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:18:48 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-2a0ee5fa-91f9-448e-acd1-2a02a1e2b2da tempest-CinderUnicodeTest-1374334805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d0a0346-9f30-4b95-9a24-4250574df518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:18:48 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-2a0ee5fa-91f9-448e-acd1-2a02a1e2b2da tempest-CinderUnicodeTest-1374334805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d0a0346-9f30-4b95-9a24-4250574df518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:18:48Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1145476229',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f05930da-34a5-4c7a-aabf-89f2cc610cea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bd93a301605473f97960a09f762b376',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:18:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:18:48Z,use_quota=True,user_id='9377d4e386fb4d039185592206faab46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:18:48 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-2a0ee5fa-91f9-448e-acd1-2a02a1e2b2da tempest-CinderUnicodeTest-1374334805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b21232fc-f9f9-479d-ab90-4fc7daccdb3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:18:48 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-2a0ee5fa-91f9-448e-acd1-2a02a1e2b2da tempest-CinderUnicodeTest-1374334805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b21232fc-f9f9-479d-ab90-4fc7daccdb3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:18:48 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-2a0ee5fa-91f9-448e-acd1-2a02a1e2b2da tempest-CinderUnicodeTest-1374334805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2efa74c2-0133-43c4-a64a-64874abc73e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:18:48 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-2a0ee5fa-91f9-448e-acd1-2a02a1e2b2da tempest-CinderUnicodeTest-1374334805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2efa74c2-0133-43c4-a64a-64874abc73e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f05930da-34a5-4c7a-aabf-89f2cc610cea', 'volume_name': 'volume-f05930da-34a5-4c7a-aabf-89f2cc610cea', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:18:48 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-2a0ee5fa-91f9-448e-acd1-2a02a1e2b2da tempest-CinderUnicodeTest-1374334805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bb6e251-9157-42a8-a84c-adb165e86cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:18:48 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-2a0ee5fa-91f9-448e-acd1-2a02a1e2b2da tempest-CinderUnicodeTest-1374334805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bb6e251-9157-42a8-a84c-adb165e86cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:18:48 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-2a0ee5fa-91f9-448e-acd1-2a02a1e2b2da tempest-CinderUnicodeTest-1374334805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ecaa518-01b1-43e8-9fb7-0d8c34ebb13c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:18:48 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-2a0ee5fa-91f9-448e-acd1-2a02a1e2b2da tempest-CinderUnicodeTest-1374334805 None] Volume f05930da-34a5-4c7a-aabf-89f2cc610cea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f05930da-34a5-4c7a-aabf-89f2cc610cea', 'volume_size': 1}
Apr 28 22:18:48 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-2a0ee5fa-91f9-448e-acd1-2a02a1e2b2da tempest-CinderUnicodeTest-1374334805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:18:48 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-2a0ee5fa-91f9-448e-acd1-2a02a1e2b2da tempest-CinderUnicodeTest-1374334805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:18:48 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-2a0ee5fa-91f9-448e-acd1-2a02a1e2b2da tempest-CinderUnicodeTest-1374334805 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7844d61e8d40>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T20:18:48Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1145476229',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f05930da-34a5-4c7a-aabf-89f2cc610cea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bd93a301605473f97960a09f762b376',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T20:18:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T20:18:48Z,use_quota=True,user_id='9377d4e386fb4d039185592206faab46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97d054bb-f465-4976-ba1c-b23b59b9587b),volume_type_id=97d054bb-f465-4976-ba1c-b23b59b9587b)}" {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 22:18:48 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-2a0ee5fa-91f9-448e-acd1-2a02a1e2b2da tempest-CinderUnicodeTest-1374334805 None] Creating volume f05930da-34a5-4c7a-aabf-89f2cc610cea {{(pid=83924) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 22:18:48 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-2a0ee5fa-91f9-448e-acd1-2a02a1e2b2da tempest-CinderUnicodeTest-1374334805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:18:48 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-2a0ee5fa-91f9-448e-acd1-2a02a1e2b2da tempest-CinderUnicodeTest-1374334805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:18:48 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-2a0ee5fa-91f9-448e-acd1-2a02a1e2b2da tempest-CinderUnicodeTest-1374334805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:18:48 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-2a0ee5fa-91f9-448e-acd1-2a02a1e2b2da tempest-CinderUnicodeTest-1374334805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:18:48 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-2a0ee5fa-91f9-448e-acd1-2a02a1e2b2da tempest-CinderUnicodeTest-1374334805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:18:48 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-2a0ee5fa-91f9-448e-acd1-2a02a1e2b2da tempest-CinderUnicodeTest-1374334805 None] Selected osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2 as target Quobyte volume. {{(pid=83924) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 22:18:48 devstack cinder-volume[83924]: INFO cinder.volume.drivers.remotefs [None req-2a0ee5fa-91f9-448e-acd1-2a02a1e2b2da tempest-CinderUnicodeTest-1374334805 None] casted to osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2
Apr 28 22:18:48 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-2a0ee5fa-91f9-448e-acd1-2a02a1e2b2da tempest-CinderUnicodeTest-1374334805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f05930da-34a5-4c7a-aabf-89f2cc610cea 1073741824 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:48 devstack sudo[93642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f05930da-34a5-4c7a-aabf-89f2cc610cea 1073741824
Apr 28 22:18:48 devstack sudo[93642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:48 devstack sudo[93636]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:48 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-45e26b08-9aa9-40ac-96f8-f47adc88f72c tempest-VolumeDependencyTests-1826445949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-393c2e15-d39c-4500-9c9c-b256c87bb969" returned: 0 in 0.860s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:48 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-45e26b08-9aa9-40ac-96f8-f47adc88f72c tempest-VolumeDependencyTests-1826445949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-393c2e15-d39c-4500-9c9c-b256c87bb969 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:48 devstack sudo[93644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-393c2e15-d39c-4500-9c9c-b256c87bb969
Apr 28 22:18:48 devstack sudo[93644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:49 devstack sudo[93644]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:49 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-45e26b08-9aa9-40ac-96f8-f47adc88f72c tempest-VolumeDependencyTests-1826445949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-393c2e15-d39c-4500-9c9c-b256c87bb969" returned: 0 in 0.623s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:49 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-45e26b08-9aa9-40ac-96f8-f47adc88f72c tempest-VolumeDependencyTests-1826445949 None] Lock "cinder-quobyte-393c2e15-d39c-4500-9c9c-b256c87bb969" released by "delete_volume" :: held 1.531s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:18:49 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-45e26b08-9aa9-40ac-96f8-f47adc88f72c tempest-VolumeDependencyTests-1826445949 None] Created reservations ['c75fc8e8-0513-4f32-b10c-5a18f110f11c', 'dc46ff19-6bf5-40cd-bbb3-244e9ab95505', '686788eb-5a47-49ad-8bb1-4dda35edede5', '610aff92-36c7-45bd-bc93-8b28626ae1dc'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:18:49 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-45e26b08-9aa9-40ac-96f8-f47adc88f72c tempest-VolumeDependencyTests-1826445949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:18:49 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-45e26b08-9aa9-40ac-96f8-f47adc88f72c tempest-VolumeDependencyTests-1826445949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:18:49 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-45e26b08-9aa9-40ac-96f8-f47adc88f72c tempest-VolumeDependencyTests-1826445949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:18:49 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-45e26b08-9aa9-40ac-96f8-f47adc88f72c tempest-VolumeDependencyTests-1826445949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:18:49 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-45e26b08-9aa9-40ac-96f8-f47adc88f72c tempest-VolumeDependencyTests-1826445949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:18:49 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-45e26b08-9aa9-40ac-96f8-f47adc88f72c tempest-VolumeDependencyTests-1826445949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:49 devstack sudo[93650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:18:49 devstack sudo[93650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:49 devstack sudo[93642]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:49 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-2a0ee5fa-91f9-448e-acd1-2a02a1e2b2da tempest-CinderUnicodeTest-1374334805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f05930da-34a5-4c7a-aabf-89f2cc610cea 1073741824" returned: 0 in 0.941s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:49 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-2a0ee5fa-91f9-448e-acd1-2a02a1e2b2da tempest-CinderUnicodeTest-1374334805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f05930da-34a5-4c7a-aabf-89f2cc610cea {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:49 devstack sudo[93652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f05930da-34a5-4c7a-aabf-89f2cc610cea
Apr 28 22:18:49 devstack sudo[93652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:49 devstack sudo[93650]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:49 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-45e26b08-9aa9-40ac-96f8-f47adc88f72c tempest-VolumeDependencyTests-1826445949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.635s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:49 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-45e26b08-9aa9-40ac-96f8-f47adc88f72c tempest-VolumeDependencyTests-1826445949 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:18:49 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-45e26b08-9aa9-40ac-96f8-f47adc88f72c tempest-VolumeDependencyTests-1826445949 None] Deleted volume successfully.
Apr 28 22:18:49 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-45e26b08-9aa9-40ac-96f8-f47adc88f72c tempest-VolumeDependencyTests-1826445949 None] Lock "cinder-393c2e15-d39c-4500-9c9c-b256c87bb969-delete_volume" released by "delete_volume" :: held 2.416s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:18:49 devstack sudo[93652]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:50 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-2a0ee5fa-91f9-448e-acd1-2a02a1e2b2da tempest-CinderUnicodeTest-1374334805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f05930da-34a5-4c7a-aabf-89f2cc610cea" returned: 0 in 0.691s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:50 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-2a0ee5fa-91f9-448e-acd1-2a02a1e2b2da tempest-CinderUnicodeTest-1374334805 None] <== create_volume: return (1676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'} {{(pid=83924) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 22:18:50 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-2a0ee5fa-91f9-448e-acd1-2a02a1e2b2da tempest-CinderUnicodeTest-1374334805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.678s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:18:50 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-2a0ee5fa-91f9-448e-acd1-2a02a1e2b2da tempest-CinderUnicodeTest-1374334805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ecaa518-01b1-43e8-9fb7-0d8c34ebb13c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f05930da-34a5-4c7a-aabf-89f2cc610cea', 'volume_size': 1}' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:18:50 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-2a0ee5fa-91f9-448e-acd1-2a02a1e2b2da tempest-CinderUnicodeTest-1374334805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71dcc6fd-06bf-4a0d-9b75-a6be0cb65e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 22:18:50 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-88e96849-8ddc-42fe-9a22-26401d03158c tempest-VolumeDependencyTests-1826445949 None] Acquiring lock "cinder-15fd5642-02a9-4f15-a052-b6159a068a24-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:18:50 devstack cinder-volume[83924]: INFO cinder.volume.flows.manager.create_volume [None req-2a0ee5fa-91f9-448e-acd1-2a02a1e2b2da tempest-CinderUnicodeTest-1374334805 None] Volume volume-f05930da-34a5-4c7a-aabf-89f2cc610cea (f05930da-34a5-4c7a-aabf-89f2cc610cea): created successfully
Apr 28 22:18:50 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-2a0ee5fa-91f9-448e-acd1-2a02a1e2b2da tempest-CinderUnicodeTest-1374334805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71dcc6fd-06bf-4a0d-9b75-a6be0cb65e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83924) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 22:18:50 devstack cinder-volume[83924]: DEBUG cinder.volume.manager [None req-2a0ee5fa-91f9-448e-acd1-2a02a1e2b2da tempest-CinderUnicodeTest-1374334805 None] Flow 'volume_create_manager' (8d5f6317-0c3b-4682-91dd-a6e917b18153) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83924) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 22:18:50 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-88e96849-8ddc-42fe-9a22-26401d03158c tempest-VolumeDependencyTests-1826445949 None] Lock "cinder-15fd5642-02a9-4f15-a052-b6159a068a24-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:18:50 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-2a0ee5fa-91f9-448e-acd1-2a02a1e2b2da tempest-CinderUnicodeTest-1374334805 None] Created volume successfully.
Apr 28 22:18:50 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-88e96849-8ddc-42fe-9a22-26401d03158c tempest-VolumeDependencyTests-1826445949 None] Acquiring lock "cinder-quobyte-15fd5642-02a9-4f15-a052-b6159a068a24" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:18:50 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-88e96849-8ddc-42fe-9a22-26401d03158c tempest-VolumeDependencyTests-1826445949 None] Lock "cinder-quobyte-15fd5642-02a9-4f15-a052-b6159a068a24" acquired by "delete_volume" :: waited 0.015s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:18:50 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d856c51-0966-4008-b549-da73b6099676]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:18:50 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-88e96849-8ddc-42fe-9a22-26401d03158c tempest-VolumeDependencyTests-1826445949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-15fd5642-02a9-4f15-a052-b6159a068a24 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:50 devstack sudo[93656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-15fd5642-02a9-4f15-a052-b6159a068a24
Apr 28 22:18:50 devstack sudo[93656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:50 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-26c88b2b-1e3a-437b-9927-09493ba7968c tempest-CinderUnicodeTest-1374334805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:18:50 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-26c88b2b-1e3a-437b-9927-09493ba7968c tempest-CinderUnicodeTest-1374334805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:18:50 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-26c88b2b-1e3a-437b-9927-09493ba7968c tempest-CinderUnicodeTest-1374334805 None] Creating offline snapshot d2f0c430-2eeb-468d-8ccc-cef5032ef7bc of volume f05930da-34a5-4c7a-aabf-89f2cc610cea {{(pid=83924) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 22:18:50 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed6f8c7-b546-4930-81b7-8bd2b752e7d9]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:18:50 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-26c88b2b-1e3a-437b-9927-09493ba7968c tempest-CinderUnicodeTest-1374334805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f05930da-34a5-4c7a-aabf-89f2cc610cea {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:50 devstack sudo[93658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f05930da-34a5-4c7a-aabf-89f2cc610cea
Apr 28 22:18:50 devstack sudo[93658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:50 devstack sudo[93656]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:50 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-88e96849-8ddc-42fe-9a22-26401d03158c tempest-VolumeDependencyTests-1826445949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-15fd5642-02a9-4f15-a052-b6159a068a24" returned: 0 in 0.687s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:50 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-88e96849-8ddc-42fe-9a22-26401d03158c tempest-VolumeDependencyTests-1826445949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-15fd5642-02a9-4f15-a052-b6159a068a24 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:50 devstack sudo[93663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-15fd5642-02a9-4f15-a052-b6159a068a24
Apr 28 22:18:50 devstack sudo[93663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:51 devstack sudo[93658]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-26c88b2b-1e3a-437b-9927-09493ba7968c tempest-CinderUnicodeTest-1374334805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f05930da-34a5-4c7a-aabf-89f2cc610cea" returned: 0 in 0.705s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-26c88b2b-1e3a-437b-9927-09493ba7968c tempest-CinderUnicodeTest-1374334805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f05930da-34a5-4c7a-aabf-89f2cc610cea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f05930da-34a5-4c7a-aabf-89f2cc610cea.d2f0c430-2eeb-468d-8ccc-cef5032ef7bc 1G {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:51 devstack sudo[93668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f05930da-34a5-4c7a-aabf-89f2cc610cea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f05930da-34a5-4c7a-aabf-89f2cc610cea.d2f0c430-2eeb-468d-8ccc-cef5032ef7bc 1G
Apr 28 22:18:51 devstack sudo[93668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:51 devstack sudo[93663]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-88e96849-8ddc-42fe-9a22-26401d03158c tempest-VolumeDependencyTests-1826445949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-15fd5642-02a9-4f15-a052-b6159a068a24" returned: 0 in 0.642s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:51 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-88e96849-8ddc-42fe-9a22-26401d03158c tempest-VolumeDependencyTests-1826445949 None] Lock "cinder-quobyte-15fd5642-02a9-4f15-a052-b6159a068a24" released by "delete_volume" :: held 1.370s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:18:51 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-88e96849-8ddc-42fe-9a22-26401d03158c tempest-VolumeDependencyTests-1826445949 None] Created reservations ['eb235774-d799-4470-8752-1decc397dae6', '34d3a7a0-2ade-4b97-98d3-8e90b9a7b297', '21ffdac7-8b11-45c7-b7f3-a669f9927065', 'd286a784-a755-4054-bec2-f8c9ec066107'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:18:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-88e96849-8ddc-42fe-9a22-26401d03158c tempest-VolumeDependencyTests-1826445949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:18:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-88e96849-8ddc-42fe-9a22-26401d03158c tempest-VolumeDependencyTests-1826445949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:18:51 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-88e96849-8ddc-42fe-9a22-26401d03158c tempest-VolumeDependencyTests-1826445949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:18:51 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-88e96849-8ddc-42fe-9a22-26401d03158c tempest-VolumeDependencyTests-1826445949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:18:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-88e96849-8ddc-42fe-9a22-26401d03158c tempest-VolumeDependencyTests-1826445949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:18:51 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-88e96849-8ddc-42fe-9a22-26401d03158c tempest-VolumeDependencyTests-1826445949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:51 devstack sudo[93671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:18:51 devstack sudo[93671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:52 devstack sudo[93668]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:52 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-26c88b2b-1e3a-437b-9927-09493ba7968c tempest-CinderUnicodeTest-1374334805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f05930da-34a5-4c7a-aabf-89f2cc610cea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f05930da-34a5-4c7a-aabf-89f2cc610cea.d2f0c430-2eeb-468d-8ccc-cef5032ef7bc 1G" returned: 0 in 0.746s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:52 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-26c88b2b-1e3a-437b-9927-09493ba7968c tempest-CinderUnicodeTest-1374334805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f05930da-34a5-4c7a-aabf-89f2cc610cea -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f05930da-34a5-4c7a-aabf-89f2cc610cea.d2f0c430-2eeb-468d-8ccc-cef5032ef7bc {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:52 devstack sudo[93676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f05930da-34a5-4c7a-aabf-89f2cc610cea -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f05930da-34a5-4c7a-aabf-89f2cc610cea.d2f0c430-2eeb-468d-8ccc-cef5032ef7bc
Apr 28 22:18:52 devstack sudo[93676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:52 devstack sudo[93671]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:52 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-88e96849-8ddc-42fe-9a22-26401d03158c tempest-VolumeDependencyTests-1826445949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.610s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:52 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-88e96849-8ddc-42fe-9a22-26401d03158c tempest-VolumeDependencyTests-1826445949 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:18:52 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-88e96849-8ddc-42fe-9a22-26401d03158c tempest-VolumeDependencyTests-1826445949 None] Deleted volume successfully.
Apr 28 22:18:52 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-88e96849-8ddc-42fe-9a22-26401d03158c tempest-VolumeDependencyTests-1826445949 None] Lock "cinder-15fd5642-02a9-4f15-a052-b6159a068a24-delete_volume" released by "delete_volume" :: held 2.176s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:18:52 devstack sudo[93676]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:52 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-26c88b2b-1e3a-437b-9927-09493ba7968c tempest-CinderUnicodeTest-1374334805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f05930da-34a5-4c7a-aabf-89f2cc610cea -F qcow2 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f05930da-34a5-4c7a-aabf-89f2cc610cea.d2f0c430-2eeb-468d-8ccc-cef5032ef7bc" returned: 0 in 0.673s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:52 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-26c88b2b-1e3a-437b-9927-09493ba7968c tempest-CinderUnicodeTest-1374334805 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f05930da-34a5-4c7a-aabf-89f2cc610cea.d2f0c430-2eeb-468d-8ccc-cef5032ef7bc is being set with open permissions: ugo+rw
Apr 28 22:18:52 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-26c88b2b-1e3a-437b-9927-09493ba7968c tempest-CinderUnicodeTest-1374334805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f05930da-34a5-4c7a-aabf-89f2cc610cea.d2f0c430-2eeb-468d-8ccc-cef5032ef7bc {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:52 devstack sudo[93682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f05930da-34a5-4c7a-aabf-89f2cc610cea.d2f0c430-2eeb-468d-8ccc-cef5032ef7bc
Apr 28 22:18:52 devstack sudo[93682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:53 devstack sudo[93682]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:53 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-26c88b2b-1e3a-437b-9927-09493ba7968c tempest-CinderUnicodeTest-1374334805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f05930da-34a5-4c7a-aabf-89f2cc610cea.d2f0c430-2eeb-468d-8ccc-cef5032ef7bc" returned: 0 in 0.626s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:53 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-26c88b2b-1e3a-437b-9927-09493ba7968c tempest-CinderUnicodeTest-1374334805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f05930da-34a5-4c7a-aabf-89f2cc610cea.info {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:53 devstack sudo[93686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f05930da-34a5-4c7a-aabf-89f2cc610cea.info
Apr 28 22:18:53 devstack sudo[93686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:54 devstack sudo[93686]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:54 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-26c88b2b-1e3a-437b-9927-09493ba7968c tempest-CinderUnicodeTest-1374334805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f05930da-34a5-4c7a-aabf-89f2cc610cea.info" returned: 0 in 0.629s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:54 devstack cinder-volume[83924]: WARNING cinder.volume.drivers.remotefs [None req-26c88b2b-1e3a-437b-9927-09493ba7968c tempest-CinderUnicodeTest-1374334805 None] /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f05930da-34a5-4c7a-aabf-89f2cc610cea.info is being set with open permissions: ugo+rw
Apr 28 22:18:54 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-26c88b2b-1e3a-437b-9927-09493ba7968c tempest-CinderUnicodeTest-1374334805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f05930da-34a5-4c7a-aabf-89f2cc610cea.info {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:54 devstack sudo[93689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f05930da-34a5-4c7a-aabf-89f2cc610cea.info
Apr 28 22:18:54 devstack sudo[93689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:54 devstack sudo[93689]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:54 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-26c88b2b-1e3a-437b-9927-09493ba7968c tempest-CinderUnicodeTest-1374334805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f05930da-34a5-4c7a-aabf-89f2cc610cea.info" returned: 0 in 0.607s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:54 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-26c88b2b-1e3a-437b-9927-09493ba7968c tempest-CinderUnicodeTest-1374334805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.090s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:18:54 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-26c88b2b-1e3a-437b-9927-09493ba7968c tempest-CinderUnicodeTest-1374334805 None] Create snapshot completed successfully
Apr 28 22:18:55 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-12a8d4e5-e349-4090-98f9-219543eb6ad0 tempest-CinderUnicodeTest-1374334805 None] Acquiring lock "cinder-d2f0c430-2eeb-468d-8ccc-cef5032ef7bc-delete_snapshot" by "delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:18:55 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-12a8d4e5-e349-4090-98f9-219543eb6ad0 tempest-CinderUnicodeTest-1374334805 None] Lock "cinder-d2f0c430-2eeb-468d-8ccc-cef5032ef7bc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:18:55 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-12a8d4e5-e349-4090-98f9-219543eb6ad0 tempest-CinderUnicodeTest-1374334805 None] Acquiring lock "cinder-quobyte-f05930da-34a5-4c7a-aabf-89f2cc610cea" by "delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:18:55 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-12a8d4e5-e349-4090-98f9-219543eb6ad0 tempest-CinderUnicodeTest-1374334805 None] Lock "cinder-quobyte-f05930da-34a5-4c7a-aabf-89f2cc610cea" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:18:55 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-12a8d4e5-e349-4090-98f9-219543eb6ad0 tempest-CinderUnicodeTest-1374334805 None] Acquiring lock "cinder-quobyte-d2f0c430-2eeb-468d-8ccc-cef5032ef7bc" by "_delete_snapshot" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:18:55 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-12a8d4e5-e349-4090-98f9-219543eb6ad0 tempest-CinderUnicodeTest-1374334805 None] Lock "cinder-quobyte-d2f0c430-2eeb-468d-8ccc-cef5032ef7bc" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:18:55 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-12a8d4e5-e349-4090-98f9-219543eb6ad0 tempest-CinderUnicodeTest-1374334805 None] Deleting offline snapshot d2f0c430-2eeb-468d-8ccc-cef5032ef7bc of volume f05930da-34a5-4c7a-aabf-89f2cc610cea {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 22:18:55 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-12a8d4e5-e349-4090-98f9-219543eb6ad0 tempest-CinderUnicodeTest-1374334805 None] snapshot_file for this snap is: volume-f05930da-34a5-4c7a-aabf-89f2cc610cea.d2f0c430-2eeb-468d-8ccc-cef5032ef7bc {{(pid=83924) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 22:18:55 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a91614-a0a6-469e-ae08-de2672b77e89]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:18:55 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-12a8d4e5-e349-4090-98f9-219543eb6ad0 tempest-CinderUnicodeTest-1374334805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f05930da-34a5-4c7a-aabf-89f2cc610cea.d2f0c430-2eeb-468d-8ccc-cef5032ef7bc {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:56 devstack sudo[93692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f05930da-34a5-4c7a-aabf-89f2cc610cea.d2f0c430-2eeb-468d-8ccc-cef5032ef7bc
Apr 28 22:18:56 devstack sudo[93692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:56 devstack sudo[93692]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:56 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-12a8d4e5-e349-4090-98f9-219543eb6ad0 tempest-CinderUnicodeTest-1374334805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f05930da-34a5-4c7a-aabf-89f2cc610cea.d2f0c430-2eeb-468d-8ccc-cef5032ef7bc" returned: 0 in 0.728s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:56 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.remotefs [None req-12a8d4e5-e349-4090-98f9-219543eb6ad0 tempest-CinderUnicodeTest-1374334805 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f05930da-34a5-4c7a-aabf-89f2cc610cea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83924) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 22:18:56 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e52b34-990f-46ca-8cfb-38e6e52770de]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:18:56 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-12a8d4e5-e349-4090-98f9-219543eb6ad0 tempest-CinderUnicodeTest-1374334805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f05930da-34a5-4c7a-aabf-89f2cc610cea {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:56 devstack sudo[93697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f05930da-34a5-4c7a-aabf-89f2cc610cea
Apr 28 22:18:56 devstack sudo[93697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:57 devstack sudo[93697]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:57 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-12a8d4e5-e349-4090-98f9-219543eb6ad0 tempest-CinderUnicodeTest-1374334805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f05930da-34a5-4c7a-aabf-89f2cc610cea" returned: 0 in 0.669s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:57 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-12a8d4e5-e349-4090-98f9-219543eb6ad0 tempest-CinderUnicodeTest-1374334805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f05930da-34a5-4c7a-aabf-89f2cc610cea.d2f0c430-2eeb-468d-8ccc-cef5032ef7bc {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:57 devstack sudo[93702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f05930da-34a5-4c7a-aabf-89f2cc610cea.d2f0c430-2eeb-468d-8ccc-cef5032ef7bc
Apr 28 22:18:57 devstack sudo[93702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:57 devstack sudo[93702]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:57 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-12a8d4e5-e349-4090-98f9-219543eb6ad0 tempest-CinderUnicodeTest-1374334805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f05930da-34a5-4c7a-aabf-89f2cc610cea.d2f0c430-2eeb-468d-8ccc-cef5032ef7bc" returned: 0 in 0.651s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:57 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-12a8d4e5-e349-4090-98f9-219543eb6ad0 tempest-CinderUnicodeTest-1374334805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f05930da-34a5-4c7a-aabf-89f2cc610cea.d2f0c430-2eeb-468d-8ccc-cef5032ef7bc {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:57 devstack sudo[93707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f05930da-34a5-4c7a-aabf-89f2cc610cea.d2f0c430-2eeb-468d-8ccc-cef5032ef7bc
Apr 28 22:18:57 devstack sudo[93707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:58 devstack sudo[93707]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:58 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-12a8d4e5-e349-4090-98f9-219543eb6ad0 tempest-CinderUnicodeTest-1374334805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f05930da-34a5-4c7a-aabf-89f2cc610cea.d2f0c430-2eeb-468d-8ccc-cef5032ef7bc" returned: 0 in 0.558s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:58 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-12a8d4e5-e349-4090-98f9-219543eb6ad0 tempest-CinderUnicodeTest-1374334805 None] Lock "cinder-quobyte-d2f0c430-2eeb-468d-8ccc-cef5032ef7bc" released by "_delete_snapshot" :: held 2.705s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:18:58 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-12a8d4e5-e349-4090-98f9-219543eb6ad0 tempest-CinderUnicodeTest-1374334805 None] Lock "cinder-quobyte-f05930da-34a5-4c7a-aabf-89f2cc610cea" released by "delete_snapshot" :: held 2.728s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:18:58 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-12a8d4e5-e349-4090-98f9-219543eb6ad0 tempest-CinderUnicodeTest-1374334805 None] Created reservations ['f0e01356-7064-488c-99ed-3722418dade5', '3029900f-141f-4255-8a5c-d8472c63316c', '5248b8f0-64bc-4ac6-aea3-7a9e2aa0a992', 'd9a1989b-7497-4498-bb98-6d4ca2d18664'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:18:58 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-12a8d4e5-e349-4090-98f9-219543eb6ad0 tempest-CinderUnicodeTest-1374334805 None] Delete snapshot completed successfully.
Apr 28 22:18:58 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-12a8d4e5-e349-4090-98f9-219543eb6ad0 tempest-CinderUnicodeTest-1374334805 None] Lock "cinder-d2f0c430-2eeb-468d-8ccc-cef5032ef7bc-delete_snapshot" released by "delete_snapshot" :: held 2.849s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:18:59 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-b2a7d223-11ec-423e-9e13-4db4310d78e3 tempest-CinderUnicodeTest-1374334805 None] Acquiring lock "cinder-f05930da-34a5-4c7a-aabf-89f2cc610cea-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:18:59 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-b2a7d223-11ec-423e-9e13-4db4310d78e3 tempest-CinderUnicodeTest-1374334805 None] Lock "cinder-f05930da-34a5-4c7a-aabf-89f2cc610cea-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:18:59 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-b2a7d223-11ec-423e-9e13-4db4310d78e3 tempest-CinderUnicodeTest-1374334805 None] Acquiring lock "cinder-quobyte-f05930da-34a5-4c7a-aabf-89f2cc610cea" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:18:59 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-b2a7d223-11ec-423e-9e13-4db4310d78e3 tempest-CinderUnicodeTest-1374334805 None] Lock "cinder-quobyte-f05930da-34a5-4c7a-aabf-89f2cc610cea" acquired by "delete_volume" :: waited 0.014s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:18:59 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a051f2-c43f-44f7-a657-1fd50f2f1216]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:18:59 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b2a7d223-11ec-423e-9e13-4db4310d78e3 tempest-CinderUnicodeTest-1374334805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f05930da-34a5-4c7a-aabf-89f2cc610cea {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:59 devstack sudo[93710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f05930da-34a5-4c7a-aabf-89f2cc610cea
Apr 28 22:18:59 devstack sudo[93710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:18:59 devstack sudo[93710]: pam_unix(sudo:session): session closed for user root
Apr 28 22:18:59 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b2a7d223-11ec-423e-9e13-4db4310d78e3 tempest-CinderUnicodeTest-1374334805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f05930da-34a5-4c7a-aabf-89f2cc610cea" returned: 0 in 0.695s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:18:59 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b2a7d223-11ec-423e-9e13-4db4310d78e3 tempest-CinderUnicodeTest-1374334805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f05930da-34a5-4c7a-aabf-89f2cc610cea {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:18:59 devstack sudo[93715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f05930da-34a5-4c7a-aabf-89f2cc610cea
Apr 28 22:18:59 devstack sudo[93715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:19:00 devstack sudo[93715]: pam_unix(sudo:session): session closed for user root
Apr 28 22:19:00 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b2a7d223-11ec-423e-9e13-4db4310d78e3 tempest-CinderUnicodeTest-1374334805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-f05930da-34a5-4c7a-aabf-89f2cc610cea" returned: 0 in 0.601s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:19:00 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-b2a7d223-11ec-423e-9e13-4db4310d78e3 tempest-CinderUnicodeTest-1374334805 None] Lock "cinder-quobyte-f05930da-34a5-4c7a-aabf-89f2cc610cea" released by "delete_volume" :: held 1.349s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:19:00 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-b2a7d223-11ec-423e-9e13-4db4310d78e3 tempest-CinderUnicodeTest-1374334805 None] Created reservations ['256a6718-35ce-41d4-9b97-a9c58c552dc7', 'dd8f7e65-1485-4344-8265-ba47949f6b42', 'e241b222-4524-4202-a802-538dec7b87d1', 'd8d3abfa-b725-436c-a707-94c3b8f2f246'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:19:00 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b2a7d223-11ec-423e-9e13-4db4310d78e3 tempest-CinderUnicodeTest-1374334805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:19:00 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b2a7d223-11ec-423e-9e13-4db4310d78e3 tempest-CinderUnicodeTest-1374334805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:19:00 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-b2a7d223-11ec-423e-9e13-4db4310d78e3 tempest-CinderUnicodeTest-1374334805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:19:00 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-b2a7d223-11ec-423e-9e13-4db4310d78e3 tempest-CinderUnicodeTest-1374334805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:19:00 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-b2a7d223-11ec-423e-9e13-4db4310d78e3 tempest-CinderUnicodeTest-1374334805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:19:00 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b2a7d223-11ec-423e-9e13-4db4310d78e3 tempest-CinderUnicodeTest-1374334805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:19:00 devstack sudo[93718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:19:00 devstack sudo[93718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:19:01 devstack sudo[93718]: pam_unix(sudo:session): session closed for user root
Apr 28 22:19:01 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-b2a7d223-11ec-423e-9e13-4db4310d78e3 tempest-CinderUnicodeTest-1374334805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.560s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:19:01 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-b2a7d223-11ec-423e-9e13-4db4310d78e3 tempest-CinderUnicodeTest-1374334805 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:19:01 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-b2a7d223-11ec-423e-9e13-4db4310d78e3 tempest-CinderUnicodeTest-1374334805 None] Deleted volume successfully.
Apr 28 22:19:01 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-b2a7d223-11ec-423e-9e13-4db4310d78e3 tempest-CinderUnicodeTest-1374334805 None] Lock "cinder-f05930da-34a5-4c7a-aabf-89f2cc610cea-delete_volume" released by "delete_volume" :: held 2.082s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:19:01 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-e1e0d118-57b5-4ab9-bc43-c634cf6d6abc tempest-CinderUnicodeTest-1374334805 None] Acquiring lock "cinder-10113798-bd25-4cf7-a058-603a02799831-delete_volume" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:19:01 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-e1e0d118-57b5-4ab9-bc43-c634cf6d6abc tempest-CinderUnicodeTest-1374334805 None] Lock "cinder-10113798-bd25-4cf7-a058-603a02799831-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:19:01 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-e1e0d118-57b5-4ab9-bc43-c634cf6d6abc tempest-CinderUnicodeTest-1374334805 None] Acquiring lock "cinder-quobyte-10113798-bd25-4cf7-a058-603a02799831" by "delete_volume" {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 22:19:01 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-e1e0d118-57b5-4ab9-bc43-c634cf6d6abc tempest-CinderUnicodeTest-1374334805 None] Lock "cinder-quobyte-10113798-bd25-4cf7-a058-603a02799831" acquired by "delete_volume" :: waited 0.017s {{(pid=83924) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 22:19:01 devstack cinder-volume[83924]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd60ce42-7f16-4502-a29d-ed9279146eaf]: (4, 'qcow2') {{(pid=84465) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 22:19:01 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e1e0d118-57b5-4ab9-bc43-c634cf6d6abc tempest-CinderUnicodeTest-1374334805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10113798-bd25-4cf7-a058-603a02799831 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:19:01 devstack sudo[93721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10113798-bd25-4cf7-a058-603a02799831
Apr 28 22:19:01 devstack sudo[93721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:19:02 devstack sudo[93721]: pam_unix(sudo:session): session closed for user root
Apr 28 22:19:02 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e1e0d118-57b5-4ab9-bc43-c634cf6d6abc tempest-CinderUnicodeTest-1374334805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10113798-bd25-4cf7-a058-603a02799831" returned: 0 in 0.708s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:19:02 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e1e0d118-57b5-4ab9-bc43-c634cf6d6abc tempest-CinderUnicodeTest-1374334805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10113798-bd25-4cf7-a058-603a02799831 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:19:02 devstack sudo[93726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10113798-bd25-4cf7-a058-603a02799831
Apr 28 22:19:02 devstack sudo[93726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:19:02 devstack sudo[93726]: pam_unix(sudo:session): session closed for user root
Apr 28 22:19:02 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e1e0d118-57b5-4ab9-bc43-c634cf6d6abc tempest-CinderUnicodeTest-1374334805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6/volume-10113798-bd25-4cf7-a058-603a02799831" returned: 0 in 0.594s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:19:02 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-e1e0d118-57b5-4ab9-bc43-c634cf6d6abc tempest-CinderUnicodeTest-1374334805 None] Lock "cinder-quobyte-10113798-bd25-4cf7-a058-603a02799831" released by "delete_volume" :: held 1.345s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:19:02 devstack cinder-volume[83924]: DEBUG cinder.quota [None req-e1e0d118-57b5-4ab9-bc43-c634cf6d6abc tempest-CinderUnicodeTest-1374334805 None] Created reservations ['ec03ff02-fed8-49b0-8f28-3d7dd1ab1910', '3755d0d0-ec1b-405d-87a4-710cb59c93a7', '7aed6bba-a9ce-4242-8b5b-4eaa76c50e42', '781d329b-5a3d-49f5-845d-98ef0070703e'] {{(pid=83924) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 22:19:02 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-e1e0d118-57b5-4ab9-bc43-c634cf6d6abc tempest-CinderUnicodeTest-1374334805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 22:19:02 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-e1e0d118-57b5-4ab9-bc43-c634cf6d6abc tempest-CinderUnicodeTest-1374334805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 22:19:02 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-e1e0d118-57b5-4ab9-bc43-c634cf6d6abc tempest-CinderUnicodeTest-1374334805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2': None} {{(pid=83924) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 22:19:02 devstack cinder-volume[83924]: DEBUG cinder.volume.drivers.quobyte [None req-e1e0d118-57b5-4ab9-bc43-c634cf6d6abc tempest-CinderUnicodeTest-1374334805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a69f940c-9f0a-46f4-9cd7-fea5245454d2'] {{(pid=83924) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 22:19:02 devstack cinder-volume[83924]: DEBUG oslo_concurrency.lockutils [None req-e1e0d118-57b5-4ab9-bc43-c634cf6d6abc tempest-CinderUnicodeTest-1374334805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83924) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 22:19:02 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e1e0d118-57b5-4ab9-bc43-c634cf6d6abc tempest-CinderUnicodeTest-1374334805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6 {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 22:19:02 devstack sudo[93729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6
Apr 28 22:19:02 devstack sudo[93729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 22:19:03 devstack sudo[93729]: pam_unix(sudo:session): session closed for user root
Apr 28 22:19:03 devstack cinder-volume[83924]: DEBUG oslo_concurrency.processutils [None req-e1e0d118-57b5-4ab9-bc43-c634cf6d6abc tempest-CinderUnicodeTest-1374334805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2ce2a9f719042d7855264ee341d272e6" returned: 0 in 0.612s {{(pid=83924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 22:19:03 devstack cinder-volume[83924]: DEBUG cinder.manager [None req-e1e0d118-57b5-4ab9-bc43-c634cf6d6abc tempest-CinderUnicodeTest-1374334805 None] Notifying Schedulers of capabilities ... {{(pid=83924) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 22:19:03 devstack cinder-volume[83924]: INFO cinder.volume.manager [None req-e1e0d118-57b5-4ab9-bc43-c634cf6d6abc tempest-CinderUnicodeTest-1374334805 None] Deleted volume successfully.
Apr 28 22:19:03 devstack cinder-volume[83924]: DEBUG cinder.coordination [None req-e1e0d118-57b5-4ab9-bc43-c634cf6d6abc tempest-CinderUnicodeTest-1374334805 None] Lock "cinder-10113798-bd25-4cf7-a058-603a02799831-delete_volume" released by "delete_volume" :: held 2.152s {{(pid=83924) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 22:19:12 devstack cinder-volume[83924]: DEBUG dbcounter [-] [83924] Writing DB stats cinder:SELECT=78,cinder:INSERT=31,cinder:UPDATE=111,cinder:DELETE=8 {{(pid=83924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 28 22:19:13 devstack cinder-volume[83924]: DEBUG dbcounter [-] [83924] Writing DB stats cinder:SELECT=83,cinder:INSERT=31,cinder:UPDATE=128,cinder:DELETE=9 {{(pid=83924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}